Apr 15 20:00:38 devstack cinder-volume[72896]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 15 20:00:38 devstack cinder-volume[72896]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 15 20:00:38 devstack cinder-volume[72896]: we strongly recommend against using it for new projects.
Apr 15 20:00:38 devstack cinder-volume[72896]: If you are already using Eventlet, we recommend migrating to a different
Apr 15 20:00:38 devstack cinder-volume[72896]: framework.  For more detail see
Apr 15 20:00:38 devstack cinder-volume[72896]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 15 20:00:38 devstack cinder-volume[72896]:   import eventlet  # noqa
Apr 15 20:00:40 devstack cinder-volume[72896]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72896) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 15 20:00:40 devstack cinder-volume[72896]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72896) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 15 20:00:40 devstack cinder-volume[72896]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72896) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 15 20:00:41 devstack cinder-volume[72896]: INFO dbcounter [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] Registered counter for database cinder
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_db.sqlalchemy.engines [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72896) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG dbcounter [-] [72896] Writer thread running {{(pid=72896) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 15 20:00:41 devstack cinder-volume[72896]: INFO cinder.rpc [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 15 20:00:41 devstack cinder-volume[72896]: INFO cinder.rpc [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_db.sqlalchemy.engines [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72896) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 15 20:00:41 devstack cinder-volume[72896]: INFO cinder.volume.manager [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] Determined volume DB was empty at startup.
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG cinder.volume.manager [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72896) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 15 20:00:41 devstack cinder-volume[72896]: INFO cinder.volume.manager [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 15 20:00:41 devstack cinder-volume[72896]: WARNING stevedore.named [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 15 20:00:41 devstack cinder-volume[72896]: WARNING castellan.key_manager [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 15 20:00:41 devstack cinder-volume[72896]: WARNING cinder.keymgr.conf_key_mgr [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG cinder.volume.drivers.lvm [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72896) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_concurrency.processutils [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72896) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_concurrency.processutils [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] CMD "cinder-rtstool verify" returned: 0 in 0.297s {{(pid=72896) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_db.sqlalchemy.engines [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72896) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 15 20:00:41 devstack cinder-volume[72896]: INFO cinder.rpc [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Apr 15 20:00:41 devstack cinder-volume[72896]: INFO cinder.rpc [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Apr 15 20:00:41 devstack cinder-volume[72896]: WARNING stevedore.named [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 15 20:00:41 devstack cinder-volume[72896]: WARNING castellan.key_manager [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 15 20:00:41 devstack cinder-volume[72896]: INFO cinder.volume.manager [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_db.sqlalchemy.engines [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72896) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 15 20:00:41 devstack cinder-volume[72896]: INFO oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] Starting 1 workers
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] Started child 73035 {{(pid=72896) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] Full set of CONF: {{(pid=72896) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] ******************************************************************************** {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] Configuration options gathered from: {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] ================================================================================ {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] allow_availability_zone_fallback = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] allow_compression_on_image_upload = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] allowed_direct_url_schemes     = [] {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] api_rate_limit                 = True {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] auth_strategy                  = keystone {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] az_cache_duration              = 3600 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_availability_zone      = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_host                   = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_name                   = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[73035]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_stats_polling_interval = 60 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backup_api_class               = cinder.backup.api.API {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backup_name_template           = backup-%s {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backup_use_same_host           = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backup_use_temp_snapshot       = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] chap_password                  = **** {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] chap_username                  =  {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] cinder_internal_tenant_project_id = 4398ad5a4f194f7ca3cb5f269557f26b {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] cinder_internal_tenant_user_id = 1bd0a0f1d9ec4dadb0a33782e91970d4 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] cloned_volume_same_az          = True {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] cluster                        = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] compression_format             = gzip {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] compute_api_class              = cinder.compute.nova.API {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] config_dir                     = [] {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] config_source                  = [] {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] control_exchange               = openstack {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] debug                          = True {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] default_availability_zone      = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] default_group_type             = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] default_volume_type            = lvmdriver-1 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] disk_geometry                  = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] driver_client_cert             = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] driver_client_cert_key         = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] driver_data_namespace          = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] driver_ssl_cert_path           = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] driver_ssl_cert_verify         = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] driver_use_ssl                 = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] enable_force_upload            = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] enable_new_services            = True {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] enable_unsupported_driver      = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] enforce_multipath_for_image_xfer = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] filter_function                = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] glance_api_insecure            = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] glance_api_servers             = ['http://192.168.122.16/image'] {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] glance_api_ssl_compression     = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] glance_ca_certificates_file    = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] glance_catalog_info            = image:glance:publicURL {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] glance_certfile                = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] glance_keyfile                 = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] glance_num_retries             = 3 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] glance_request_timeout         = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] goodness_function              = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] graceful_shutdown_timeout      = 5 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] group_api_class                = cinder.group.api.API {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] host                           = devstack {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] image_compress_on_upload       = True {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] image_conversion_address_space_limit = 1 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] image_conversion_cpu_limit     = 60 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] image_conversion_disable       = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] image_upload_use_cinder_backend = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] image_upload_use_internal_tenant = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] image_volume_cache_enabled     = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] image_volume_cache_max_count   = 0 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] image_volume_cache_max_size_gb = 0 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] init_host_max_objects_retrieval = 0 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] instance_format                = [instance: %(uuid)s]  {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] iscsi_target_flags             =  {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] iscsi_write_cache              = on {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] iser_helper                    = tgtadm {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] iser_ip_address                = 192.168.122.16 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] iser_port                      = 3260 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] log_color                      = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] log_config_append              = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] log_dir                        = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] log_file                       = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] log_options                    = True {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] log_rotate_interval            = 1 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] log_rotate_interval_type       = days {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] log_rotation_type              = none {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] max_age                        = 0 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] max_logfile_count              = 30 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] max_logfile_size_mb            = 200 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] max_over_subscription_ratio    = 20.0 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] message_reap_interval          = 86400 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] message_ttl                    = 2592000 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] migration_create_volume_timeout_secs = 300 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] monkey_patch                   = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] monkey_patch_modules           = [] {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] my_ip                          = 192.168.122.16 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] no_snapshot_gb_quota           = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] num_iser_scan_tries            = 3 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] num_shell_tries                = 3 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] num_volume_device_scan_tries   = 3 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] nvmeof_conn_info_version       = 1 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] nvmet_ns_id                    = 10 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] nvmet_port_id                  = 1 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] osapi_max_limit                = 1000 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] osapi_volume_ext_list          = [] {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] osapi_volume_listen_port       = 8776 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] osapi_volume_use_ssl           = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] osapi_volume_workers           = 2 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] per_volume_size_limit          = -1 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] periodic_fuzzy_delay           = 60 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] periodic_interval              = 60 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] public_endpoint                = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] publish_errors                 = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] quota_backup_gigabytes         = 1000 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] quota_backups                  = 10 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] quota_gigabytes                = 1000 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] quota_groups                   = 10 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] quota_snapshots                = 10 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] quota_volumes                  = 10 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] rate_limit_burst               = 0 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] rate_limit_except_level        = CRITICAL {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] rate_limit_interval            = 0 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] reinit_driver_count            = 3 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] replication_device             = **** {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] report_discard_supported       = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] report_interval                = 120 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] reservation_clean_interval     = 86400 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] reservation_expire             = 86400 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] reserved_image_namespaces      = [] {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] reserved_percentage            = 0 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] rpc_response_timeout           = 120 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] run_external_periodic_tasks    = True {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] scst_target_driver             = iscsi {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] scst_target_iqn_name           = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] service_down_time              = 720 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] shell_completion               = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] snapshot_name_template         = snapshot-%s {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] snapshot_same_host             = True {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] split_loggers                  = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] state_path                     = /opt/stack/data/cinder {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] storage_availability_zone      = nova {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] storage_protocol               = iSCSI {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] syslog_log_facility            = LOG_USER {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] target_helper                  = lioadm {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] target_ip_address              = 192.168.122.16 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] target_port                    = 3260 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] target_protocol                = iscsi {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] target_secondary_ip_addresses  = [] {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] trace_flags                    = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] transport_url                  = **** {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] until_refresh                  = 0 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] use_chap_auth                  = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] use_default_quota_class        = True {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] use_journal                    = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] use_json                       = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] use_multipath_for_image_xfer   = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] use_stderr                     = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] use_syslog                     = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] verify_glance_signatures       = enabled {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] volume_api_class               = cinder.volume.api.API {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] volume_backend_name            = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] volume_clear                   = zero {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] volume_clear_ionice            = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] volume_clear_size              = 0 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] volume_copy_bps_limit          = 0 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] volume_dd_blocksize            = 1M {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] volume_name_template           = volume-%s {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] volume_service_inithost_offload = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] volume_usage_audit_period      = month {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] zoning_mode                    = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] oslo_concurrency.disable_process_locking = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] keystone_authtoken.admin_password = **** {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] keystone_authtoken.admin_token = **** {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] keystone_authtoken.admin_user  = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] keystone_authtoken.auth_port   = 35357 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] keystone_authtoken.auth_protocol = https {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] keystone_authtoken.auth_section = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] keystone_authtoken.auth_type   = password {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] keystone_authtoken.auth_uri    = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] keystone_authtoken.auth_version = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] keystone_authtoken.cache       = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] keystone_authtoken.certfile    = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] keystone_authtoken.delay_auth_decision = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[73035]: INFO cinder.volume.manager [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] Starting volume driver LVMVolumeDriver (3.0.0)
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] keystone_authtoken.http_connect_timeout = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] keystone_authtoken.identity_uri = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] keystone_authtoken.include_service_catalog = True {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] keystone_authtoken.insecure    = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] keystone_authtoken.interface   = public {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] keystone_authtoken.keyfile     = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] keystone_authtoken.memcache_password =  {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] keystone_authtoken.memcache_username =  {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] keystone_authtoken.region_name = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] keystone_authtoken.service_token_roles_required = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] keystone_authtoken.service_type = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] keystone_authtoken.token_cache_time = 300 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.16/identity {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] cache.backend                  = dogpile.cache.null {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] cache.backend_argument         = **** {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] cache.backend_expiration_time  = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] cache.config_prefix            = cache.oslo {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] cache.debug_cache_backend      = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] cache.enable_retry_client      = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] cache.enable_socket_keepalive  = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] cache.enabled                  = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] cache.enforce_fips_mode        = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] cache.expiration_time          = 600 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] cache.hashclient_retry_attempts = 2 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] cache.memcache_dead_retry      = 300 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] cache.memcache_pool_maxsize    = 10 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] cache.memcache_sasl_enabled    = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] cache.password                 = **** {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] cache.proxies                  = [] {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] cache.redis_db                 = 0 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] cache.redis_sentinel_service_name = mymaster {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] cache.redis_server             = localhost:6379 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] cache.retry_attempts           = 2 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] cache.retry_delay              = 0.0 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:41 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] cache.socket_keepalive_count   = 1 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] cache.socket_keepalive_idle    = 1 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] cache.socket_keepalive_interval = 1 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] cache.socket_timeout           = 1.0 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] cache.tls_allowed_ciphers      = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] cache.tls_cafile               = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] cache.tls_certfile             = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] cache.tls_enabled              = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] cache.tls_keyfile              = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] cache.username                 = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] coordination.backend_url       = **** {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] database.asyncio_connection    = **** {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] database.asyncio_slave_connection = **** {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] database.backend               = sqlalchemy {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] database.connection            = **** {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] database.connection_debug      = 0 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] database.connection_parameters =  {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] database.connection_recycle_time = 3600 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] database.connection_trace      = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] database.db_inc_retry_interval = True {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] database.db_max_retries        = 20 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] database.db_max_retry_interval = 10 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] database.db_retry_interval     = 1 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] database.max_overflow          = 50 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] database.max_pool_size         = 5 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] database.max_retries           = 10 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] database.mysql_wsrep_sync_wait = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] database.pool_timeout          = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] database.retry_interval        = 10 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] database.slave_connection      = **** {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] database.sqlite_synchronous    = True {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] database.synchronous_reader    = True {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] database.use_db_reconnect      = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] profiler.connection_string     = messaging:// {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] profiler.enabled               = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] profiler.es_doc_type           = notification {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] profiler.es_scroll_size        = 10000 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] profiler.es_scroll_time        = 2m {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] profiler.filter_error_trace    = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] profiler.hmac_keys             = **** {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] profiler.sentinel_service_name = mymaster {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] profiler.socket_timeout        = 0.1 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] profiler.trace_requests        = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] profiler.trace_sqlalchemy      = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] profiler_jaeger.process_tags   = {} {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] profiler_jaeger.service_name_prefix = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] profiler_otlp.service_name_prefix = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] oslo_policy.enforce_new_defaults = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: WARNING oslo_config.cfg [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] oslo_policy.enforce_scope      = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] oslo_policy.policy_default_rule = default {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] oslo_policy.policy_file        = policy.yaml {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] privsep_osbrick.group          = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] privsep_osbrick.helper_command = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] privsep_osbrick.user           = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] cinder_sys_admin.group         = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] cinder_sys_admin.helper_command = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] cinder_sys_admin.user          = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] service_user.auth_section      = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] service_user.auth_type         = password {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] service_user.cafile            = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] service_user.certfile          = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] service_user.collect_timing    = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] service_user.insecure          = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] service_user.keyfile           = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] service_user.send_service_user_token = True {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] service_user.split_loggers     = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] service_user.timeout           = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] glance.auth_section            = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] glance.auth_type               = password {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] glance.certfile                = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] glance.collect_timing          = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] glance.insecure                = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] glance.keyfile                 = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] glance.region_name             = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] glance.split_loggers           = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] glance.timeout                 = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.045s {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_defaults.backend_availability_zone = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_defaults.chap_password = **** {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_defaults.chap_username =  {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_defaults.disk_geometry = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_defaults.driver_client_cert = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_defaults.driver_client_cert_key = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_defaults.driver_data_namespace = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_defaults.driver_use_ssl = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_defaults.enable_unsupported_driver = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_defaults.extra_capabilities = {} {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_defaults.filter_function = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_defaults.goodness_function = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_defaults.iscsi_target_flags =  {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_defaults.iscsi_write_cache = on {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_defaults.iser_helper   = tgtadm {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_defaults.iser_ip_address = 192.168.122.16 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_defaults.iser_port     = 3260 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_defaults.lvm_share_target = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_defaults.lvm_type      = auto {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_defaults.num_shell_tries = 3 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_defaults.nvmet_port_id = 1 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_defaults.replication_device = **** {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_defaults.report_discard_supported = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_defaults.reserved_percentage = 0 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_defaults.scst_target_driver = iscsi {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_defaults.scst_target_iqn_name = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_defaults.storage_protocol = iSCSI {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_defaults.target_helper = tgtadm {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_defaults.target_ip_address = 192.168.122.16 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_defaults.target_port   = 3260 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_defaults.target_protocol = iscsi {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_defaults.trace_flags   = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_defaults.unique_fqdn_network = True {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_defaults.use_chap_auth = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_defaults.volume_backend_name = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_defaults.volume_clear  = zero {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_defaults.volume_clear_ionice = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_defaults.volume_clear_size = 0 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] oslo_reports.file_event_handler = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] oslo_reports.log_dir           = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] lvmdriver-1.backend_availability_zone = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] lvmdriver-1.backend_host       = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] lvmdriver-1.chap_password      = **** {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] lvmdriver-1.chap_username      = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] lvmdriver-1.disk_geometry      = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] lvmdriver-1.driver_client_cert = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] lvmdriver-1.driver_data_namespace = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] lvmdriver-1.extra_capabilities = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] lvmdriver-1.filter_function    = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] lvmdriver-1.goodness_function  = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] lvmdriver-1.iser_helper        = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] lvmdriver-1.iser_ip_address    = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] lvmdriver-1.iser_port          = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] lvmdriver-1.iser_target_prefix = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] lvmdriver-1.lvm_share_target   = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] lvmdriver-1.lvm_type           = auto {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] lvmdriver-1.num_shell_tries    = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] lvmdriver-1.replication_device = **** {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] lvmdriver-1.report_discard_supported = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] lvmdriver-1.reserved_percentage = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] lvmdriver-1.scst_target_driver = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] lvmdriver-1.storage_protocol   = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] lvmdriver-1.target_helper      = lioadm {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] lvmdriver-1.target_ip_address  = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] lvmdriver-1.target_port        = 3260 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] lvmdriver-1.trace_flags        = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] lvmdriver-1.use_chap_auth      = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] lvmdriver-1.volume_clear       = zero {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] lvmdriver-1.volume_clear_size  = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] lvmdriver-1.volumes_dir        = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] oslo_messaging_rabbit.ssl      = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] oslo_messaging_notifications.driver = [] {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] oslo_messaging_notifications.retry = -1 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] key_manager.fixed_key          = **** {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] barbican.barbican_api_version  = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] barbican.barbican_endpoint     = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] barbican.barbican_endpoint_type = public {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] barbican.barbican_region_name  = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] barbican.cafile                = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] barbican.certfile              = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] barbican.collect_timing        = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] barbican.insecure              = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] barbican.keyfile               = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] barbican.number_of_retries     = 60 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] barbican.retry_delay           = 1 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] barbican.send_service_user_token = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] barbican.split_loggers         = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] barbican.timeout               = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] barbican.verify_ssl            = True {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] barbican.verify_ssl_path       = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] barbican_service_user.auth_section = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] barbican_service_user.auth_type = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] barbican_service_user.cafile   = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] barbican_service_user.certfile = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] barbican_service_user.collect_timing = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] barbican_service_user.insecure = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] barbican_service_user.keyfile  = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] barbican_service_user.split_loggers = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] barbican_service_user.timeout  = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.052s {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] vault.approle_role_id          = **** {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] vault.approle_secret_id        = **** {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] vault.kv_mountpoint            = secret {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] vault.kv_path                  = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] vault.kv_version               = 2 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] vault.namespace                = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] vault.root_token_id            = **** {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] vault.ssl_ca_crt_file          = None {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] vault.timeout                  = 60.0 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] vault.use_ssl                  = False {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:00:42 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] ******************************************************************************** {{(pid=72896) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 15 20:00:42 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.013s {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:00:42 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:00:42 devstack sudo[73045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Apr 15 20:00:42 devstack sudo[73045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:00:42 devstack sudo[73045]: pam_unix(sudo:session): session closed for user root
Apr 15 20:00:42 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.547s {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:00:42 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:00:42 devstack sudo[73160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 15 20:00:42 devstack sudo[73160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:00:43 devstack sudo[73160]: pam_unix(sudo:session): session closed for user root
Apr 15 20:00:43 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.477s {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:00:43 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 20:00:43 devstack cinder-volume[73035]: INFO cinder.brick.local_dev.lvm [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Apr 15 20:00:43 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:00:43 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:00:43 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:00:43 devstack sudo[73367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 15 20:00:43 devstack sudo[73367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:00:43 devstack sudo[73367]: pam_unix(sudo:session): session closed for user root
Apr 15 20:00:43 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.568s {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:00:43 devstack cinder-volume[73035]: DEBUG cinder.brick.local_dev.lvm [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=73035) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Apr 15 20:00:43 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:00:43 devstack sudo[73561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 15 20:00:43 devstack sudo[73561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:00:44 devstack sudo[73561]: pam_unix(sudo:session): session closed for user root
Apr 15 20:00:44 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.792s {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:00:44 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:00:44 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:00:44 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:00:44 devstack sudo[73676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 15 20:00:44 devstack sudo[73676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:00:45 devstack sudo[73676]: pam_unix(sudo:session): session closed for user root
Apr 15 20:00:45 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.509s {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:00:45 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:00:45 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:00:45 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:00:45 devstack sudo[73735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Apr 15 20:00:45 devstack sudo[73735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:00:45 devstack sudo[73735]: pam_unix(sudo:session): session closed for user root
Apr 15 20:00:45 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.483s {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:00:45 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:00:45 devstack sudo[73738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 15 20:00:45 devstack sudo[73738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:00:46 devstack sudo[73738]: pam_unix(sudo:session): session closed for user root
Apr 15 20:00:46 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.479s {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:00:46 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:00:46 devstack sudo[73747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 15 20:00:46 devstack sudo[73747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:00:46 devstack sudo[73747]: pam_unix(sudo:session): session closed for user root
Apr 15 20:00:46 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.444s {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:00:46 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:00:46 devstack sudo[73750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 15 20:00:46 devstack sudo[73750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:00:46 devstack sudo[73750]: pam_unix(sudo:session): session closed for user root
Apr 15 20:00:46 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.504s {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:00:46 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:00:47 devstack sudo[73755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 15 20:00:47 devstack sudo[73755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:00:47 devstack sudo[73755]: pam_unix(sudo:session): session closed for user root
Apr 15 20:00:47 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.486s {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:00:47 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:00:47 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:00:47 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:00:47 devstack sudo[73759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 15 20:00:47 devstack sudo[73759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:00:48 devstack sudo[73759]: pam_unix(sudo:session): session closed for user root
Apr 15 20:00:48 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.536s {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:00:48 devstack cinder-volume[73035]: INFO cinder.volume.drivers.lvm [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] Enabling LVM thin provisioning by default because a thin pool exists.
Apr 15 20:00:48 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:00:48 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.012s {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:00:48 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:00:48 devstack sudo[73772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 15 20:00:48 devstack sudo[73772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:00:48 devstack sudo[73772]: pam_unix(sudo:session): session closed for user root
Apr 15 20:00:48 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.532s {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:00:48 devstack cinder-volume[73035]: DEBUG cinder.volume.drivers.lvm [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] Updating volume stats {{(pid=73035) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 15 20:00:48 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:00:48 devstack sudo[73885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 15 20:00:48 devstack sudo[73885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:00:49 devstack sudo[73885]: pam_unix(sudo:session): session closed for user root
Apr 15 20:00:49 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.436s {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:00:49 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:00:49 devstack sudo[73902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 15 20:00:49 devstack sudo[73902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:00:49 devstack sudo[73902]: pam_unix(sudo:session): session closed for user root
Apr 15 20:00:49 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.428s {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:00:49 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:00:49 devstack sudo[74026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 15 20:00:49 devstack sudo[74026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:00:49 devstack sudo[74026]: pam_unix(sudo:session): session closed for user root
Apr 15 20:00:49 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.480s {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:00:49 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:00:49 devstack sudo[74033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 15 20:00:49 devstack sudo[74033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:00:50 devstack sudo[74033]: pam_unix(sudo:session): session closed for user root
Apr 15 20:00:50 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.421s {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:00:50 devstack cinder-volume[73035]: INFO cinder.volume.driver [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] Driver hasn't implemented _init_vendor_properties()
Apr 15 20:00:50 devstack cinder-volume[73035]: DEBUG cinder.volume.driver [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=73035) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 15 20:00:50 devstack cinder-volume[73035]: DEBUG oslo_db.sqlalchemy.engines [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73035) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 15 20:00:50 devstack cinder-volume[73035]: DEBUG dbcounter [-] [73035] Writer thread running {{(pid=73035) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 15 20:00:50 devstack cinder-volume[73035]: DEBUG cinder.db.sqlalchemy.api [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] Building query based on filter {{(pid=73035) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 15 20:00:50 devstack cinder-volume[73035]: DEBUG cinder.image.image_utils [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=73035) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 15 20:00:50 devstack cinder-volume[73035]: INFO cinder.keymgr.migration [None req-d75aa647-c520-4b9b-96a5-177024bce1f4 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 15 20:00:50 devstack cinder-volume[73035]: DEBUG cinder.volume.drivers.lvm [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] Updating volume stats {{(pid=73035) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 15 20:00:50 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:00:50 devstack sudo[74037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 15 20:00:50 devstack sudo[74037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:00:50 devstack sudo[74037]: pam_unix(sudo:session): session closed for user root
Apr 15 20:00:50 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.490s {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:00:50 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:00:50 devstack sudo[74041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 15 20:00:50 devstack sudo[74041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:00:51 devstack sudo[74041]: pam_unix(sudo:session): session closed for user root
Apr 15 20:00:51 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.493s {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:00:51 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:00:51 devstack sudo[74045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 15 20:00:51 devstack sudo[74045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:00:51 devstack sudo[74045]: pam_unix(sudo:session): session closed for user root
Apr 15 20:00:51 devstack cinder-volume[72896]: DEBUG dbcounter [-] [72896] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72896) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 20:00:51 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.493s {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:00:51 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:00:51 devstack sudo[74050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 15 20:00:51 devstack sudo[74050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:00:52 devstack sudo[74050]: pam_unix(sudo:session): session closed for user root
Apr 15 20:00:52 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.498s {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:00:52 devstack cinder-volume[73035]: DEBUG cinder.manager [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] Notifying Schedulers of capabilities ... {{(pid=73035) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:00:52 devstack cinder-volume[73035]: INFO cinder.volume.manager [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] Driver initialization completed successfully.
Apr 15 20:00:52 devstack cinder-volume[73035]: INFO cinder.manager [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] Initiating service 2 cleanup
Apr 15 20:00:52 devstack cinder-volume[73035]: INFO cinder.manager [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] Service 2 cleanup completed.
Apr 15 20:00:52 devstack cinder-volume[73035]: DEBUG cinder.service [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] Creating RPC server for service cinder-volume {{(pid=73035) start /opt/stack/cinder/cinder/service.py:231}}
Apr 15 20:00:52 devstack cinder-volume[73035]: DEBUG cinder.service [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=73035) start /opt/stack/cinder/cinder/service.py:237}}
Apr 15 20:00:52 devstack cinder-volume[73035]: INFO cinder.volume.manager [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Apr 15 20:00:52 devstack cinder-volume[73035]: DEBUG cinder.volume.drivers.lvm [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] Updating volume stats {{(pid=73035) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 15 20:00:52 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:00:52 devstack sudo[74059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 15 20:00:52 devstack sudo[74059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:00:52 devstack sudo[74059]: pam_unix(sudo:session): session closed for user root
Apr 15 20:00:52 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.486s {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:00:52 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:00:52 devstack sudo[74062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 15 20:00:52 devstack sudo[74062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:00:53 devstack sudo[74062]: pam_unix(sudo:session): session closed for user root
Apr 15 20:00:53 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.434s {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:00:53 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:00:53 devstack sudo[74119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 15 20:00:53 devstack sudo[74119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:00:53 devstack sudo[74119]: pam_unix(sudo:session): session closed for user root
Apr 15 20:00:53 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.426s {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:00:53 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:00:53 devstack sudo[74122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 15 20:00:53 devstack sudo[74122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:00:54 devstack sudo[74122]: pam_unix(sudo:session): session closed for user root
Apr 15 20:00:54 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.441s {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:00:54 devstack cinder-volume[73035]: INFO cinder.volume.manager [None req-d426600a-fe8c-4c15-b03b-02910f90e7bd None None] Driver post RPC initialization completed successfully.
Apr 15 20:01:02 devstack cinder-volume[73035]: DEBUG dbcounter [-] [73035] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=73035) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 20:01:04 devstack cinder-volume[73035]: DEBUG dbcounter [-] [73035] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=73035) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 20:02:01 devstack cinder-volume[73035]: DEBUG oslo_service.periodic_task [None req-069431d8-c613-47a8-b59e-043bc89528fa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73035) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 15 20:02:01 devstack cinder-volume[73035]: DEBUG cinder.volume.drivers.lvm [None req-069431d8-c613-47a8-b59e-043bc89528fa None None] Updating volume stats {{(pid=73035) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 15 20:02:01 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-069431d8-c613-47a8-b59e-043bc89528fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:02:01 devstack sudo[78869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 15 20:02:01 devstack sudo[78869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:02:01 devstack sudo[78869]: pam_unix(sudo:session): session closed for user root
Apr 15 20:02:01 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-069431d8-c613-47a8-b59e-043bc89528fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.437s {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:02:01 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-069431d8-c613-47a8-b59e-043bc89528fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:02:01 devstack sudo[78873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 15 20:02:01 devstack sudo[78873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:02:02 devstack sudo[78873]: pam_unix(sudo:session): session closed for user root
Apr 15 20:02:02 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-069431d8-c613-47a8-b59e-043bc89528fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.445s {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:02:02 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-069431d8-c613-47a8-b59e-043bc89528fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:02:02 devstack sudo[78877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 15 20:02:02 devstack sudo[78877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:02:02 devstack sudo[78877]: pam_unix(sudo:session): session closed for user root
Apr 15 20:02:02 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-069431d8-c613-47a8-b59e-043bc89528fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.443s {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:02:02 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-069431d8-c613-47a8-b59e-043bc89528fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:02:02 devstack sudo[78883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 15 20:02:02 devstack sudo[78883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:02:03 devstack sudo[78883]: pam_unix(sudo:session): session closed for user root
Apr 15 20:02:03 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-069431d8-c613-47a8-b59e-043bc89528fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.439s {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:02:03 devstack cinder-volume[73035]: DEBUG cinder.manager [None req-069431d8-c613-47a8-b59e-043bc89528fa None None] Notifying Schedulers of capabilities ... {{(pid=73035) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:03:01 devstack cinder-volume[73035]: DEBUG oslo_service.periodic_task [None req-069431d8-c613-47a8-b59e-043bc89528fa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73035) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 15 20:03:01 devstack cinder-volume[73035]: DEBUG cinder.volume.drivers.lvm [None req-069431d8-c613-47a8-b59e-043bc89528fa None None] Updating volume stats {{(pid=73035) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 15 20:03:01 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-069431d8-c613-47a8-b59e-043bc89528fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:03:01 devstack sudo[80523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 15 20:03:01 devstack sudo[80523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:03:01 devstack sudo[80523]: pam_unix(sudo:session): session closed for user root
Apr 15 20:03:01 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-069431d8-c613-47a8-b59e-043bc89528fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.482s {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:03:01 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-069431d8-c613-47a8-b59e-043bc89528fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:03:01 devstack sudo[80546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 15 20:03:01 devstack sudo[80546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:03:02 devstack sudo[80546]: pam_unix(sudo:session): session closed for user root
Apr 15 20:03:02 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-069431d8-c613-47a8-b59e-043bc89528fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.464s {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:03:02 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-069431d8-c613-47a8-b59e-043bc89528fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:03:02 devstack sudo[80567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 15 20:03:02 devstack sudo[80567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:03:02 devstack sudo[80567]: pam_unix(sudo:session): session closed for user root
Apr 15 20:03:02 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-069431d8-c613-47a8-b59e-043bc89528fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.446s {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:03:02 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-069431d8-c613-47a8-b59e-043bc89528fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:03:02 devstack sudo[80587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 15 20:03:02 devstack sudo[80587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:03:03 devstack sudo[80587]: pam_unix(sudo:session): session closed for user root
Apr 15 20:03:03 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-069431d8-c613-47a8-b59e-043bc89528fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.441s {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:03:03 devstack cinder-volume[73035]: DEBUG cinder.manager [None req-069431d8-c613-47a8-b59e-043bc89528fa None None] Notifying Schedulers of capabilities ... {{(pid=73035) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:03:04 devstack cinder-volume[73035]: DEBUG dbcounter [-] [73035] Writing DB stats cinder:SELECT=1 {{(pid=73035) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 20:03:04 devstack cinder-volume[73035]: DEBUG dbcounter [-] [73035] Writing DB stats cinder:UPDATE=1 {{(pid=73035) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 20:04:01 devstack cinder-volume[73035]: DEBUG oslo_service.periodic_task [None req-069431d8-c613-47a8-b59e-043bc89528fa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73035) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 15 20:04:01 devstack cinder-volume[73035]: DEBUG cinder.volume.drivers.lvm [None req-069431d8-c613-47a8-b59e-043bc89528fa None None] Updating volume stats {{(pid=73035) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 15 20:04:01 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-069431d8-c613-47a8-b59e-043bc89528fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:04:01 devstack sudo[81920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 15 20:04:01 devstack sudo[81920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:04:01 devstack sudo[81920]: pam_unix(sudo:session): session closed for user root
Apr 15 20:04:01 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-069431d8-c613-47a8-b59e-043bc89528fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.465s {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:04:01 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-069431d8-c613-47a8-b59e-043bc89528fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:04:01 devstack sudo[81937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 15 20:04:01 devstack sudo[81937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:04:02 devstack sudo[81937]: pam_unix(sudo:session): session closed for user root
Apr 15 20:04:02 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-069431d8-c613-47a8-b59e-043bc89528fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.432s {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:04:02 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-069431d8-c613-47a8-b59e-043bc89528fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:04:02 devstack sudo[81960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 15 20:04:02 devstack sudo[81960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:04:02 devstack sudo[81960]: pam_unix(sudo:session): session closed for user root
Apr 15 20:04:02 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-069431d8-c613-47a8-b59e-043bc89528fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.447s {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:04:02 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-069431d8-c613-47a8-b59e-043bc89528fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:04:02 devstack sudo[81986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 15 20:04:02 devstack sudo[81986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:04:03 devstack sudo[81986]: pam_unix(sudo:session): session closed for user root
Apr 15 20:04:03 devstack cinder-volume[73035]: DEBUG oslo_concurrency.processutils [None req-069431d8-c613-47a8-b59e-043bc89528fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.444s {{(pid=73035) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:04:03 devstack cinder-volume[73035]: DEBUG cinder.manager [None req-069431d8-c613-47a8-b59e-043bc89528fa None None] Notifying Schedulers of capabilities ... {{(pid=73035) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:04:04 devstack cinder-volume[72896]: INFO oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] Caught SIGTERM, stopping children
Apr 15 20:04:04 devstack cinder-volume[72896]: DEBUG oslo_concurrency.lockutils [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] Acquiring lock "singleton_lock" {{(pid=72896) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 15 20:04:04 devstack cinder-volume[72896]: DEBUG oslo_concurrency.lockutils [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] Acquired lock "singleton_lock" {{(pid=72896) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 15 20:04:04 devstack cinder-volume[72896]: DEBUG oslo_concurrency.lockutils [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] Releasing lock "singleton_lock" {{(pid=72896) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 15 20:04:04 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] Stop services. {{(pid=72896) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 15 20:04:04 devstack cinder-volume[72896]: DEBUG oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] Killing children. {{(pid=72896) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 15 20:04:04 devstack cinder-volume[72896]: INFO oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] Waiting on 1 children to exit
Apr 15 20:04:07 devstack cinder-volume[73035]: DEBUG oslo_concurrency.lockutils [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] Acquiring lock "singleton_lock" {{(pid=73035) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 15 20:04:07 devstack cinder-volume[73035]: DEBUG oslo_concurrency.lockutils [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] Acquired lock "singleton_lock" {{(pid=73035) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 15 20:04:07 devstack cinder-volume[73035]: DEBUG oslo_concurrency.lockutils [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] Releasing lock "singleton_lock" {{(pid=73035) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 15 20:04:07 devstack cinder-volume[73035]: WARNING amqp [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 15 20:04:07 devstack cinder-volume[73035]: WARNING amqp [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 15 20:04:07 devstack cinder-volume[72896]: INFO oslo_service.backend._eventlet.service [None req-9ecfb0ca-1be5-4e5a-8e05-a582ad303d81 None None] Child 73035 exited with status 0
Apr 15 20:04:07 devstack cinder-volume[82094]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 15 20:04:07 devstack cinder-volume[82094]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 15 20:04:07 devstack cinder-volume[82094]: we strongly recommend against using it for new projects.
Apr 15 20:04:07 devstack cinder-volume[82094]: If you are already using Eventlet, we recommend migrating to a different
Apr 15 20:04:07 devstack cinder-volume[82094]: framework.  For more detail see
Apr 15 20:04:07 devstack cinder-volume[82094]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 15 20:04:07 devstack cinder-volume[82094]:   import eventlet  # noqa
Apr 15 20:04:09 devstack cinder-volume[82094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 15 20:04:09 devstack cinder-volume[82094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 15 20:04:09 devstack cinder-volume[82094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 15 20:04:10 devstack cinder-volume[82094]: INFO dbcounter [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] Registered counter for database cinder
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_db.sqlalchemy.engines [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82094) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG dbcounter [-] [82094] Writer thread running {{(pid=82094) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 15 20:04:10 devstack cinder-volume[82094]: INFO cinder.rpc [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 15 20:04:10 devstack cinder-volume[82094]: INFO cinder.rpc [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_db.sqlalchemy.engines [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82094) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 15 20:04:10 devstack cinder-volume[82094]: INFO cinder.volume.manager [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] Determined volume DB was empty at startup.
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG cinder.volume.manager [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82094) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 15 20:04:10 devstack cinder-volume[82094]: INFO cinder.volume.manager [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 15 20:04:10 devstack cinder-volume[82094]: WARNING stevedore.named [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 15 20:04:10 devstack cinder-volume[82094]: WARNING castellan.key_manager [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 15 20:04:10 devstack cinder-volume[82094]: WARNING cinder.keymgr.conf_key_mgr [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 15 20:04:10 devstack cinder-volume[82094]: INFO cinder.volume.manager [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_db.sqlalchemy.engines [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82094) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 15 20:04:10 devstack cinder-volume[82094]: INFO oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] Starting 1 workers
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] Started child 82209 {{(pid=82094) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] Full set of CONF: {{(pid=82094) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] ******************************************************************************** {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] Configuration options gathered from: {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] ================================================================================ {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] allow_availability_zone_fallback = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] allow_compression_on_image_upload = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] allowed_direct_url_schemes     = [] {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] api_rate_limit                 = True {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] auth_strategy                  = keystone {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_availability_zone      = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_host                   = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_name                   = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_stats_polling_interval = 60 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backup_api_class               = cinder.backup.api.API {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backup_name_template           = backup-%s {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backup_use_same_host           = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backup_use_temp_snapshot       = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] chap_password                  = **** {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] chap_username                  =  {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] cinder_internal_tenant_project_id = 4398ad5a4f194f7ca3cb5f269557f26b {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] cinder_internal_tenant_user_id = 1bd0a0f1d9ec4dadb0a33782e91970d4 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] cluster                        = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] compression_format             = gzip {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] compute_api_class              = cinder.compute.nova.API {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] config_dir                     = [] {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] config_source                  = [] {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] control_exchange               = openstack {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] debug                          = True {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] default_availability_zone      = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] default_group_type             = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] default_volume_type            = QuobyteHD {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] disk_geometry                  = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] driver_client_cert             = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] driver_client_cert_key         = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] driver_data_namespace          = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] driver_ssl_cert_path           = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] driver_ssl_cert_verify         = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] driver_use_ssl                 = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] enable_new_services            = True {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] enable_unsupported_driver      = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] enabled_backends               = ['QuobyteHD'] {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] enforce_multipath_for_image_xfer = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] filter_function                = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] glance_api_insecure            = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] glance_api_servers             = ['http://192.168.122.16/image'] {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] glance_api_ssl_compression     = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] glance_ca_certificates_file    = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] glance_catalog_info            = image:glance:publicURL {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] glance_certfile                = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82209]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] glance_keyfile                 = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] glance_num_retries             = 3 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] glance_request_timeout         = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] goodness_function              = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] graceful_shutdown_timeout      = 5 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] group_api_class                = cinder.group.api.API {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] host                           = devstack {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] image_compress_on_upload       = True {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] image_conversion_address_space_limit = 1 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] image_conversion_cpu_limit     = 60 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] image_conversion_disable       = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] image_upload_use_cinder_backend = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] image_upload_use_internal_tenant = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] image_volume_cache_enabled     = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] image_volume_cache_max_count   = 0 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] image_volume_cache_max_size_gb = 0 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] init_host_max_objects_retrieval = 0 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] instance_format                = [instance: %(uuid)s]  {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] iscsi_target_flags             =  {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] iscsi_write_cache              = on {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] iser_helper                    = tgtadm {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] iser_ip_address                = 192.168.122.16 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] iser_port                      = 3260 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] log_color                      = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] log_config_append              = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] log_dir                        = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] log_file                       = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] log_options                    = True {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] log_rotate_interval            = 1 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] log_rotate_interval_type       = days {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] log_rotation_type              = none {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] max_age                        = 0 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] max_logfile_count              = 30 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] max_logfile_size_mb            = 200 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] max_over_subscription_ratio    = 20.0 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] message_reap_interval          = 86400 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] message_ttl                    = 2592000 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] migration_create_volume_timeout_secs = 300 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] monkey_patch                   = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] monkey_patch_modules           = [] {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] my_ip                          = 192.168.122.16 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] no_snapshot_gb_quota           = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] num_iser_scan_tries            = 3 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] num_shell_tries                = 3 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] num_volume_device_scan_tries   = 3 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] nvmeof_conn_info_version       = 1 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] nvmet_ns_id                    = 10 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] nvmet_port_id                  = 1 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] osapi_max_limit                = 1000 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] osapi_volume_ext_list          = [] {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] osapi_volume_listen_port       = 8776 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] osapi_volume_use_ssl           = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] osapi_volume_workers           = 2 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] per_volume_size_limit          = -1 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] periodic_fuzzy_delay           = 60 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] periodic_interval              = 60 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] public_endpoint                = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] publish_errors                 = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] quota_backup_gigabytes         = 1000 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] quota_backups                  = 10 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] quota_gigabytes                = 1000 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] quota_groups                   = 10 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] quota_snapshots                = 10 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] quota_volumes                  = 10 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] rate_limit_burst               = 0 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] rate_limit_except_level        = CRITICAL {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] rate_limit_interval            = 0 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] reinit_driver_count            = 3 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] replication_device             = **** {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] report_discard_supported       = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] report_interval                = 120 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] reservation_clean_interval     = 86400 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] reservation_expire             = 86400 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] reserved_image_namespaces      = [] {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] reserved_percentage            = 0 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] rpc_response_timeout           = 120 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] run_external_periodic_tasks    = True {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] scst_target_driver             = iscsi {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] scst_target_iqn_name           = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] service_down_time              = 720 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] shell_completion               = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] snapshot_name_template         = snapshot-%s {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] split_loggers                  = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] state_path                     = /opt/stack/data/cinder {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] storage_availability_zone      = nova {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82209]: INFO cinder.volume.manager [None req-62b67f5a-9c57-461a-b8d5-c42ee58fb969 None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 15 20:04:10 devstack cinder-volume[82209]: DEBUG cinder.volume.drivers.remotefs [None req-62b67f5a-9c57-461a-b8d5-c42ee58fb969 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82209) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] storage_protocol               = iSCSI {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] syslog_log_facility            = LOG_USER {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] target_helper                  = lioadm {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] target_ip_address              = 192.168.122.16 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] target_port                    = 3260 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] target_protocol                = iscsi {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] target_secondary_ip_addresses  = [] {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] trace_flags                    = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] transport_url                  = **** {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] until_refresh                  = 0 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] use_chap_auth                  = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] use_default_quota_class        = True {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] use_journal                    = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] use_json                       = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] use_multipath_for_image_xfer   = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] use_stderr                     = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] use_syslog                     = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] verify_glance_signatures       = enabled {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] volume_api_class               = cinder.volume.api.API {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] volume_backend_name            = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] volume_clear                   = zero {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] volume_clear_ionice            = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] volume_clear_size              = 0 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] volume_copy_bps_limit          = 0 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] volume_dd_blocksize            = 1M {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] volume_name_template           = volume-%s {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] volume_service_inithost_offload = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] volume_usage_audit_period      = month {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] zoning_mode                    = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] oslo_concurrency.disable_process_locking = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] keystone_authtoken.admin_password = **** {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] keystone_authtoken.admin_token = **** {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] keystone_authtoken.admin_user  = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] keystone_authtoken.auth_port   = 35357 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] keystone_authtoken.auth_protocol = https {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] keystone_authtoken.auth_section = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] keystone_authtoken.auth_type   = password {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] keystone_authtoken.auth_uri    = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] keystone_authtoken.auth_version = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] keystone_authtoken.cache       = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] keystone_authtoken.certfile    = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] keystone_authtoken.identity_uri = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] keystone_authtoken.include_service_catalog = True {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] keystone_authtoken.insecure    = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] keystone_authtoken.interface   = public {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] keystone_authtoken.keyfile     = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] keystone_authtoken.memcache_password =  {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] keystone_authtoken.memcache_username =  {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] keystone_authtoken.region_name = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] keystone_authtoken.service_type = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.16/identity {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] cache.backend                  = dogpile.cache.null {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] cache.backend_argument         = **** {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] cache.backend_expiration_time  = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] cache.config_prefix            = cache.oslo {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] cache.debug_cache_backend      = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] cache.enable_retry_client      = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] cache.enable_socket_keepalive  = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] cache.enabled                  = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] cache.enforce_fips_mode        = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] cache.expiration_time          = 600 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] cache.hashclient_retry_attempts = 2 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] cache.memcache_dead_retry      = 300 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] cache.memcache_pool_maxsize    = 10 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] cache.memcache_sasl_enabled    = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] cache.password                 = **** {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] cache.proxies                  = [] {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] cache.redis_db                 = 0 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] cache.redis_server             = localhost:6379 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] cache.retry_attempts           = 2 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] cache.retry_delay              = 0.0 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] cache.socket_keepalive_count   = 1 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] cache.socket_keepalive_idle    = 1 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] cache.socket_keepalive_interval = 1 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] cache.socket_timeout           = 1.0 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] cache.tls_allowed_ciphers      = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] cache.tls_cafile               = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] cache.tls_certfile             = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] cache.tls_enabled              = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] cache.tls_keyfile              = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] cache.username                 = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] coordination.backend_url       = **** {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] database.asyncio_connection    = **** {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] database.asyncio_slave_connection = **** {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] database.backend               = sqlalchemy {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] database.connection            = **** {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] database.connection_debug      = 0 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] database.connection_parameters =  {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] database.connection_recycle_time = 3600 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] database.connection_trace      = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] database.db_inc_retry_interval = True {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] database.db_max_retries        = 20 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] database.db_max_retry_interval = 10 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] database.db_retry_interval     = 1 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] database.max_overflow          = 50 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] database.max_pool_size         = 5 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] database.max_retries           = 10 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] database.mysql_wsrep_sync_wait = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] database.pool_timeout          = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] database.retry_interval        = 10 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] database.slave_connection      = **** {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] database.sqlite_synchronous    = True {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] database.synchronous_reader    = True {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] database.use_db_reconnect      = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] profiler.connection_string     = messaging:// {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] profiler.enabled               = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] profiler.es_doc_type           = notification {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] profiler.es_scroll_size        = 10000 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] profiler.es_scroll_time        = 2m {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] profiler.filter_error_trace    = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] profiler.hmac_keys             = **** {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] profiler.sentinel_service_name = mymaster {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] profiler.socket_timeout        = 0.1 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] profiler.trace_requests        = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] profiler.trace_sqlalchemy      = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] profiler_jaeger.process_tags   = {} {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] profiler_jaeger.service_name_prefix = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] profiler_otlp.service_name_prefix = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] oslo_policy.enforce_new_defaults = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: WARNING oslo_config.cfg [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] oslo_policy.enforce_scope      = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] oslo_policy.policy_default_rule = default {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] oslo_policy.policy_file        = policy.yaml {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] privsep_osbrick.group          = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] privsep_osbrick.helper_command = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] privsep_osbrick.user           = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] cinder_sys_admin.group         = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] cinder_sys_admin.helper_command = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] cinder_sys_admin.user          = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] service_user.auth_section      = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] service_user.auth_type         = password {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] service_user.cafile            = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] service_user.certfile          = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] service_user.collect_timing    = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] service_user.insecure          = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] service_user.keyfile           = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] service_user.send_service_user_token = True {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] service_user.split_loggers     = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] service_user.timeout           = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] glance.auth_section            = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] glance.auth_type               = password {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] glance.certfile                = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] glance.collect_timing          = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] glance.insecure                = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] glance.keyfile                 = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] glance.region_name             = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] glance.split_loggers           = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] glance.timeout                 = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.backend_availability_zone = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.chap_password = **** {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.chap_username =  {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.disk_geometry = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.driver_client_cert = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.driver_client_cert_key = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.driver_data_namespace = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.driver_use_ssl = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.extra_capabilities = {} {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.filter_function = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.goodness_function = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.iscsi_target_flags =  {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.iscsi_write_cache = on {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.iser_helper   = tgtadm {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.iser_ip_address = 192.168.122.16 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.iser_port     = 3260 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.nas_host      =  {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.nas_login     = admin {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.nas_mount_options = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.nas_password  = **** {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.nas_private_key =  {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.nas_share_path =  {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.num_shell_tries = 3 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.quobyte_volume_url = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.replication_device = **** {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.report_discard_supported = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.reserved_percentage = 0 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.target_helper = tgtadm {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.target_ip_address = 192.168.122.16 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.target_port   = 3260 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.target_protocol = iscsi {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.trace_flags   = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.unique_fqdn_network = True {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.use_chap_auth = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.volume_backend_name = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.volume_clear  = zero {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.volume_clear_ionice = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.volume_clear_size = 0 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] oslo_reports.file_event_handler = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] oslo_reports.log_dir           = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.backend_availability_zone = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.backend_host         = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.chap_password        = **** {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.chap_username        = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.chiscsi_conf         = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.disk_geometry        = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.driver_client_cert   = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.driver_data_namespace = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.driver_use_ssl       = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.extra_capabilities   = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.filter_function      = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.goodness_function    = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.iser_helper          = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.iser_ip_address      = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.iser_port            = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.iser_target_prefix   = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.nas_host             = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.nas_login            = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.nas_mount_options    = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.nas_password         = **** {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.nas_private_key      = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.nas_share_path       = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.nas_ssh_port         = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.num_shell_tries      = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.nvmet_port_id        = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.replication_device   = **** {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.report_discard_supported = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.reserved_percentage  = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.scst_target_driver   = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.storage_protocol     = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.target_helper        = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.target_ip_address    = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.target_port          = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.target_prefix        = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.target_protocol      = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.trace_flags          = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.use_chap_auth        = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.volume_clear         = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.volume_clear_size    = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] QuobyteHD.volumes_dir          = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] oslo_messaging_rabbit.ssl      = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] oslo_messaging_notifications.driver = [] {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] oslo_messaging_notifications.retry = -1 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] key_manager.fixed_key          = **** {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] barbican.barbican_api_version  = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] barbican.barbican_endpoint     = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] barbican.barbican_endpoint_type = public {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] barbican.barbican_region_name  = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] barbican.cafile                = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] barbican.certfile              = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] barbican.collect_timing        = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] barbican.insecure              = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] barbican.keyfile               = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] barbican.number_of_retries     = 60 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] barbican.retry_delay           = 1 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] barbican.send_service_user_token = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] barbican.split_loggers         = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] barbican.timeout               = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] barbican.verify_ssl            = True {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] barbican.verify_ssl_path       = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] barbican_service_user.auth_section = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] barbican_service_user.auth_type = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] barbican_service_user.cafile   = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] barbican_service_user.certfile = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] barbican_service_user.collect_timing = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] barbican_service_user.insecure = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] barbican_service_user.keyfile  = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] barbican_service_user.split_loggers = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] barbican_service_user.timeout  = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] vault.approle_role_id          = **** {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] vault.approle_secret_id        = **** {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] vault.kv_mountpoint            = secret {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] vault.kv_path                  = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] vault.kv_version               = 2 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] vault.namespace                = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] vault.root_token_id            = **** {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] vault.ssl_ca_crt_file          = None {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] vault.timeout                  = 60.0 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] vault.use_ssl                  = False {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82209]: DEBUG cinder.volume.drivers.quobyte [None req-62b67f5a-9c57-461a-b8d5-c42ee58fb969 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82209) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:10 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] ******************************************************************************** {{(pid=82094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 15 20:04:10 devstack cinder-volume[82209]: WARNING cinder.volume.drivers.quobyte [None req-62b67f5a-9c57-461a-b8d5-c42ee58fb969 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 15 20:04:10 devstack cinder-volume[82209]: WARNING cinder.volume.drivers.quobyte [None req-62b67f5a-9c57-461a-b8d5-c42ee58fb969 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 15 20:04:10 devstack cinder-volume[82209]: DEBUG oslo_concurrency.processutils [None req-62b67f5a-9c57-461a-b8d5-c42ee58fb969 None None] Running cmd (subprocess): mount.quobyte {{(pid=82209) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:04:10 devstack quobyte-client[82213]: Reading configuration file: /etc/quobyte/client.cfg
Apr 15 20:04:10 devstack quobyte-client[82213]: Invalid parameters found, error: missing mount point.
Apr 15 20:04:10 devstack quobyte-client[82213]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Apr 15 20:04:10 devstack quobyte-client[82213]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Apr 15 20:04:10 devstack cinder-volume[82209]: DEBUG oslo_concurrency.processutils [None req-62b67f5a-9c57-461a-b8d5-c42ee58fb969 None None] CMD "mount.quobyte" returned: 1 in 0.062s {{(pid=82209) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:04:10 devstack cinder-volume[82209]: DEBUG oslo_concurrency.lockutils [None req-62b67f5a-9c57-461a-b8d5-c42ee58fb969 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82209) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:04:10 devstack cinder-volume[82209]: DEBUG oslo_concurrency.lockutils [None req-62b67f5a-9c57-461a-b8d5-c42ee58fb969 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82209) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:04:10 devstack cinder-volume[82209]: DEBUG cinder.volume.drivers.quobyte [None req-62b67f5a-9c57-461a-b8d5-c42ee58fb969 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:04:10 devstack cinder-volume[82209]: INFO cinder.volume.drivers.quobyte [None req-62b67f5a-9c57-461a-b8d5-c42ee58fb969 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 ...
Apr 15 20:04:10 devstack cinder-volume[82209]: DEBUG oslo_concurrency.processutils [None req-62b67f5a-9c57-461a-b8d5-c42ee58fb969 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb -c /etc/quobyte/client-cinder.cfg {{(pid=82209) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:04:10 devstack sudo[82214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb -c /etc/quobyte/client-cinder.cfg
Apr 15 20:04:10 devstack sudo[82214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:04:11 devstack sudo[82214]: pam_unix(sudo:session): session closed for user root
Apr 15 20:04:11 devstack cinder-volume[82209]: DEBUG oslo_concurrency.processutils [None req-62b67f5a-9c57-461a-b8d5-c42ee58fb969 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.530s {{(pid=82209) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:04:11 devstack cinder-volume[82209]: INFO cinder.volume.drivers.quobyte [None req-62b67f5a-9c57-461a-b8d5-c42ee58fb969 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 succeeded
Apr 15 20:04:11 devstack cinder-volume[82209]: DEBUG cinder.volume.drivers.quobyte [None req-62b67f5a-9c57-461a-b8d5-c42ee58fb969 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:04:11 devstack cinder-volume[82209]: DEBUG oslo_concurrency.lockutils [None req-62b67f5a-9c57-461a-b8d5-c42ee58fb969 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.538s {{(pid=82209) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:04:11 devstack cinder-volume[82209]: DEBUG oslo_concurrency.processutils [None req-62b67f5a-9c57-461a-b8d5-c42ee58fb969 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82209) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:04:11 devstack sudo[82285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:04:11 devstack sudo[82285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:04:11 devstack sudo[82285]: pam_unix(sudo:session): session closed for user root
Apr 15 20:04:11 devstack cinder-volume[82209]: DEBUG oslo_concurrency.processutils [None req-62b67f5a-9c57-461a-b8d5-c42ee58fb969 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.430s {{(pid=82209) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:04:11 devstack cinder-volume[82209]: INFO cinder.volume.driver [None req-62b67f5a-9c57-461a-b8d5-c42ee58fb969 None None] Driver hasn't implemented _init_vendor_properties()
Apr 15 20:04:11 devstack cinder-volume[82209]: DEBUG cinder.volume.driver [None req-62b67f5a-9c57-461a-b8d5-c42ee58fb969 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7328071594238, 'free_capacity_gb': 1775.7328071594238, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82209) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 15 20:04:11 devstack cinder-volume[82209]: DEBUG oslo_db.sqlalchemy.engines [None req-62b67f5a-9c57-461a-b8d5-c42ee58fb969 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82209) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 15 20:04:11 devstack cinder-volume[82209]: DEBUG dbcounter [-] [82209] Writer thread running {{(pid=82209) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 15 20:04:11 devstack cinder-volume[82209]: DEBUG cinder.db.sqlalchemy.api [None req-62b67f5a-9c57-461a-b8d5-c42ee58fb969 None None] Building query based on filter {{(pid=82209) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 15 20:04:11 devstack cinder-volume[82209]: DEBUG cinder.image.image_utils [None req-62b67f5a-9c57-461a-b8d5-c42ee58fb969 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82209) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 15 20:04:11 devstack cinder-volume[82209]: INFO cinder.keymgr.migration [None req-ac83806b-e28e-4e21-b82d-a948df7fa2a3 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 15 20:04:11 devstack cinder-volume[82209]: DEBUG oslo_concurrency.lockutils [None req-62b67f5a-9c57-461a-b8d5-c42ee58fb969 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82209) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:04:11 devstack cinder-volume[82209]: DEBUG oslo_concurrency.lockutils [None req-62b67f5a-9c57-461a-b8d5-c42ee58fb969 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82209) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:04:11 devstack cinder-volume[82209]: DEBUG cinder.volume.drivers.quobyte [None req-62b67f5a-9c57-461a-b8d5-c42ee58fb969 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:04:11 devstack cinder-volume[82209]: DEBUG cinder.volume.drivers.quobyte [None req-62b67f5a-9c57-461a-b8d5-c42ee58fb969 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:04:11 devstack cinder-volume[82209]: DEBUG oslo_concurrency.lockutils [None req-62b67f5a-9c57-461a-b8d5-c42ee58fb969 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82209) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:04:11 devstack cinder-volume[82209]: DEBUG oslo_concurrency.processutils [None req-62b67f5a-9c57-461a-b8d5-c42ee58fb969 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82209) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:04:11 devstack sudo[82304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:04:11 devstack sudo[82304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:04:12 devstack sudo[82304]: pam_unix(sudo:session): session closed for user root
Apr 15 20:04:12 devstack cinder-volume[82209]: DEBUG oslo_concurrency.processutils [None req-62b67f5a-9c57-461a-b8d5-c42ee58fb969 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.525s {{(pid=82209) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:04:12 devstack cinder-volume[82209]: DEBUG cinder.manager [None req-62b67f5a-9c57-461a-b8d5-c42ee58fb969 None None] Notifying Schedulers of capabilities ... {{(pid=82209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:04:12 devstack cinder-volume[82209]: INFO cinder.volume.manager [None req-62b67f5a-9c57-461a-b8d5-c42ee58fb969 None None] Driver initialization completed successfully.
Apr 15 20:04:12 devstack cinder-volume[82209]: INFO cinder.manager [None req-62b67f5a-9c57-461a-b8d5-c42ee58fb969 None None] Initiating service 3 cleanup
Apr 15 20:04:12 devstack cinder-volume[82209]: INFO cinder.manager [None req-62b67f5a-9c57-461a-b8d5-c42ee58fb969 None None] Service 3 cleanup completed.
Apr 15 20:04:12 devstack cinder-volume[82209]: DEBUG cinder.service [None req-62b67f5a-9c57-461a-b8d5-c42ee58fb969 None None] Creating RPC server for service cinder-volume {{(pid=82209) start /opt/stack/cinder/cinder/service.py:231}}
Apr 15 20:04:12 devstack cinder-volume[82209]: DEBUG cinder.service [None req-62b67f5a-9c57-461a-b8d5-c42ee58fb969 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82209) start /opt/stack/cinder/cinder/service.py:237}}
Apr 15 20:04:12 devstack cinder-volume[82209]: INFO cinder.volume.manager [None req-62b67f5a-9c57-461a-b8d5-c42ee58fb969 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 15 20:04:12 devstack cinder-volume[82209]: DEBUG oslo_concurrency.lockutils [None req-62b67f5a-9c57-461a-b8d5-c42ee58fb969 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82209) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:04:12 devstack cinder-volume[82209]: DEBUG oslo_concurrency.lockutils [None req-62b67f5a-9c57-461a-b8d5-c42ee58fb969 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82209) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:04:12 devstack cinder-volume[82209]: DEBUG cinder.volume.drivers.quobyte [None req-62b67f5a-9c57-461a-b8d5-c42ee58fb969 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:04:12 devstack cinder-volume[82209]: DEBUG cinder.volume.drivers.quobyte [None req-62b67f5a-9c57-461a-b8d5-c42ee58fb969 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:04:12 devstack cinder-volume[82209]: DEBUG oslo_concurrency.lockutils [None req-62b67f5a-9c57-461a-b8d5-c42ee58fb969 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=82209) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:04:12 devstack cinder-volume[82209]: DEBUG oslo_concurrency.processutils [None req-62b67f5a-9c57-461a-b8d5-c42ee58fb969 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82209) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:04:12 devstack sudo[82348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:04:12 devstack sudo[82348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:04:13 devstack sudo[82348]: pam_unix(sudo:session): session closed for user root
Apr 15 20:04:13 devstack cinder-volume[82209]: DEBUG oslo_concurrency.processutils [None req-62b67f5a-9c57-461a-b8d5-c42ee58fb969 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.535s {{(pid=82209) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:04:13 devstack cinder-volume[82209]: INFO cinder.volume.manager [None req-62b67f5a-9c57-461a-b8d5-c42ee58fb969 None None] Driver post RPC initialization completed successfully.
Apr 15 20:04:14 devstack cinder-volume[82209]: DEBUG oslo_concurrency.lockutils [None req-36ffdfc2-2d2e-4854-8980-82ef9887b347 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82209) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:04:14 devstack cinder-volume[82209]: DEBUG oslo_concurrency.lockutils [None req-36ffdfc2-2d2e-4854-8980-82ef9887b347 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82209) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:04:14 devstack cinder-volume[82209]: DEBUG cinder.volume.drivers.quobyte [None req-36ffdfc2-2d2e-4854-8980-82ef9887b347 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:04:14 devstack cinder-volume[82209]: DEBUG cinder.volume.drivers.quobyte [None req-36ffdfc2-2d2e-4854-8980-82ef9887b347 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:04:14 devstack cinder-volume[82209]: DEBUG oslo_concurrency.lockutils [None req-36ffdfc2-2d2e-4854-8980-82ef9887b347 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82209) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:04:14 devstack cinder-volume[82209]: DEBUG oslo_concurrency.processutils [None req-36ffdfc2-2d2e-4854-8980-82ef9887b347 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82209) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:04:14 devstack sudo[82359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:04:14 devstack sudo[82359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:04:15 devstack sudo[82359]: pam_unix(sudo:session): session closed for user root
Apr 15 20:04:15 devstack cinder-volume[82209]: DEBUG oslo_concurrency.processutils [None req-36ffdfc2-2d2e-4854-8980-82ef9887b347 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.375s {{(pid=82209) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:04:15 devstack cinder-volume[82209]: DEBUG cinder.manager [None req-36ffdfc2-2d2e-4854-8980-82ef9887b347 None None] Notifying Schedulers of capabilities ... {{(pid=82209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:04:18 devstack cinder-volume[82094]: INFO oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] Caught SIGTERM, stopping children
Apr 15 20:04:18 devstack cinder-volume[82094]: DEBUG oslo_concurrency.lockutils [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] Acquiring lock "singleton_lock" {{(pid=82094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 15 20:04:18 devstack cinder-volume[82094]: DEBUG oslo_concurrency.lockutils [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] Acquired lock "singleton_lock" {{(pid=82094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 15 20:04:18 devstack cinder-volume[82094]: DEBUG oslo_concurrency.lockutils [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] Releasing lock "singleton_lock" {{(pid=82094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 15 20:04:18 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] Stop services. {{(pid=82094) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 15 20:04:18 devstack cinder-volume[82094]: DEBUG oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] Killing children. {{(pid=82094) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 15 20:04:18 devstack cinder-volume[82094]: INFO oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] Waiting on 1 children to exit
Apr 15 20:04:20 devstack cinder-volume[82209]: DEBUG oslo_concurrency.lockutils [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] Acquiring lock "singleton_lock" {{(pid=82209) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 15 20:04:20 devstack cinder-volume[82209]: DEBUG oslo_concurrency.lockutils [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] Acquired lock "singleton_lock" {{(pid=82209) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 15 20:04:20 devstack cinder-volume[82209]: DEBUG oslo_concurrency.lockutils [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] Releasing lock "singleton_lock" {{(pid=82209) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 15 20:04:20 devstack cinder-volume[82209]: WARNING amqp [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 15 20:04:20 devstack cinder-volume[82209]: WARNING amqp [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 15 20:04:20 devstack cinder-volume[82094]: INFO oslo_service.backend._eventlet.service [None req-5c4414e5-5ae6-4061-8bc1-412f578f07a6 None None] Child 82209 exited with status 0
Apr 15 20:04:21 devstack cinder-volume[82436]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 15 20:04:21 devstack cinder-volume[82436]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 15 20:04:21 devstack cinder-volume[82436]: we strongly recommend against using it for new projects.
Apr 15 20:04:21 devstack cinder-volume[82436]: If you are already using Eventlet, we recommend migrating to a different
Apr 15 20:04:21 devstack cinder-volume[82436]: framework.  For more detail see
Apr 15 20:04:21 devstack cinder-volume[82436]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 15 20:04:21 devstack cinder-volume[82436]:   import eventlet  # noqa
Apr 15 20:04:23 devstack cinder-volume[82436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 15 20:04:23 devstack cinder-volume[82436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 15 20:04:23 devstack cinder-volume[82436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 15 20:04:24 devstack cinder-volume[82436]: INFO dbcounter [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] Registered counter for database cinder
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_db.sqlalchemy.engines [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82436) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG dbcounter [-] [82436] Writer thread running {{(pid=82436) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 15 20:04:24 devstack cinder-volume[82436]: INFO cinder.rpc [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 15 20:04:24 devstack cinder-volume[82436]: INFO cinder.rpc [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_db.sqlalchemy.engines [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82436) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 15 20:04:24 devstack cinder-volume[82436]: INFO cinder.volume.manager [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] Determined volume DB was empty at startup.
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG cinder.volume.manager [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82436) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 15 20:04:24 devstack cinder-volume[82436]: WARNING stevedore.named [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 15 20:04:24 devstack cinder-volume[82436]: WARNING castellan.key_manager [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 15 20:04:24 devstack cinder-volume[82436]: WARNING cinder.keymgr.conf_key_mgr [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 15 20:04:24 devstack cinder-volume[82436]: INFO cinder.volume.manager [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_db.sqlalchemy.engines [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82436) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 15 20:04:24 devstack cinder-volume[82436]: INFO oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] Starting 1 workers
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] Started child 82646 {{(pid=82436) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] Full set of CONF: {{(pid=82436) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] ******************************************************************************** {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] Configuration options gathered from: {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] ================================================================================ {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 15 20:04:24 devstack cinder-volume[82646]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] allow_availability_zone_fallback = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] allow_compression_on_image_upload = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] allowed_direct_url_schemes     = [] {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] api_rate_limit                 = True {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] auth_strategy                  = keystone {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_availability_zone      = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_host                   = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_name                   = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_stats_polling_interval = 60 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backup_api_class               = cinder.backup.api.API {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backup_name_template           = backup-%s {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backup_use_same_host           = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backup_use_temp_snapshot       = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] chap_password                  = **** {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] chap_username                  =  {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] cinder_internal_tenant_project_id = 4398ad5a4f194f7ca3cb5f269557f26b {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] cinder_internal_tenant_user_id = 1bd0a0f1d9ec4dadb0a33782e91970d4 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] cluster                        = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] compression_format             = gzip {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] compute_api_class              = cinder.compute.nova.API {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] config_dir                     = [] {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] config_source                  = [] {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] control_exchange               = openstack {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] debug                          = True {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] default_availability_zone      = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] default_group_type             = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] default_volume_type            = QuobyteHD {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] disk_geometry                  = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] driver_client_cert             = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] driver_client_cert_key         = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] driver_data_namespace          = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] driver_ssl_cert_path           = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] driver_ssl_cert_verify         = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] driver_use_ssl                 = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] enable_new_services            = True {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] enable_unsupported_driver      = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] enabled_backends               = ['QuobyteHD'] {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] enforce_multipath_for_image_xfer = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] filter_function                = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] glance_api_insecure            = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] glance_api_servers             = ['http://192.168.122.16/image'] {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] glance_api_ssl_compression     = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] glance_ca_certificates_file    = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] glance_catalog_info            = image:glance:publicURL {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] glance_certfile                = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] glance_keyfile                 = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] glance_num_retries             = 3 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] glance_request_timeout         = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] goodness_function              = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] graceful_shutdown_timeout      = 5 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] group_api_class                = cinder.group.api.API {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] host                           = devstack {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] image_compress_on_upload       = True {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] image_conversion_address_space_limit = 1 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] image_conversion_cpu_limit     = 60 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] image_conversion_disable       = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] image_upload_use_cinder_backend = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] image_upload_use_internal_tenant = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] image_volume_cache_enabled     = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] image_volume_cache_max_count   = 0 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] image_volume_cache_max_size_gb = 0 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] init_host_max_objects_retrieval = 0 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] instance_format                = [instance: %(uuid)s]  {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] iscsi_target_flags             =  {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] iscsi_write_cache              = on {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] iser_helper                    = tgtadm {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-1fb0b8fa-8d69-4213-985b-0daa69f6b309 None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] iser_ip_address                = 192.168.122.16 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] iser_port                      = 3260 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] log_color                      = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-1fb0b8fa-8d69-4213-985b-0daa69f6b309 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82646) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] log_config_append              = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] log_dir                        = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] log_file                       = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] log_options                    = True {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] log_rotate_interval            = 1 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] log_rotate_interval_type       = days {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] log_rotation_type              = none {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] max_age                        = 0 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] max_logfile_count              = 30 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] max_logfile_size_mb            = 200 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] max_over_subscription_ratio    = 20.0 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] message_reap_interval          = 86400 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] message_ttl                    = 2592000 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] migration_create_volume_timeout_secs = 300 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] monkey_patch                   = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] monkey_patch_modules           = [] {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] my_ip                          = 192.168.122.16 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] no_snapshot_gb_quota           = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] num_iser_scan_tries            = 3 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] num_shell_tries                = 3 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] num_volume_device_scan_tries   = 3 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] nvmeof_conn_info_version       = 1 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] nvmet_ns_id                    = 10 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] nvmet_port_id                  = 1 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] osapi_max_limit                = 1000 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] osapi_volume_ext_list          = [] {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] osapi_volume_listen_port       = 8776 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] osapi_volume_use_ssl           = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] osapi_volume_workers           = 2 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] per_volume_size_limit          = -1 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] periodic_fuzzy_delay           = 60 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] periodic_interval              = 60 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] public_endpoint                = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] publish_errors                 = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] quota_backup_gigabytes         = 1000 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] quota_backups                  = 10 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] quota_gigabytes                = 1000 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] quota_groups                   = 10 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] quota_snapshots                = 10 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] quota_volumes                  = 10 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] rate_limit_burst               = 0 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] rate_limit_except_level        = CRITICAL {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] rate_limit_interval            = 0 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] reinit_driver_count            = 3 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] replication_device             = **** {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] report_discard_supported       = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] report_interval                = 120 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] reservation_clean_interval     = 86400 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] reservation_expire             = 86400 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] reserved_image_namespaces      = [] {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] reserved_percentage            = 0 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] rpc_response_timeout           = 120 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] run_external_periodic_tasks    = True {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] scst_target_driver             = iscsi {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] scst_target_iqn_name           = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] service_down_time              = 720 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] shell_completion               = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] snapshot_name_template         = snapshot-%s {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] split_loggers                  = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] state_path                     = /opt/stack/data/cinder {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] storage_availability_zone      = nova {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] storage_protocol               = iSCSI {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] syslog_log_facility            = LOG_USER {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] target_helper                  = lioadm {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] target_ip_address              = 192.168.122.16 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] target_port                    = 3260 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] target_protocol                = iscsi {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] target_secondary_ip_addresses  = [] {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] trace_flags                    = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] transport_url                  = **** {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] until_refresh                  = 0 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] use_chap_auth                  = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] use_default_quota_class        = True {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] use_journal                    = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] use_json                       = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] use_multipath_for_image_xfer   = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] use_stderr                     = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] use_syslog                     = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] verify_glance_signatures       = enabled {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] volume_api_class               = cinder.volume.api.API {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] volume_backend_name            = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] volume_clear                   = zero {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] volume_clear_ionice            = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] volume_clear_size              = 0 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] volume_copy_bps_limit          = 0 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] volume_dd_blocksize            = 1M {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] volume_name_template           = volume-%s {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] volume_service_inithost_offload = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] volume_usage_audit_period      = month {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] zoning_mode                    = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] oslo_concurrency.disable_process_locking = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] keystone_authtoken.admin_password = **** {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] keystone_authtoken.admin_token = **** {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] keystone_authtoken.admin_user  = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] keystone_authtoken.auth_port   = 35357 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] keystone_authtoken.auth_protocol = https {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] keystone_authtoken.auth_section = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] keystone_authtoken.auth_type   = password {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] keystone_authtoken.auth_uri    = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] keystone_authtoken.auth_version = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] keystone_authtoken.cache       = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] keystone_authtoken.certfile    = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] keystone_authtoken.identity_uri = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] keystone_authtoken.include_service_catalog = True {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] keystone_authtoken.insecure    = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] keystone_authtoken.interface   = public {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] keystone_authtoken.keyfile     = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] keystone_authtoken.memcache_password =  {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-1fb0b8fa-8d69-4213-985b-0daa69f6b309 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82646) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.quobyte [None req-1fb0b8fa-8d69-4213-985b-0daa69f6b309 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.quobyte [None req-1fb0b8fa-8d69-4213-985b-0daa69f6b309 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-1fb0b8fa-8d69-4213-985b-0daa69f6b309 None None] Running cmd (subprocess): mount.quobyte {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] keystone_authtoken.memcache_username =  {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] keystone_authtoken.region_name = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] keystone_authtoken.service_type = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.16/identity {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] cache.backend                  = dogpile.cache.null {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] cache.backend_argument         = **** {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] cache.backend_expiration_time  = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] cache.config_prefix            = cache.oslo {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] cache.debug_cache_backend      = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] cache.enable_retry_client      = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] cache.enable_socket_keepalive  = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] cache.enabled                  = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] cache.enforce_fips_mode        = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] cache.expiration_time          = 600 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] cache.hashclient_retry_attempts = 2 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] cache.memcache_dead_retry      = 300 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] cache.memcache_pool_maxsize    = 10 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] cache.memcache_sasl_enabled    = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] cache.password                 = **** {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] cache.proxies                  = [] {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] cache.redis_db                 = 0 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] cache.redis_server             = localhost:6379 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] cache.retry_attempts           = 2 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] cache.retry_delay              = 0.0 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] cache.socket_keepalive_count   = 1 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] cache.socket_keepalive_idle    = 1 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] cache.socket_keepalive_interval = 1 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] cache.socket_timeout           = 1.0 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] cache.tls_allowed_ciphers      = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] cache.tls_cafile               = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] cache.tls_certfile             = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] cache.tls_enabled              = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] cache.tls_keyfile              = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] cache.username                 = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] coordination.backend_url       = **** {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] database.asyncio_connection    = **** {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] database.asyncio_slave_connection = **** {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] database.backend               = sqlalchemy {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] database.connection            = **** {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] database.connection_debug      = 0 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] database.connection_parameters =  {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] database.connection_recycle_time = 3600 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] database.connection_trace      = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] database.db_inc_retry_interval = True {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] database.db_max_retries        = 20 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] database.db_max_retry_interval = 10 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] database.db_retry_interval     = 1 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] database.max_overflow          = 50 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] database.max_pool_size         = 5 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] database.max_retries           = 10 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] database.mysql_wsrep_sync_wait = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] database.pool_timeout          = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] database.retry_interval        = 10 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] database.slave_connection      = **** {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] database.sqlite_synchronous    = True {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] database.synchronous_reader    = True {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] database.use_db_reconnect      = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] profiler.connection_string     = messaging:// {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] profiler.enabled               = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] profiler.es_doc_type           = notification {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] profiler.es_scroll_size        = 10000 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] profiler.es_scroll_time        = 2m {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] profiler.filter_error_trace    = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] profiler.hmac_keys             = **** {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] profiler.sentinel_service_name = mymaster {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] profiler.socket_timeout        = 0.1 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] profiler.trace_requests        = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] profiler.trace_sqlalchemy      = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] profiler_jaeger.process_tags   = {} {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] profiler_jaeger.service_name_prefix = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] profiler_otlp.service_name_prefix = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] oslo_policy.enforce_new_defaults = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: WARNING oslo_config.cfg [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] oslo_policy.enforce_scope      = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] oslo_policy.policy_default_rule = default {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] oslo_policy.policy_file        = policy.yaml {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] privsep_osbrick.group          = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] privsep_osbrick.helper_command = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] privsep_osbrick.user           = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] cinder_sys_admin.group         = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] cinder_sys_admin.helper_command = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] cinder_sys_admin.user          = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] service_user.auth_section      = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] service_user.auth_type         = password {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] service_user.cafile            = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] service_user.certfile          = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] service_user.collect_timing    = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] service_user.insecure          = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] service_user.keyfile           = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] service_user.send_service_user_token = True {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] service_user.split_loggers     = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] service_user.timeout           = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] glance.auth_section            = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] glance.auth_type               = password {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] glance.certfile                = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] glance.collect_timing          = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] glance.insecure                = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] glance.keyfile                 = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] glance.region_name             = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] glance.split_loggers           = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] glance.timeout                 = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.backend_availability_zone = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.chap_password = **** {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.chap_username =  {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.disk_geometry = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.driver_client_cert = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.driver_client_cert_key = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.driver_data_namespace = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.driver_use_ssl = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.extra_capabilities = {} {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.filter_function = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.goodness_function = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.iscsi_target_flags =  {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.iscsi_write_cache = on {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.iser_helper   = tgtadm {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.iser_ip_address = 192.168.122.16 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack quobyte-client[82650]: Reading configuration file: /etc/quobyte/client.cfg
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.iser_port     = 3260 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack quobyte-client[82650]: Invalid parameters found, error: missing mount point.
Apr 15 20:04:24 devstack quobyte-client[82650]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Apr 15 20:04:24 devstack quobyte-client[82650]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.nas_host      =  {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.nas_login     = admin {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.nas_mount_options = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.nas_password  = **** {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.nas_private_key =  {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.nas_share_path =  {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.num_shell_tries = 3 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-1fb0b8fa-8d69-4213-985b-0daa69f6b309 None None] CMD "mount.quobyte" returned: 1 in 0.059s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-1fb0b8fa-8d69-4213-985b-0daa69f6b309 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.quobyte_volume_url = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.replication_device = **** {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-1fb0b8fa-8d69-4213-985b-0daa69f6b309 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.report_discard_supported = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.reserved_percentage = 0 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-1fb0b8fa-8d69-4213-985b-0daa69f6b309 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.target_helper = tgtadm {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.target_ip_address = 192.168.122.16 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.target_port   = 3260 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.target_protocol = iscsi {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.trace_flags   = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.unique_fqdn_network = True {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.use_chap_auth = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.volume_backend_name = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-1fb0b8fa-8d69-4213-985b-0daa69f6b309 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.volume_clear  = zero {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-1fb0b8fa-8d69-4213-985b-0daa69f6b309 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.volume_clear_ionice = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.volume_clear_size = 0 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-1fb0b8fa-8d69-4213-985b-0daa69f6b309 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] oslo_reports.file_event_handler = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] oslo_reports.log_dir           = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.backend_availability_zone = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.backend_host         = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.chap_password        = **** {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.chap_username        = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.chiscsi_conf         = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.disk_geometry        = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.driver_client_cert   = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.driver_data_namespace = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.driver_use_ssl       = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.extra_capabilities   = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.filter_function      = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.goodness_function    = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.iser_helper          = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.iser_ip_address      = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.iser_port            = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.iser_target_prefix   = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.nas_host             = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.nas_login            = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.nas_mount_options    = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.nas_password         = **** {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.nas_private_key      = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.nas_share_path       = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.nas_ssh_port         = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.num_shell_tries      = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack sudo[82662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack sudo[82662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.nvmet_port_id        = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.replication_device   = **** {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.report_discard_supported = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.reserved_percentage  = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.scst_target_driver   = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.storage_protocol     = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.target_helper        = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.target_ip_address    = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.target_port          = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.target_prefix        = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.target_protocol      = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.trace_flags          = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.use_chap_auth        = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.volume_clear         = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.volume_clear_size    = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] QuobyteHD.volumes_dir          = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] oslo_messaging_rabbit.ssl      = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] oslo_messaging_notifications.driver = [] {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] oslo_messaging_notifications.retry = -1 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] key_manager.fixed_key          = **** {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] barbican.barbican_api_version  = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] barbican.barbican_endpoint     = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] barbican.barbican_endpoint_type = public {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] barbican.barbican_region_name  = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] barbican.cafile                = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] barbican.certfile              = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] barbican.collect_timing        = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] barbican.insecure              = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] barbican.keyfile               = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] barbican.number_of_retries     = 60 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] barbican.retry_delay           = 1 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] barbican.send_service_user_token = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] barbican.split_loggers         = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] barbican.timeout               = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] barbican.verify_ssl            = True {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] barbican.verify_ssl_path       = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] barbican_service_user.auth_section = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] barbican_service_user.auth_type = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] barbican_service_user.cafile   = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] barbican_service_user.certfile = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] barbican_service_user.collect_timing = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] barbican_service_user.insecure = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] barbican_service_user.keyfile  = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] barbican_service_user.split_loggers = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] barbican_service_user.timeout  = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] vault.approle_role_id          = **** {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] vault.approle_secret_id        = **** {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] vault.kv_mountpoint            = secret {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] vault.kv_path                  = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] vault.kv_version               = 2 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] vault.namespace                = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] vault.root_token_id            = **** {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] vault.ssl_ca_crt_file          = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] vault.timeout                  = 60.0 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] vault.use_ssl                  = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 20:04:24 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-7dd0d92a-2404-4e2e-b28a-2cd6ee5be119 None None] ******************************************************************************** {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 15 20:04:24 devstack sudo[82662]: pam_unix(sudo:session): session closed for user root
Apr 15 20:04:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-1fb0b8fa-8d69-4213-985b-0daa69f6b309 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.422s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:04:24 devstack cinder-volume[82646]: INFO cinder.volume.driver [None req-1fb0b8fa-8d69-4213-985b-0daa69f6b309 None None] Driver hasn't implemented _init_vendor_properties()
Apr 15 20:04:24 devstack cinder-volume[82646]: DEBUG cinder.volume.driver [None req-1fb0b8fa-8d69-4213-985b-0daa69f6b309 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7328071594238, 'free_capacity_gb': 1775.7328071594238, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82646) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 15 20:04:24 devstack cinder-volume[82646]: DEBUG oslo_db.sqlalchemy.engines [None req-1fb0b8fa-8d69-4213-985b-0daa69f6b309 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82646) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 15 20:04:24 devstack cinder-volume[82646]: DEBUG dbcounter [-] [82646] Writer thread running {{(pid=82646) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 15 20:04:24 devstack cinder-volume[82646]: DEBUG cinder.db.sqlalchemy.api [None req-1fb0b8fa-8d69-4213-985b-0daa69f6b309 None None] Building query based on filter {{(pid=82646) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 15 20:04:24 devstack cinder-volume[82646]: DEBUG cinder.image.image_utils [None req-1fb0b8fa-8d69-4213-985b-0daa69f6b309 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82646) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 15 20:04:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-1fb0b8fa-8d69-4213-985b-0daa69f6b309 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:04:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-1fb0b8fa-8d69-4213-985b-0daa69f6b309 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:04:24 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-1fb0b8fa-8d69-4213-985b-0daa69f6b309 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:04:24 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-1fb0b8fa-8d69-4213-985b-0daa69f6b309 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:04:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-1fb0b8fa-8d69-4213-985b-0daa69f6b309 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:04:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-1fb0b8fa-8d69-4213-985b-0daa69f6b309 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:04:25 devstack cinder-volume[82646]: INFO cinder.keymgr.migration [None req-35ca545c-29d3-436b-bfb0-e2e7d4aa5cd3 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 15 20:04:25 devstack sudo[82678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:04:25 devstack sudo[82678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:04:25 devstack sudo[82678]: pam_unix(sudo:session): session closed for user root
Apr 15 20:04:25 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-1fb0b8fa-8d69-4213-985b-0daa69f6b309 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.408s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:04:25 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-1fb0b8fa-8d69-4213-985b-0daa69f6b309 None None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:04:25 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-1fb0b8fa-8d69-4213-985b-0daa69f6b309 None None] Driver initialization completed successfully.
Apr 15 20:04:25 devstack cinder-volume[82646]: INFO cinder.manager [None req-1fb0b8fa-8d69-4213-985b-0daa69f6b309 None None] Initiating service 3 cleanup
Apr 15 20:04:25 devstack cinder-volume[82646]: INFO cinder.manager [None req-1fb0b8fa-8d69-4213-985b-0daa69f6b309 None None] Service 3 cleanup completed.
Apr 15 20:04:25 devstack cinder-volume[82646]: DEBUG cinder.service [None req-1fb0b8fa-8d69-4213-985b-0daa69f6b309 None None] Creating RPC server for service cinder-volume {{(pid=82646) start /opt/stack/cinder/cinder/service.py:231}}
Apr 15 20:04:25 devstack cinder-volume[82646]: DEBUG cinder.service [None req-1fb0b8fa-8d69-4213-985b-0daa69f6b309 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82646) start /opt/stack/cinder/cinder/service.py:237}}
Apr 15 20:04:25 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-1fb0b8fa-8d69-4213-985b-0daa69f6b309 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 15 20:04:25 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-1fb0b8fa-8d69-4213-985b-0daa69f6b309 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:04:25 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-1fb0b8fa-8d69-4213-985b-0daa69f6b309 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:04:25 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-1fb0b8fa-8d69-4213-985b-0daa69f6b309 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:04:25 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-1fb0b8fa-8d69-4213-985b-0daa69f6b309 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:04:25 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-1fb0b8fa-8d69-4213-985b-0daa69f6b309 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:04:25 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-1fb0b8fa-8d69-4213-985b-0daa69f6b309 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:04:25 devstack sudo[82681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:04:25 devstack sudo[82681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:04:25 devstack sudo[82681]: pam_unix(sudo:session): session closed for user root
Apr 15 20:04:25 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-1fb0b8fa-8d69-4213-985b-0daa69f6b309 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.395s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:04:25 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-1fb0b8fa-8d69-4213-985b-0daa69f6b309 None None] Driver post RPC initialization completed successfully.
Apr 15 20:04:34 devstack cinder-volume[82436]: DEBUG dbcounter [-] [82436] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82436) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 20:04:34 devstack cinder-volume[82646]: DEBUG dbcounter [-] [82646] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=82646) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 20:04:35 devstack cinder-volume[82646]: DEBUG dbcounter [-] [82646] Writing DB stats cinder:SELECT=4 {{(pid=82646) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 20:05:28 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-eebcfb51-1c29-4590-b84b-c257759f6c6b tempest-VolumesAdminNegativeTest-1388377401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:05:29 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-eebcfb51-1c29-4590-b84b-c257759f6c6b tempest-VolumesAdminNegativeTest-1388377401 None] Flow 'volume_create_manager' (f3683dd2-847f-4055-bc85-28eaa69df432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:05:29 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-eebcfb51-1c29-4590-b84b-c257759f6c6b tempest-VolumesAdminNegativeTest-1388377401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2f71400-9f03-4483-806f-a9da74eb16f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:05:29 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-eebcfb51-1c29-4590-b84b-c257759f6c6b tempest-VolumesAdminNegativeTest-1388377401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2f71400-9f03-4483-806f-a9da74eb16f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:05:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-791906941',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d6b6280-6465-4a9c-8b91-8ad782ad8d94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1334fd2cbe543668ef363ba0f8cfe06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:05:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:05:29Z,use_quota=True,user_id='d85e823038f54fd6891e765a74bbd0b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:05:29 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-eebcfb51-1c29-4590-b84b-c257759f6c6b tempest-VolumesAdminNegativeTest-1388377401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7320d849-eeba-4a37-a743-e1f0bfe86814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:05:29 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-eebcfb51-1c29-4590-b84b-c257759f6c6b tempest-VolumesAdminNegativeTest-1388377401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7320d849-eeba-4a37-a743-e1f0bfe86814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:05:29 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-eebcfb51-1c29-4590-b84b-c257759f6c6b tempest-VolumesAdminNegativeTest-1388377401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d83cd1b4-541e-4a76-8e06-87d60e488f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:05:29 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-eebcfb51-1c29-4590-b84b-c257759f6c6b tempest-VolumesAdminNegativeTest-1388377401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d83cd1b4-541e-4a76-8e06-87d60e488f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d6b6280-6465-4a9c-8b91-8ad782ad8d94', 'volume_name': 'volume-7d6b6280-6465-4a9c-8b91-8ad782ad8d94', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:05:29 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-eebcfb51-1c29-4590-b84b-c257759f6c6b tempest-VolumesAdminNegativeTest-1388377401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ae76278-8ece-4773-a29c-62a31b8a0814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:05:29 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-eebcfb51-1c29-4590-b84b-c257759f6c6b tempest-VolumesAdminNegativeTest-1388377401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ae76278-8ece-4773-a29c-62a31b8a0814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:05:29 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-eebcfb51-1c29-4590-b84b-c257759f6c6b tempest-VolumesAdminNegativeTest-1388377401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0195b25-1689-4538-a21e-7aced7a1d219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:05:29 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-eebcfb51-1c29-4590-b84b-c257759f6c6b tempest-VolumesAdminNegativeTest-1388377401 None] Volume 7d6b6280-6465-4a9c-8b91-8ad782ad8d94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d6b6280-6465-4a9c-8b91-8ad782ad8d94', 'volume_size': 1}
Apr 15 20:05:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-eebcfb51-1c29-4590-b84b-c257759f6c6b tempest-VolumesAdminNegativeTest-1388377401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:05:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-eebcfb51-1c29-4590-b84b-c257759f6c6b tempest-VolumesAdminNegativeTest-1388377401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:05:29 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-eebcfb51-1c29-4590-b84b-c257759f6c6b tempest-VolumesAdminNegativeTest-1388377401 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:05:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-791906941',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d6b6280-6465-4a9c-8b91-8ad782ad8d94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1334fd2cbe543668ef363ba0f8cfe06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:05:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:05:29Z,use_quota=True,user_id='d85e823038f54fd6891e765a74bbd0b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:05:29 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-eebcfb51-1c29-4590-b84b-c257759f6c6b tempest-VolumesAdminNegativeTest-1388377401 None] Creating volume 7d6b6280-6465-4a9c-8b91-8ad782ad8d94 {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:05:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-eebcfb51-1c29-4590-b84b-c257759f6c6b tempest-VolumesAdminNegativeTest-1388377401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:05:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-eebcfb51-1c29-4590-b84b-c257759f6c6b tempest-VolumesAdminNegativeTest-1388377401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:05:29 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-eebcfb51-1c29-4590-b84b-c257759f6c6b tempest-VolumesAdminNegativeTest-1388377401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:05:29 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-eebcfb51-1c29-4590-b84b-c257759f6c6b tempest-VolumesAdminNegativeTest-1388377401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:05:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-eebcfb51-1c29-4590-b84b-c257759f6c6b tempest-VolumesAdminNegativeTest-1388377401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:05:29 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-eebcfb51-1c29-4590-b84b-c257759f6c6b tempest-VolumesAdminNegativeTest-1388377401 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:05:29 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-eebcfb51-1c29-4590-b84b-c257759f6c6b tempest-VolumesAdminNegativeTest-1388377401 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:05:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-eebcfb51-1c29-4590-b84b-c257759f6c6b tempest-VolumesAdminNegativeTest-1388377401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-7d6b6280-6465-4a9c-8b91-8ad782ad8d94 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:05:29 devstack sudo[83255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-7d6b6280-6465-4a9c-8b91-8ad782ad8d94 1073741824
Apr 15 20:05:29 devstack sudo[83255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:05:31 devstack sudo[83255]: pam_unix(sudo:session): session closed for user root
Apr 15 20:05:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-eebcfb51-1c29-4590-b84b-c257759f6c6b tempest-VolumesAdminNegativeTest-1388377401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-7d6b6280-6465-4a9c-8b91-8ad782ad8d94 1073741824" returned: 0 in 1.783s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:05:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-eebcfb51-1c29-4590-b84b-c257759f6c6b tempest-VolumesAdminNegativeTest-1388377401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-7d6b6280-6465-4a9c-8b91-8ad782ad8d94 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:05:31 devstack sudo[83579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-7d6b6280-6465-4a9c-8b91-8ad782ad8d94
Apr 15 20:05:31 devstack sudo[83579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:05:32 devstack sudo[83579]: pam_unix(sudo:session): session closed for user root
Apr 15 20:05:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-eebcfb51-1c29-4590-b84b-c257759f6c6b tempest-VolumesAdminNegativeTest-1388377401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-7d6b6280-6465-4a9c-8b91-8ad782ad8d94" returned: 0 in 1.029s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:05:32 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-eebcfb51-1c29-4590-b84b-c257759f6c6b tempest-VolumesAdminNegativeTest-1388377401 None] <== create_volume: return (2900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:05:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-eebcfb51-1c29-4590-b84b-c257759f6c6b tempest-VolumesAdminNegativeTest-1388377401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.903s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:05:32 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-eebcfb51-1c29-4590-b84b-c257759f6c6b tempest-VolumesAdminNegativeTest-1388377401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0195b25-1689-4538-a21e-7aced7a1d219) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d6b6280-6465-4a9c-8b91-8ad782ad8d94', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:05:32 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-eebcfb51-1c29-4590-b84b-c257759f6c6b tempest-VolumesAdminNegativeTest-1388377401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec019f39-c910-4a78-adca-9bd6599df643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:05:32 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-eebcfb51-1c29-4590-b84b-c257759f6c6b tempest-VolumesAdminNegativeTest-1388377401 None] Volume volume-7d6b6280-6465-4a9c-8b91-8ad782ad8d94 (7d6b6280-6465-4a9c-8b91-8ad782ad8d94): created successfully
Apr 15 20:05:32 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-eebcfb51-1c29-4590-b84b-c257759f6c6b tempest-VolumesAdminNegativeTest-1388377401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec019f39-c910-4a78-adca-9bd6599df643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:05:32 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-eebcfb51-1c29-4590-b84b-c257759f6c6b tempest-VolumesAdminNegativeTest-1388377401 None] Flow 'volume_create_manager' (f3683dd2-847f-4055-bc85-28eaa69df432) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:05:32 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-eebcfb51-1c29-4590-b84b-c257759f6c6b tempest-VolumesAdminNegativeTest-1388377401 None] Created volume successfully.
Apr 15 20:05:34 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-eca7bf95-90c0-4be2-a711-149efed5012a tempest-VolumesAdminNegativeTest-1388377401 None] Acquiring lock "cinder-7d6b6280-6465-4a9c-8b91-8ad782ad8d94-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:05:34 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-eca7bf95-90c0-4be2-a711-149efed5012a tempest-VolumesAdminNegativeTest-1388377401 None] Lock "cinder-7d6b6280-6465-4a9c-8b91-8ad782ad8d94-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:05:34 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-eca7bf95-90c0-4be2-a711-149efed5012a tempest-VolumesAdminNegativeTest-1388377401 None] Acquiring lock "cinder-quobyte-7d6b6280-6465-4a9c-8b91-8ad782ad8d94" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:05:34 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-eca7bf95-90c0-4be2-a711-149efed5012a tempest-VolumesAdminNegativeTest-1388377401 None] Lock "cinder-quobyte-7d6b6280-6465-4a9c-8b91-8ad782ad8d94" acquired by "delete_volume" :: waited 0.040s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:05:34 devstack cinder-volume[82646]: INFO oslo.privsep.daemon [None req-eca7bf95-90c0-4be2-a711-149efed5012a tempest-VolumesAdminNegativeTest-1388377401 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpv3mhg8tg/privsep.sock']
Apr 15 20:05:34 devstack sudo[83598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpv3mhg8tg/privsep.sock
Apr 15 20:05:34 devstack sudo[83598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:05:35 devstack cinder-volume[82646]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
Apr 15 20:05:35 devstack cinder-volume[82646]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 15 20:05:35 devstack cinder-volume[82646]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Apr 15 20:05:35 devstack cinder-volume[82646]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 15 20:05:35 devstack cinder-volume[82646]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Apr 15 20:05:35 devstack cinder-volume[82646]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Apr 15 20:05:35 devstack cinder-volume[82646]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 15 20:05:35 devstack cinder-volume[82646]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 15 20:05:35 devstack cinder-volume[82646]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
Apr 15 20:05:36 devstack cinder-volume[82646]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning:
Apr 15 20:05:36 devstack cinder-volume[82646]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 15 20:05:36 devstack cinder-volume[82646]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Apr 15 20:05:36 devstack cinder-volume[82646]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 15 20:05:36 devstack cinder-volume[82646]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Apr 15 20:05:36 devstack cinder-volume[82646]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Apr 15 20:05:36 devstack cinder-volume[82646]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 15 20:05:36 devstack cinder-volume[82646]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 15 20:05:36 devstack cinder-volume[82646]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Apr 15 20:05:37 devstack sudo[83598]: pam_unix(sudo:session): session closed for user root
Apr 15 20:05:37 devstack cinder-volume[82646]: INFO oslo.privsep.daemon [None req-eca7bf95-90c0-4be2-a711-149efed5012a tempest-VolumesAdminNegativeTest-1388377401 None] Spawned new privsep daemon via rootwrap
Apr 15 20:05:37 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [None req-eca7bf95-90c0-4be2-a711-149efed5012a tempest-VolumesAdminNegativeTest-1388377401 None] Accepted privsep connection to /tmp/tmpv3mhg8tg/privsep.sock {{(pid=82646) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}}
Apr 15 20:05:37 devstack cinder-volume[82646]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 15 20:05:37 devstack cinder-volume[82646]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 15 20:05:37 devstack cinder-volume[82646]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 15 20:05:37 devstack cinder-volume[82646]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83652
Apr 15 20:05:37 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b80aa1-d079-4dc3-9d23-d96f69ae5b31]: (2,) {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:05:37 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7087dd5-599b-4abc-8df6-7d08ea3ce54a]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:05:37 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-eca7bf95-90c0-4be2-a711-149efed5012a tempest-VolumesAdminNegativeTest-1388377401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-7d6b6280-6465-4a9c-8b91-8ad782ad8d94 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:05:37 devstack sudo[83655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-7d6b6280-6465-4a9c-8b91-8ad782ad8d94
Apr 15 20:05:37 devstack sudo[83655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:05:38 devstack sudo[83655]: pam_unix(sudo:session): session closed for user root
Apr 15 20:05:38 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-eca7bf95-90c0-4be2-a711-149efed5012a tempest-VolumesAdminNegativeTest-1388377401 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-7d6b6280-6465-4a9c-8b91-8ad782ad8d94" returned: 0 in 1.519s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:05:38 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-eca7bf95-90c0-4be2-a711-149efed5012a tempest-VolumesAdminNegativeTest-1388377401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-7d6b6280-6465-4a9c-8b91-8ad782ad8d94 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:05:38 devstack sudo[83662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-7d6b6280-6465-4a9c-8b91-8ad782ad8d94
Apr 15 20:05:38 devstack sudo[83662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:05:39 devstack sudo[83662]: pam_unix(sudo:session): session closed for user root
Apr 15 20:05:39 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-eca7bf95-90c0-4be2-a711-149efed5012a tempest-VolumesAdminNegativeTest-1388377401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-7d6b6280-6465-4a9c-8b91-8ad782ad8d94" returned: 0 in 0.935s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:05:39 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-eca7bf95-90c0-4be2-a711-149efed5012a tempest-VolumesAdminNegativeTest-1388377401 None] Lock "cinder-quobyte-7d6b6280-6465-4a9c-8b91-8ad782ad8d94" released by "delete_volume" :: held 5.329s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:05:39 devstack cinder-volume[82646]: WARNING cinder.quota [None req-eca7bf95-90c0-4be2-a711-149efed5012a tempest-VolumesAdminNegativeTest-1388377401 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 15 20:05:39 devstack cinder-volume[82646]: WARNING cinder.quota [None req-eca7bf95-90c0-4be2-a711-149efed5012a tempest-VolumesAdminNegativeTest-1388377401 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 15 20:05:39 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-eca7bf95-90c0-4be2-a711-149efed5012a tempest-VolumesAdminNegativeTest-1388377401 None] Created reservations ['599172cc-ea85-4238-8f02-07eeec37fdc9', 'e2cdc1d8-e1be-4aa8-a1a1-d2dc18ea5ef4', '46e21aab-a004-4a07-b745-83edef9cff83', '3395a72f-c6ca-4787-b692-81f737854012'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:05:40 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-eca7bf95-90c0-4be2-a711-149efed5012a tempest-VolumesAdminNegativeTest-1388377401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:05:40 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-eca7bf95-90c0-4be2-a711-149efed5012a tempest-VolumesAdminNegativeTest-1388377401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:05:40 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-eca7bf95-90c0-4be2-a711-149efed5012a tempest-VolumesAdminNegativeTest-1388377401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:05:40 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-eca7bf95-90c0-4be2-a711-149efed5012a tempest-VolumesAdminNegativeTest-1388377401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:05:40 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-eca7bf95-90c0-4be2-a711-149efed5012a tempest-VolumesAdminNegativeTest-1388377401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:05:40 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-eca7bf95-90c0-4be2-a711-149efed5012a tempest-VolumesAdminNegativeTest-1388377401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:05:40 devstack sudo[83692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:05:40 devstack sudo[83692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:05:41 devstack sudo[83692]: pam_unix(sudo:session): session closed for user root
Apr 15 20:05:41 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-eca7bf95-90c0-4be2-a711-149efed5012a tempest-VolumesAdminNegativeTest-1388377401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 1.256s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:05:41 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-eca7bf95-90c0-4be2-a711-149efed5012a tempest-VolumesAdminNegativeTest-1388377401 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:05:41 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-eca7bf95-90c0-4be2-a711-149efed5012a tempest-VolumesAdminNegativeTest-1388377401 None] Deleted volume successfully.
Apr 15 20:05:41 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-eca7bf95-90c0-4be2-a711-149efed5012a tempest-VolumesAdminNegativeTest-1388377401 None] Lock "cinder-7d6b6280-6465-4a9c-8b91-8ad782ad8d94-delete_volume" released by "delete_volume" :: held 7.236s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:05:46 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-7111fef8-70a7-4bb0-85be-da2adc2e103b tempest-ServerRescueNegativeTestJSON-980923551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:05:46 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-7111fef8-70a7-4bb0-85be-da2adc2e103b tempest-ServerRescueNegativeTestJSON-980923551 None] Flow 'volume_create_manager' (bf9c4874-c90b-4f63-8896-975467685c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:05:46 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-7111fef8-70a7-4bb0-85be-da2adc2e103b tempest-ServerRescueNegativeTestJSON-980923551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (badedbdf-6734-4fbf-ae06-dee5585acc58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:05:46 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-7111fef8-70a7-4bb0-85be-da2adc2e103b tempest-ServerRescueNegativeTestJSON-980923551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (badedbdf-6734-4fbf-ae06-dee5585acc58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:05:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1607497565',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98b7444a-b068-47bf-bde1-518e2d3f2f5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41b238071ac0408a8520ce4ea40691db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:05:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:05:47Z,use_quota=True,user_id='4ba7fa1fac5d431c853625d3a11e13e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:05:46 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-7111fef8-70a7-4bb0-85be-da2adc2e103b tempest-ServerRescueNegativeTestJSON-980923551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dedae63-faea-4398-985c-be17b59278d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:05:46 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-7111fef8-70a7-4bb0-85be-da2adc2e103b tempest-ServerRescueNegativeTestJSON-980923551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dedae63-faea-4398-985c-be17b59278d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:05:46 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-7111fef8-70a7-4bb0-85be-da2adc2e103b tempest-ServerRescueNegativeTestJSON-980923551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01c4e5c4-d4f4-45b0-a125-2b68db5ccb15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:05:46 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-7111fef8-70a7-4bb0-85be-da2adc2e103b tempest-ServerRescueNegativeTestJSON-980923551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01c4e5c4-d4f4-45b0-a125-2b68db5ccb15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98b7444a-b068-47bf-bde1-518e2d3f2f5b', 'volume_name': 'volume-98b7444a-b068-47bf-bde1-518e2d3f2f5b', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:05:46 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-7111fef8-70a7-4bb0-85be-da2adc2e103b tempest-ServerRescueNegativeTestJSON-980923551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc27651d-6974-4ddf-bb86-f21b25b2b179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:05:46 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-7111fef8-70a7-4bb0-85be-da2adc2e103b tempest-ServerRescueNegativeTestJSON-980923551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc27651d-6974-4ddf-bb86-f21b25b2b179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:05:46 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-7111fef8-70a7-4bb0-85be-da2adc2e103b tempest-ServerRescueNegativeTestJSON-980923551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab6980ef-62aa-473f-9f04-6621b271ee21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:05:46 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-7111fef8-70a7-4bb0-85be-da2adc2e103b tempest-ServerRescueNegativeTestJSON-980923551 None] Volume 98b7444a-b068-47bf-bde1-518e2d3f2f5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98b7444a-b068-47bf-bde1-518e2d3f2f5b', 'volume_size': 1}
Apr 15 20:05:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-7111fef8-70a7-4bb0-85be-da2adc2e103b tempest-ServerRescueNegativeTestJSON-980923551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:05:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-7111fef8-70a7-4bb0-85be-da2adc2e103b tempest-ServerRescueNegativeTestJSON-980923551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:05:46 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-7111fef8-70a7-4bb0-85be-da2adc2e103b tempest-ServerRescueNegativeTestJSON-980923551 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:05:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1607497565',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98b7444a-b068-47bf-bde1-518e2d3f2f5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41b238071ac0408a8520ce4ea40691db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:05:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:05:47Z,use_quota=True,user_id='4ba7fa1fac5d431c853625d3a11e13e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:05:46 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-7111fef8-70a7-4bb0-85be-da2adc2e103b tempest-ServerRescueNegativeTestJSON-980923551 None] Creating volume 98b7444a-b068-47bf-bde1-518e2d3f2f5b {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:05:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-7111fef8-70a7-4bb0-85be-da2adc2e103b tempest-ServerRescueNegativeTestJSON-980923551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:05:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-7111fef8-70a7-4bb0-85be-da2adc2e103b tempest-ServerRescueNegativeTestJSON-980923551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:05:46 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-7111fef8-70a7-4bb0-85be-da2adc2e103b tempest-ServerRescueNegativeTestJSON-980923551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:05:46 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-7111fef8-70a7-4bb0-85be-da2adc2e103b tempest-ServerRescueNegativeTestJSON-980923551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:05:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-7111fef8-70a7-4bb0-85be-da2adc2e103b tempest-ServerRescueNegativeTestJSON-980923551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:05:46 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-7111fef8-70a7-4bb0-85be-da2adc2e103b tempest-ServerRescueNegativeTestJSON-980923551 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:05:46 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-7111fef8-70a7-4bb0-85be-da2adc2e103b tempest-ServerRescueNegativeTestJSON-980923551 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:05:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-7111fef8-70a7-4bb0-85be-da2adc2e103b tempest-ServerRescueNegativeTestJSON-980923551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-98b7444a-b068-47bf-bde1-518e2d3f2f5b 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:05:46 devstack sudo[83766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-98b7444a-b068-47bf-bde1-518e2d3f2f5b 1073741824
Apr 15 20:05:46 devstack sudo[83766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:05:48 devstack sudo[83766]: pam_unix(sudo:session): session closed for user root
Apr 15 20:05:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-7111fef8-70a7-4bb0-85be-da2adc2e103b tempest-ServerRescueNegativeTestJSON-980923551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-98b7444a-b068-47bf-bde1-518e2d3f2f5b 1073741824" returned: 0 in 1.932s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:05:48 devstack cinder-volume[82646]: DEBUG oslo_service.periodic_task [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 15 20:05:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:05:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:05:48 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:05:48 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:05:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:05:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:05:49 devstack sudo[83772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:05:49 devstack sudo[83772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:05:49 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-7111fef8-70a7-4bb0-85be-da2adc2e103b tempest-ServerRescueNegativeTestJSON-980923551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-98b7444a-b068-47bf-bde1-518e2d3f2f5b {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:05:49 devstack sudo[83774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-98b7444a-b068-47bf-bde1-518e2d3f2f5b
Apr 15 20:05:49 devstack sudo[83774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:05:50 devstack sudo[83774]: pam_unix(sudo:session): session closed for user root
Apr 15 20:05:50 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-7111fef8-70a7-4bb0-85be-da2adc2e103b tempest-ServerRescueNegativeTestJSON-980923551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-98b7444a-b068-47bf-bde1-518e2d3f2f5b" returned: 0 in 1.056s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:05:50 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-7111fef8-70a7-4bb0-85be-da2adc2e103b tempest-ServerRescueNegativeTestJSON-980923551 None] <== create_volume: return (3250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:05:50 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-7111fef8-70a7-4bb0-85be-da2adc2e103b tempest-ServerRescueNegativeTestJSON-980923551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.252s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:05:50 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-7111fef8-70a7-4bb0-85be-da2adc2e103b tempest-ServerRescueNegativeTestJSON-980923551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab6980ef-62aa-473f-9f04-6621b271ee21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98b7444a-b068-47bf-bde1-518e2d3f2f5b', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:05:50 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-7111fef8-70a7-4bb0-85be-da2adc2e103b tempest-ServerRescueNegativeTestJSON-980923551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca830250-b813-4a31-b4b0-0a01498501ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:05:50 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-7111fef8-70a7-4bb0-85be-da2adc2e103b tempest-ServerRescueNegativeTestJSON-980923551 None] Volume volume-98b7444a-b068-47bf-bde1-518e2d3f2f5b (98b7444a-b068-47bf-bde1-518e2d3f2f5b): created successfully
Apr 15 20:05:50 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-7111fef8-70a7-4bb0-85be-da2adc2e103b tempest-ServerRescueNegativeTestJSON-980923551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca830250-b813-4a31-b4b0-0a01498501ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:05:50 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-7111fef8-70a7-4bb0-85be-da2adc2e103b tempest-ServerRescueNegativeTestJSON-980923551 None] Flow 'volume_create_manager' (bf9c4874-c90b-4f63-8896-975467685c86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:05:50 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-7111fef8-70a7-4bb0-85be-da2adc2e103b tempest-ServerRescueNegativeTestJSON-980923551 None] Created volume successfully.
Apr 15 20:05:50 devstack sudo[83772]: pam_unix(sudo:session): session closed for user root
Apr 15 20:05:50 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 1.649s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:05:50 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:05:51 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [req-74e7cef7-38be-465a-b2d0-9e7d74df79c2 req-ef720f85-ade5-4786-995f-97ed0a3e0776 tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:05:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [req-74e7cef7-38be-465a-b2d0-9e7d74df79c2 req-ef720f85-ade5-4786-995f-97ed0a3e0776 tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Flow 'volume_create_manager' (36012f30-62b0-40a4-922a-98c8362a0888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:05:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [req-74e7cef7-38be-465a-b2d0-9e7d74df79c2 req-ef720f85-ade5-4786-995f-97ed0a3e0776 tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35c40f5a-56ee-46b8-a895-9db2f62ba926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:05:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [req-74e7cef7-38be-465a-b2d0-9e7d74df79c2 req-ef720f85-ade5-4786-995f-97ed0a3e0776 tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35c40f5a-56ee-46b8-a895-9db2f62ba926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:05:51Z,deleted=False,deleted_at=None,display_description='',display_name='b764a5ac-ece7-4776-93ec-ab2018215a78-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae6b4ca8-4ee6-47f1-b968-bd0fa8421f74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='227dbfbe5f9d44169b11cda58a2477f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:05:51Z,use_quota=True,user_id='261582d0c7e14b41bb27d528cdd754db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:05:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [req-74e7cef7-38be-465a-b2d0-9e7d74df79c2 req-ef720f85-ade5-4786-995f-97ed0a3e0776 tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7898cf0f-a41b-4d97-969a-c03918951c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:05:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [req-74e7cef7-38be-465a-b2d0-9e7d74df79c2 req-ef720f85-ade5-4786-995f-97ed0a3e0776 tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7898cf0f-a41b-4d97-969a-c03918951c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:05:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [req-74e7cef7-38be-465a-b2d0-9e7d74df79c2 req-ef720f85-ade5-4786-995f-97ed0a3e0776 tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8979e88e-ea33-4c3e-b879-4a8418a02ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:05:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [req-74e7cef7-38be-465a-b2d0-9e7d74df79c2 req-ef720f85-ade5-4786-995f-97ed0a3e0776 tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8979e88e-ea33-4c3e-b879-4a8418a02ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae6b4ca8-4ee6-47f1-b968-bd0fa8421f74', 'volume_name': 'volume-ae6b4ca8-4ee6-47f1-b968-bd0fa8421f74', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:05:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [req-74e7cef7-38be-465a-b2d0-9e7d74df79c2 req-ef720f85-ade5-4786-995f-97ed0a3e0776 tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7cd1c04-cb61-4061-aa28-13eb82019cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:05:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [req-74e7cef7-38be-465a-b2d0-9e7d74df79c2 req-ef720f85-ade5-4786-995f-97ed0a3e0776 tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7cd1c04-cb61-4061-aa28-13eb82019cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:05:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [req-74e7cef7-38be-465a-b2d0-9e7d74df79c2 req-ef720f85-ade5-4786-995f-97ed0a3e0776 tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da6fe4fc-3b4b-450f-99b5-e5dcd0bd2634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:05:51 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [req-74e7cef7-38be-465a-b2d0-9e7d74df79c2 req-ef720f85-ade5-4786-995f-97ed0a3e0776 tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Volume ae6b4ca8-4ee6-47f1-b968-bd0fa8421f74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae6b4ca8-4ee6-47f1-b968-bd0fa8421f74', 'volume_size': 1}
Apr 15 20:05:51 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [req-74e7cef7-38be-465a-b2d0-9e7d74df79c2 req-ef720f85-ade5-4786-995f-97ed0a3e0776 tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:05:51 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [req-74e7cef7-38be-465a-b2d0-9e7d74df79c2 req-ef720f85-ade5-4786-995f-97ed0a3e0776 tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:05:51 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [req-74e7cef7-38be-465a-b2d0-9e7d74df79c2 req-ef720f85-ade5-4786-995f-97ed0a3e0776 tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:05:51Z,deleted=False,deleted_at=None,display_description='',display_name='b764a5ac-ece7-4776-93ec-ab2018215a78-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae6b4ca8-4ee6-47f1-b968-bd0fa8421f74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='227dbfbe5f9d44169b11cda58a2477f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:05:51Z,use_quota=True,user_id='261582d0c7e14b41bb27d528cdd754db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:05:51 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [req-74e7cef7-38be-465a-b2d0-9e7d74df79c2 req-ef720f85-ade5-4786-995f-97ed0a3e0776 tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Creating volume ae6b4ca8-4ee6-47f1-b968-bd0fa8421f74 {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:05:51 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [req-74e7cef7-38be-465a-b2d0-9e7d74df79c2 req-ef720f85-ade5-4786-995f-97ed0a3e0776 tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:05:51 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [req-74e7cef7-38be-465a-b2d0-9e7d74df79c2 req-ef720f85-ade5-4786-995f-97ed0a3e0776 tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:05:51 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [req-74e7cef7-38be-465a-b2d0-9e7d74df79c2 req-ef720f85-ade5-4786-995f-97ed0a3e0776 tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:05:51 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [req-74e7cef7-38be-465a-b2d0-9e7d74df79c2 req-ef720f85-ade5-4786-995f-97ed0a3e0776 tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:05:51 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [req-74e7cef7-38be-465a-b2d0-9e7d74df79c2 req-ef720f85-ade5-4786-995f-97ed0a3e0776 tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:05:51 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [req-74e7cef7-38be-465a-b2d0-9e7d74df79c2 req-ef720f85-ade5-4786-995f-97ed0a3e0776 tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:05:51 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [req-74e7cef7-38be-465a-b2d0-9e7d74df79c2 req-ef720f85-ade5-4786-995f-97ed0a3e0776 tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:05:51 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-74e7cef7-38be-465a-b2d0-9e7d74df79c2 req-ef720f85-ade5-4786-995f-97ed0a3e0776 tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-ae6b4ca8-4ee6-47f1-b968-bd0fa8421f74 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:05:51 devstack sudo[83778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-ae6b4ca8-4ee6-47f1-b968-bd0fa8421f74 1073741824
Apr 15 20:05:51 devstack sudo[83778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:05:52 devstack sudo[83778]: pam_unix(sudo:session): session closed for user root
Apr 15 20:05:52 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-74e7cef7-38be-465a-b2d0-9e7d74df79c2 req-ef720f85-ade5-4786-995f-97ed0a3e0776 tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-ae6b4ca8-4ee6-47f1-b968-bd0fa8421f74 1073741824" returned: 0 in 1.450s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:05:52 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-74e7cef7-38be-465a-b2d0-9e7d74df79c2 req-ef720f85-ade5-4786-995f-97ed0a3e0776 tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-ae6b4ca8-4ee6-47f1-b968-bd0fa8421f74 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:05:52 devstack sudo[83784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-ae6b4ca8-4ee6-47f1-b968-bd0fa8421f74
Apr 15 20:05:52 devstack sudo[83784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:05:53 devstack sudo[83784]: pam_unix(sudo:session): session closed for user root
Apr 15 20:05:53 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-74e7cef7-38be-465a-b2d0-9e7d74df79c2 req-ef720f85-ade5-4786-995f-97ed0a3e0776 tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-ae6b4ca8-4ee6-47f1-b968-bd0fa8421f74" returned: 0 in 1.207s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:05:53 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [req-74e7cef7-38be-465a-b2d0-9e7d74df79c2 req-ef720f85-ade5-4786-995f-97ed0a3e0776 tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] <== create_volume: return (2738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:05:54 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [req-74e7cef7-38be-465a-b2d0-9e7d74df79c2 req-ef720f85-ade5-4786-995f-97ed0a3e0776 tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.742s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:05:54 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [req-74e7cef7-38be-465a-b2d0-9e7d74df79c2 req-ef720f85-ade5-4786-995f-97ed0a3e0776 tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da6fe4fc-3b4b-450f-99b5-e5dcd0bd2634) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae6b4ca8-4ee6-47f1-b968-bd0fa8421f74', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:05:54 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [req-74e7cef7-38be-465a-b2d0-9e7d74df79c2 req-ef720f85-ade5-4786-995f-97ed0a3e0776 tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfe29bd9-da63-481b-88ca-35a0af4fc195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:05:54 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [req-74e7cef7-38be-465a-b2d0-9e7d74df79c2 req-ef720f85-ade5-4786-995f-97ed0a3e0776 tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Volume volume-ae6b4ca8-4ee6-47f1-b968-bd0fa8421f74 (ae6b4ca8-4ee6-47f1-b968-bd0fa8421f74): created successfully
Apr 15 20:05:54 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [req-74e7cef7-38be-465a-b2d0-9e7d74df79c2 req-ef720f85-ade5-4786-995f-97ed0a3e0776 tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfe29bd9-da63-481b-88ca-35a0af4fc195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:05:54 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [req-74e7cef7-38be-465a-b2d0-9e7d74df79c2 req-ef720f85-ade5-4786-995f-97ed0a3e0776 tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Flow 'volume_create_manager' (36012f30-62b0-40a4-922a-98c8362a0888) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:05:54 devstack cinder-volume[82646]: INFO cinder.volume.manager [req-74e7cef7-38be-465a-b2d0-9e7d74df79c2 req-ef720f85-ade5-4786-995f-97ed0a3e0776 tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Created volume successfully.
Apr 15 20:05:58 devstack cinder-volume[82646]: WARNING py.warnings [req-74e7cef7-38be-465a-b2d0-9e7d74df79c2 req-d274390c-bd47-43ff-87d4-65d98c8760bc tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes".  Apply join condition(s) between each element to resolve.
Apr 15 20:05:58 devstack cinder-volume[82646]:   .first()
Apr 15 20:05:58 devstack cinder-volume[82646]: 
Apr 15 20:05:58 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [req-74e7cef7-38be-465a-b2d0-9e7d74df79c2 req-d274390c-bd47-43ff-87d4-65d98c8760bc tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:05:58 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [req-74e7cef7-38be-465a-b2d0-9e7d74df79c2 req-d274390c-bd47-43ff-87d4-65d98c8760bc tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:05:58 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[f584ae1b-415a-427e-accc-347b849ecd39]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:05:58 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-74e7cef7-38be-465a-b2d0-9e7d74df79c2 req-d274390c-bd47-43ff-87d4-65d98c8760bc tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-ae6b4ca8-4ee6-47f1-b968-bd0fa8421f74 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:05:58 devstack sudo[83845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-ae6b4ca8-4ee6-47f1-b968-bd0fa8421f74
Apr 15 20:05:58 devstack sudo[83845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:05:59 devstack sudo[83845]: pam_unix(sudo:session): session closed for user root
Apr 15 20:05:59 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-74e7cef7-38be-465a-b2d0-9e7d74df79c2 req-d274390c-bd47-43ff-87d4-65d98c8760bc tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-ae6b4ca8-4ee6-47f1-b968-bd0fa8421f74" returned: 0 in 1.052s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:05:59 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [req-74e7cef7-38be-465a-b2d0-9e7d74df79c2 req-d274390c-bd47-43ff-87d4-65d98c8760bc tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.063s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:05:59 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [req-74e7cef7-38be-465a-b2d0-9e7d74df79c2 req-d274390c-bd47-43ff-87d4-65d98c8760bc tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450', 'name': 'volume-ae6b4ca8-4ee6-47f1-b968-bd0fa8421f74', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9b40076c-9c92-4c0b-9c71-fed46df36dea', 'enforce_multipath': True} {{(pid=82646) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 15 20:05:59 devstack cinder-volume[82646]: INFO cinder.volume.manager [req-74e7cef7-38be-465a-b2d0-9e7d74df79c2 req-d274390c-bd47-43ff-87d4-65d98c8760bc tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] attachment_update completed successfully.
Apr 15 20:06:09 devstack cinder-volume[82646]: DEBUG dbcounter [-] [82646] Writing DB stats cinder:UPDATE=20,cinder:SELECT=13,cinder:INSERT=5,cinder:DELETE=2 {{(pid=82646) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 20:06:09 devstack cinder-volume[82646]: DEBUG dbcounter [-] [82646] Writing DB stats cinder:SELECT=20,cinder:UPDATE=17,cinder:INSERT=2,cinder:DELETE=2 {{(pid=82646) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 20:06:14 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-2635f930-3029-4c4c-9203-9d697096522e tempest-ServerRescueNegativeTestJSON-980923551 None] Acquiring lock "cinder-98b7444a-b068-47bf-bde1-518e2d3f2f5b-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:06:14 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-2635f930-3029-4c4c-9203-9d697096522e tempest-ServerRescueNegativeTestJSON-980923551 None] Lock "cinder-98b7444a-b068-47bf-bde1-518e2d3f2f5b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:06:14 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-2635f930-3029-4c4c-9203-9d697096522e tempest-ServerRescueNegativeTestJSON-980923551 None] Acquiring lock "cinder-quobyte-98b7444a-b068-47bf-bde1-518e2d3f2f5b" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:06:14 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-2635f930-3029-4c4c-9203-9d697096522e tempest-ServerRescueNegativeTestJSON-980923551 None] Lock "cinder-quobyte-98b7444a-b068-47bf-bde1-518e2d3f2f5b" acquired by "delete_volume" :: waited 0.015s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:06:14 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[9710c436-0778-4860-8e64-7588ebc7ac67]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:06:14 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-2635f930-3029-4c4c-9203-9d697096522e tempest-ServerRescueNegativeTestJSON-980923551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-98b7444a-b068-47bf-bde1-518e2d3f2f5b {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:06:14 devstack sudo[84489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-98b7444a-b068-47bf-bde1-518e2d3f2f5b
Apr 15 20:06:14 devstack sudo[84489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:06:15 devstack sudo[84489]: pam_unix(sudo:session): session closed for user root
Apr 15 20:06:15 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-2635f930-3029-4c4c-9203-9d697096522e tempest-ServerRescueNegativeTestJSON-980923551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-98b7444a-b068-47bf-bde1-518e2d3f2f5b" returned: 0 in 1.263s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:06:15 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-2635f930-3029-4c4c-9203-9d697096522e tempest-ServerRescueNegativeTestJSON-980923551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-98b7444a-b068-47bf-bde1-518e2d3f2f5b {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:06:15 devstack sudo[84496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-98b7444a-b068-47bf-bde1-518e2d3f2f5b
Apr 15 20:06:15 devstack sudo[84496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:06:16 devstack sudo[84496]: pam_unix(sudo:session): session closed for user root
Apr 15 20:06:16 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-2635f930-3029-4c4c-9203-9d697096522e tempest-ServerRescueNegativeTestJSON-980923551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-98b7444a-b068-47bf-bde1-518e2d3f2f5b" returned: 0 in 0.669s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:06:16 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-2635f930-3029-4c4c-9203-9d697096522e tempest-ServerRescueNegativeTestJSON-980923551 None] Lock "cinder-quobyte-98b7444a-b068-47bf-bde1-518e2d3f2f5b" released by "delete_volume" :: held 2.004s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:06:16 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-2635f930-3029-4c4c-9203-9d697096522e tempest-ServerRescueNegativeTestJSON-980923551 None] Created reservations ['d9400622-f95d-4184-821d-aea717cbf3e7', '940e1ef3-8604-45df-ab7e-8159b5b8112d', 'eccc6ad2-70b8-4f63-9b14-a0d262cedf2c', 'f9750d41-52da-44b7-a5a2-eb53dafd956f'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:06:16 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-2635f930-3029-4c4c-9203-9d697096522e tempest-ServerRescueNegativeTestJSON-980923551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:06:16 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-2635f930-3029-4c4c-9203-9d697096522e tempest-ServerRescueNegativeTestJSON-980923551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:06:16 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-2635f930-3029-4c4c-9203-9d697096522e tempest-ServerRescueNegativeTestJSON-980923551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:06:16 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-2635f930-3029-4c4c-9203-9d697096522e tempest-ServerRescueNegativeTestJSON-980923551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:06:16 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-2635f930-3029-4c4c-9203-9d697096522e tempest-ServerRescueNegativeTestJSON-980923551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:06:16 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-2635f930-3029-4c4c-9203-9d697096522e tempest-ServerRescueNegativeTestJSON-980923551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:06:16 devstack sudo[84500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:06:16 devstack sudo[84500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:06:17 devstack sudo[84500]: pam_unix(sudo:session): session closed for user root
Apr 15 20:06:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-2635f930-3029-4c4c-9203-9d697096522e tempest-ServerRescueNegativeTestJSON-980923551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 1.198s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:06:17 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-2635f930-3029-4c4c-9203-9d697096522e tempest-ServerRescueNegativeTestJSON-980923551 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:06:17 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-2635f930-3029-4c4c-9203-9d697096522e tempest-ServerRescueNegativeTestJSON-980923551 None] Deleted volume successfully.
Apr 15 20:06:17 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-2635f930-3029-4c4c-9203-9d697096522e tempest-ServerRescueNegativeTestJSON-980923551 None] Lock "cinder-98b7444a-b068-47bf-bde1-518e2d3f2f5b-delete_volume" released by "delete_volume" :: held 3.527s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:06:35 devstack cinder-volume[82646]: DEBUG dbcounter [-] [82646] Writing DB stats cinder:UPDATE=5,cinder:SELECT=6,cinder:INSERT=3 {{(pid=82646) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 20:06:35 devstack cinder-volume[82646]: DEBUG dbcounter [-] [82646] Writing DB stats cinder:SELECT=5,cinder:INSERT=1,cinder:UPDATE=12,cinder:DELETE=1 {{(pid=82646) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 20:06:43 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-a3af04c1-1171-4267-b810-2de8bd665815 tempest-BackendsCapabilitiesAdminTestsJSON-1240674266 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7328071594238, 'free_capacity_gb': 1775.7328071594238, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82646) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 15 20:06:43 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-2b3992d2-5cf3-458c-9545-887ea434107c tempest-BackendsCapabilitiesAdminTestsJSON-1240674266 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7328071594238, 'free_capacity_gb': 1775.7328071594238, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82646) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 15 20:06:47 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-46c01615-55d6-40b8-bf87-b0005df1692d tempest-DeleteServersTestJSON-1742452567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:06:47 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-46c01615-55d6-40b8-bf87-b0005df1692d tempest-DeleteServersTestJSON-1742452567 None] Flow 'volume_create_manager' (791719e7-20c6-4b8f-8ab0-62ba9d85f502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:06:47 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-46c01615-55d6-40b8-bf87-b0005df1692d tempest-DeleteServersTestJSON-1742452567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8292a911-fea7-4944-9a4a-9116cae65921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:06:47 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-46c01615-55d6-40b8-bf87-b0005df1692d tempest-DeleteServersTestJSON-1742452567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8292a911-fea7-4944-9a4a-9116cae65921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:06:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-909156862',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c331ef6-ce7a-47da-9924-6c2587376472,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39e4f35f67494b9a8436bbd9e9ceee22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:06:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:06:48Z,use_quota=True,user_id='8bfd5cc677a447208604af2561d8577d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:06:47 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-46c01615-55d6-40b8-bf87-b0005df1692d tempest-DeleteServersTestJSON-1742452567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (101c0b07-ddf8-4ed4-b76f-a7957ed04243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:06:47 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-46c01615-55d6-40b8-bf87-b0005df1692d tempest-DeleteServersTestJSON-1742452567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (101c0b07-ddf8-4ed4-b76f-a7957ed04243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:06:47 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-46c01615-55d6-40b8-bf87-b0005df1692d tempest-DeleteServersTestJSON-1742452567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd261691-7bbb-4fc9-931d-7d0e384fd6cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:06:47 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-46c01615-55d6-40b8-bf87-b0005df1692d tempest-DeleteServersTestJSON-1742452567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd261691-7bbb-4fc9-931d-7d0e384fd6cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c331ef6-ce7a-47da-9924-6c2587376472', 'volume_name': 'volume-6c331ef6-ce7a-47da-9924-6c2587376472', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:06:47 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-46c01615-55d6-40b8-bf87-b0005df1692d tempest-DeleteServersTestJSON-1742452567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af9b7c89-39a1-489d-9fb6-a54fc1f93f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:06:47 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-46c01615-55d6-40b8-bf87-b0005df1692d tempest-DeleteServersTestJSON-1742452567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af9b7c89-39a1-489d-9fb6-a54fc1f93f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:06:47 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-46c01615-55d6-40b8-bf87-b0005df1692d tempest-DeleteServersTestJSON-1742452567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e327b8db-1c71-48fd-8a48-f8b65a859715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:06:47 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-46c01615-55d6-40b8-bf87-b0005df1692d tempest-DeleteServersTestJSON-1742452567 None] Volume 6c331ef6-ce7a-47da-9924-6c2587376472: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c331ef6-ce7a-47da-9924-6c2587376472', 'volume_size': 1}
Apr 15 20:06:47 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-46c01615-55d6-40b8-bf87-b0005df1692d tempest-DeleteServersTestJSON-1742452567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:06:47 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-46c01615-55d6-40b8-bf87-b0005df1692d tempest-DeleteServersTestJSON-1742452567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:06:47 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-46c01615-55d6-40b8-bf87-b0005df1692d tempest-DeleteServersTestJSON-1742452567 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:06:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-909156862',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c331ef6-ce7a-47da-9924-6c2587376472,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39e4f35f67494b9a8436bbd9e9ceee22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:06:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:06:48Z,use_quota=True,user_id='8bfd5cc677a447208604af2561d8577d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:06:47 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-46c01615-55d6-40b8-bf87-b0005df1692d tempest-DeleteServersTestJSON-1742452567 None] Creating volume 6c331ef6-ce7a-47da-9924-6c2587376472 {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:06:47 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-46c01615-55d6-40b8-bf87-b0005df1692d tempest-DeleteServersTestJSON-1742452567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:06:47 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-46c01615-55d6-40b8-bf87-b0005df1692d tempest-DeleteServersTestJSON-1742452567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:06:47 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-46c01615-55d6-40b8-bf87-b0005df1692d tempest-DeleteServersTestJSON-1742452567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:06:47 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-46c01615-55d6-40b8-bf87-b0005df1692d tempest-DeleteServersTestJSON-1742452567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:06:47 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-46c01615-55d6-40b8-bf87-b0005df1692d tempest-DeleteServersTestJSON-1742452567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:06:47 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-46c01615-55d6-40b8-bf87-b0005df1692d tempest-DeleteServersTestJSON-1742452567 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:06:47 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-46c01615-55d6-40b8-bf87-b0005df1692d tempest-DeleteServersTestJSON-1742452567 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:06:47 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-46c01615-55d6-40b8-bf87-b0005df1692d tempest-DeleteServersTestJSON-1742452567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6c331ef6-ce7a-47da-9924-6c2587376472 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:06:47 devstack sudo[84971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6c331ef6-ce7a-47da-9924-6c2587376472 1073741824
Apr 15 20:06:47 devstack sudo[84971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:06:48 devstack cinder-volume[82646]: DEBUG oslo_service.periodic_task [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 15 20:06:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:06:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:06:48 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:06:48 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:06:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:06:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:06:48 devstack sudo[84971]: pam_unix(sudo:session): session closed for user root
Apr 15 20:06:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-46c01615-55d6-40b8-bf87-b0005df1692d tempest-DeleteServersTestJSON-1742452567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6c331ef6-ce7a-47da-9924-6c2587376472 1073741824" returned: 0 in 1.204s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:06:48 devstack sudo[84976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:06:48 devstack sudo[84976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:06:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-46c01615-55d6-40b8-bf87-b0005df1692d tempest-DeleteServersTestJSON-1742452567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6c331ef6-ce7a-47da-9924-6c2587376472 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:06:49 devstack sudo[84978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6c331ef6-ce7a-47da-9924-6c2587376472
Apr 15 20:06:49 devstack sudo[84978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:06:49 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbf93ab2-e660-4784-add4-921ff1fd4935 tempest-ServersNegativeTestJSON-1417584242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:06:49 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-fbf93ab2-e660-4784-add4-921ff1fd4935 tempest-ServersNegativeTestJSON-1417584242 None] Flow 'volume_create_manager' (98f927c8-0a5f-4810-88ff-a23d6dfac4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:06:49 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-fbf93ab2-e660-4784-add4-921ff1fd4935 tempest-ServersNegativeTestJSON-1417584242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57197dde-4737-45a0-bfe7-7c8350fe0557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:06:49 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-fbf93ab2-e660-4784-add4-921ff1fd4935 tempest-ServersNegativeTestJSON-1417584242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57197dde-4737-45a0-bfe7-7c8350fe0557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:06:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1109396917',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=359973b0-b3cc-452c-bd4c-8be9256b317a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8268afdfb67b48dbb17e59495aefd324',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:06:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:06:49Z,use_quota=True,user_id='6b3baa60c5cd4555afd69df502b48c06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:06:49 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-fbf93ab2-e660-4784-add4-921ff1fd4935 tempest-ServersNegativeTestJSON-1417584242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fb5e1ca-dea3-4b9d-8494-7d9df0026e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:06:49 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-fbf93ab2-e660-4784-add4-921ff1fd4935 tempest-ServersNegativeTestJSON-1417584242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fb5e1ca-dea3-4b9d-8494-7d9df0026e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:06:49 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-fbf93ab2-e660-4784-add4-921ff1fd4935 tempest-ServersNegativeTestJSON-1417584242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a5e60cd-38d3-459b-bfc5-418dfe1569bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:06:49 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-fbf93ab2-e660-4784-add4-921ff1fd4935 tempest-ServersNegativeTestJSON-1417584242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a5e60cd-38d3-459b-bfc5-418dfe1569bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '359973b0-b3cc-452c-bd4c-8be9256b317a', 'volume_name': 'volume-359973b0-b3cc-452c-bd4c-8be9256b317a', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:06:49 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-fbf93ab2-e660-4784-add4-921ff1fd4935 tempest-ServersNegativeTestJSON-1417584242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50b66b31-fbd1-49ba-accb-970caaa1fe91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:06:49 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-fbf93ab2-e660-4784-add4-921ff1fd4935 tempest-ServersNegativeTestJSON-1417584242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50b66b31-fbd1-49ba-accb-970caaa1fe91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:06:49 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-fbf93ab2-e660-4784-add4-921ff1fd4935 tempest-ServersNegativeTestJSON-1417584242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb723f04-0e51-4a7f-8259-5bc943c47186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:06:49 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-fbf93ab2-e660-4784-add4-921ff1fd4935 tempest-ServersNegativeTestJSON-1417584242 None] Volume 359973b0-b3cc-452c-bd4c-8be9256b317a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-359973b0-b3cc-452c-bd4c-8be9256b317a', 'volume_size': 1}
Apr 15 20:06:49 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-fbf93ab2-e660-4784-add4-921ff1fd4935 tempest-ServersNegativeTestJSON-1417584242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:06:49 devstack sudo[84976]: pam_unix(sudo:session): session closed for user root
Apr 15 20:06:49 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.686s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:06:49 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:06:49 devstack sudo[84978]: pam_unix(sudo:session): session closed for user root
Apr 15 20:06:50 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-46c01615-55d6-40b8-bf87-b0005df1692d tempest-DeleteServersTestJSON-1742452567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6c331ef6-ce7a-47da-9924-6c2587376472" returned: 0 in 1.022s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:06:50 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-46c01615-55d6-40b8-bf87-b0005df1692d tempest-DeleteServersTestJSON-1742452567 None] <== create_volume: return (2288ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:06:50 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-46c01615-55d6-40b8-bf87-b0005df1692d tempest-DeleteServersTestJSON-1742452567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.291s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:06:50 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-fbf93ab2-e660-4784-add4-921ff1fd4935 tempest-ServersNegativeTestJSON-1417584242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.557s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:06:50 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-fbf93ab2-e660-4784-add4-921ff1fd4935 tempest-ServersNegativeTestJSON-1417584242 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:06:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1109396917',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=359973b0-b3cc-452c-bd4c-8be9256b317a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8268afdfb67b48dbb17e59495aefd324',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:06:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:06:49Z,use_quota=True,user_id='6b3baa60c5cd4555afd69df502b48c06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:06:50 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-fbf93ab2-e660-4784-add4-921ff1fd4935 tempest-ServersNegativeTestJSON-1417584242 None] Creating volume 359973b0-b3cc-452c-bd4c-8be9256b317a {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:06:50 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-fbf93ab2-e660-4784-add4-921ff1fd4935 tempest-ServersNegativeTestJSON-1417584242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:06:50 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-fbf93ab2-e660-4784-add4-921ff1fd4935 tempest-ServersNegativeTestJSON-1417584242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:06:50 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-fbf93ab2-e660-4784-add4-921ff1fd4935 tempest-ServersNegativeTestJSON-1417584242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:06:50 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-fbf93ab2-e660-4784-add4-921ff1fd4935 tempest-ServersNegativeTestJSON-1417584242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:06:50 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-fbf93ab2-e660-4784-add4-921ff1fd4935 tempest-ServersNegativeTestJSON-1417584242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:06:50 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-fbf93ab2-e660-4784-add4-921ff1fd4935 tempest-ServersNegativeTestJSON-1417584242 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:06:50 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-fbf93ab2-e660-4784-add4-921ff1fd4935 tempest-ServersNegativeTestJSON-1417584242 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:06:50 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-fbf93ab2-e660-4784-add4-921ff1fd4935 tempest-ServersNegativeTestJSON-1417584242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-359973b0-b3cc-452c-bd4c-8be9256b317a 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:06:50 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-46c01615-55d6-40b8-bf87-b0005df1692d tempest-DeleteServersTestJSON-1742452567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e327b8db-1c71-48fd-8a48-f8b65a859715) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c331ef6-ce7a-47da-9924-6c2587376472', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:06:50 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-46c01615-55d6-40b8-bf87-b0005df1692d tempest-DeleteServersTestJSON-1742452567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baff71c3-46aa-46d5-b55b-a31d4f55e134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:06:50 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-46c01615-55d6-40b8-bf87-b0005df1692d tempest-DeleteServersTestJSON-1742452567 None] Volume volume-6c331ef6-ce7a-47da-9924-6c2587376472 (6c331ef6-ce7a-47da-9924-6c2587376472): created successfully
Apr 15 20:06:50 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-46c01615-55d6-40b8-bf87-b0005df1692d tempest-DeleteServersTestJSON-1742452567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baff71c3-46aa-46d5-b55b-a31d4f55e134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:06:50 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-46c01615-55d6-40b8-bf87-b0005df1692d tempest-DeleteServersTestJSON-1742452567 None] Flow 'volume_create_manager' (791719e7-20c6-4b8f-8ab0-62ba9d85f502) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:06:50 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-46c01615-55d6-40b8-bf87-b0005df1692d tempest-DeleteServersTestJSON-1742452567 None] Created volume successfully.
Apr 15 20:06:50 devstack sudo[84982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-359973b0-b3cc-452c-bd4c-8be9256b317a 1073741824
Apr 15 20:06:50 devstack sudo[84982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:06:50 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-e027ff9e-f6d5-4650-8859-eb355a5acd5f tempest-VolumeTypesAccessTest-1547930951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:06:50 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e027ff9e-f6d5-4650-8859-eb355a5acd5f tempest-VolumeTypesAccessTest-1547930951 None] Flow 'volume_create_manager' (a67c6625-1b51-4272-aa62-881523f8e87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:06:50 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e027ff9e-f6d5-4650-8859-eb355a5acd5f tempest-VolumeTypesAccessTest-1547930951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54272abe-6d23-40a1-81f5-2e0e91ec4f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:06:50 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e027ff9e-f6d5-4650-8859-eb355a5acd5f tempest-VolumeTypesAccessTest-1547930951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54272abe-6d23-40a1-81f5-2e0e91ec4f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:06:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-418159151',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cb1ebff-06f1-4a97-a15e-6d0ffe87e665,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d88ce916dcf840918cc46eae287a0353',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:06:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:06:51Z,use_quota=True,user_id='0ec636296f2346a2a8bf878f06ee39b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11716b87-3e29-468b-ae67-ed6bd4a93eac),volume_type_id=11716b87-3e29-468b-ae67-ed6bd4a93eac)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:06:50 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e027ff9e-f6d5-4650-8859-eb355a5acd5f tempest-VolumeTypesAccessTest-1547930951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18b1c894-0868-411b-bc0a-7233b09101bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:06:50 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e027ff9e-f6d5-4650-8859-eb355a5acd5f tempest-VolumeTypesAccessTest-1547930951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18b1c894-0868-411b-bc0a-7233b09101bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:06:50 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e027ff9e-f6d5-4650-8859-eb355a5acd5f tempest-VolumeTypesAccessTest-1547930951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88f0d7d0-7e3b-4b30-a49e-eb7a1bd8fe5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:06:50 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e027ff9e-f6d5-4650-8859-eb355a5acd5f tempest-VolumeTypesAccessTest-1547930951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88f0d7d0-7e3b-4b30-a49e-eb7a1bd8fe5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cb1ebff-06f1-4a97-a15e-6d0ffe87e665', 'volume_name': 'volume-3cb1ebff-06f1-4a97-a15e-6d0ffe87e665', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:06:50 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e027ff9e-f6d5-4650-8859-eb355a5acd5f tempest-VolumeTypesAccessTest-1547930951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c299ce6e-7396-43a6-9603-b6dc2ebfdeb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:06:50 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e027ff9e-f6d5-4650-8859-eb355a5acd5f tempest-VolumeTypesAccessTest-1547930951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c299ce6e-7396-43a6-9603-b6dc2ebfdeb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:06:50 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e027ff9e-f6d5-4650-8859-eb355a5acd5f tempest-VolumeTypesAccessTest-1547930951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c0363fc-a81d-437a-82d3-8a7e953cee75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:06:50 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-e027ff9e-f6d5-4650-8859-eb355a5acd5f tempest-VolumeTypesAccessTest-1547930951 None] Volume 3cb1ebff-06f1-4a97-a15e-6d0ffe87e665: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cb1ebff-06f1-4a97-a15e-6d0ffe87e665', 'volume_size': 1}
Apr 15 20:06:50 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-e027ff9e-f6d5-4650-8859-eb355a5acd5f tempest-VolumeTypesAccessTest-1547930951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:06:50 devstack sudo[84982]: pam_unix(sudo:session): session closed for user root
Apr 15 20:06:50 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-fbf93ab2-e660-4784-add4-921ff1fd4935 tempest-ServersNegativeTestJSON-1417584242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-359973b0-b3cc-452c-bd4c-8be9256b317a 1073741824" returned: 0 in 0.834s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:06:50 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-fbf93ab2-e660-4784-add4-921ff1fd4935 tempest-ServersNegativeTestJSON-1417584242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-359973b0-b3cc-452c-bd4c-8be9256b317a {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:06:50 devstack sudo[84987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-359973b0-b3cc-452c-bd4c-8be9256b317a
Apr 15 20:06:50 devstack sudo[84987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:06:51 devstack sudo[84987]: pam_unix(sudo:session): session closed for user root
Apr 15 20:06:51 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-fbf93ab2-e660-4784-add4-921ff1fd4935 tempest-ServersNegativeTestJSON-1417584242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-359973b0-b3cc-452c-bd4c-8be9256b317a" returned: 0 in 0.462s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:06:51 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-fbf93ab2-e660-4784-add4-921ff1fd4935 tempest-ServersNegativeTestJSON-1417584242 None] <== create_volume: return (1330ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:06:51 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-fbf93ab2-e660-4784-add4-921ff1fd4935 tempest-ServersNegativeTestJSON-1417584242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.333s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:06:51 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-e027ff9e-f6d5-4650-8859-eb355a5acd5f tempest-VolumeTypesAccessTest-1547930951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.569s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:06:51 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-e027ff9e-f6d5-4650-8859-eb355a5acd5f tempest-VolumeTypesAccessTest-1547930951 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:06:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-418159151',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cb1ebff-06f1-4a97-a15e-6d0ffe87e665,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d88ce916dcf840918cc46eae287a0353',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:06:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:06:51Z,use_quota=True,user_id='0ec636296f2346a2a8bf878f06ee39b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11716b87-3e29-468b-ae67-ed6bd4a93eac),volume_type_id=11716b87-3e29-468b-ae67-ed6bd4a93eac)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:06:51 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-e027ff9e-f6d5-4650-8859-eb355a5acd5f tempest-VolumeTypesAccessTest-1547930951 None] Creating volume 3cb1ebff-06f1-4a97-a15e-6d0ffe87e665 {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:06:51 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-e027ff9e-f6d5-4650-8859-eb355a5acd5f tempest-VolumeTypesAccessTest-1547930951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:06:51 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-e027ff9e-f6d5-4650-8859-eb355a5acd5f tempest-VolumeTypesAccessTest-1547930951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:06:51 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-e027ff9e-f6d5-4650-8859-eb355a5acd5f tempest-VolumeTypesAccessTest-1547930951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:06:51 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-e027ff9e-f6d5-4650-8859-eb355a5acd5f tempest-VolumeTypesAccessTest-1547930951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:06:51 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-e027ff9e-f6d5-4650-8859-eb355a5acd5f tempest-VolumeTypesAccessTest-1547930951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:06:51 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-e027ff9e-f6d5-4650-8859-eb355a5acd5f tempest-VolumeTypesAccessTest-1547930951 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:06:51 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-e027ff9e-f6d5-4650-8859-eb355a5acd5f tempest-VolumeTypesAccessTest-1547930951 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:06:51 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e027ff9e-f6d5-4650-8859-eb355a5acd5f tempest-VolumeTypesAccessTest-1547930951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3cb1ebff-06f1-4a97-a15e-6d0ffe87e665 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:06:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-fbf93ab2-e660-4784-add4-921ff1fd4935 tempest-ServersNegativeTestJSON-1417584242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb723f04-0e51-4a7f-8259-5bc943c47186) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-359973b0-b3cc-452c-bd4c-8be9256b317a', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:06:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-fbf93ab2-e660-4784-add4-921ff1fd4935 tempest-ServersNegativeTestJSON-1417584242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (016fdb33-bf93-4c27-a414-5917c49aae0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:06:51 devstack sudo[84996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3cb1ebff-06f1-4a97-a15e-6d0ffe87e665 1073741824
Apr 15 20:06:51 devstack sudo[84996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:06:51 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-fbf93ab2-e660-4784-add4-921ff1fd4935 tempest-ServersNegativeTestJSON-1417584242 None] Volume volume-359973b0-b3cc-452c-bd4c-8be9256b317a (359973b0-b3cc-452c-bd4c-8be9256b317a): created successfully
Apr 15 20:06:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-fbf93ab2-e660-4784-add4-921ff1fd4935 tempest-ServersNegativeTestJSON-1417584242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (016fdb33-bf93-4c27-a414-5917c49aae0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:06:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-fbf93ab2-e660-4784-add4-921ff1fd4935 tempest-ServersNegativeTestJSON-1417584242 None] Flow 'volume_create_manager' (98f927c8-0a5f-4810-88ff-a23d6dfac4c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:06:51 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-fbf93ab2-e660-4784-add4-921ff1fd4935 tempest-ServersNegativeTestJSON-1417584242 None] Created volume successfully.
Apr 15 20:06:51 devstack sudo[84996]: pam_unix(sudo:session): session closed for user root
Apr 15 20:06:51 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e027ff9e-f6d5-4650-8859-eb355a5acd5f tempest-VolumeTypesAccessTest-1547930951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3cb1ebff-06f1-4a97-a15e-6d0ffe87e665 1073741824" returned: 0 in 0.538s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:06:51 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e027ff9e-f6d5-4650-8859-eb355a5acd5f tempest-VolumeTypesAccessTest-1547930951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3cb1ebff-06f1-4a97-a15e-6d0ffe87e665 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:06:51 devstack sudo[85004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3cb1ebff-06f1-4a97-a15e-6d0ffe87e665
Apr 15 20:06:51 devstack sudo[85004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:06:52 devstack sudo[85004]: pam_unix(sudo:session): session closed for user root
Apr 15 20:06:52 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e027ff9e-f6d5-4650-8859-eb355a5acd5f tempest-VolumeTypesAccessTest-1547930951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3cb1ebff-06f1-4a97-a15e-6d0ffe87e665" returned: 0 in 0.505s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:06:52 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-e027ff9e-f6d5-4650-8859-eb355a5acd5f tempest-VolumeTypesAccessTest-1547930951 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:06:52 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-e027ff9e-f6d5-4650-8859-eb355a5acd5f tempest-VolumeTypesAccessTest-1547930951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:06:52 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e027ff9e-f6d5-4650-8859-eb355a5acd5f tempest-VolumeTypesAccessTest-1547930951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c0363fc-a81d-437a-82d3-8a7e953cee75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cb1ebff-06f1-4a97-a15e-6d0ffe87e665', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:06:52 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e027ff9e-f6d5-4650-8859-eb355a5acd5f tempest-VolumeTypesAccessTest-1547930951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80b57f97-26df-4da6-bf66-eef2fa4b7646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:06:52 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-e027ff9e-f6d5-4650-8859-eb355a5acd5f tempest-VolumeTypesAccessTest-1547930951 None] Volume volume-3cb1ebff-06f1-4a97-a15e-6d0ffe87e665 (3cb1ebff-06f1-4a97-a15e-6d0ffe87e665): created successfully
Apr 15 20:06:52 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e027ff9e-f6d5-4650-8859-eb355a5acd5f tempest-VolumeTypesAccessTest-1547930951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80b57f97-26df-4da6-bf66-eef2fa4b7646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:06:52 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e027ff9e-f6d5-4650-8859-eb355a5acd5f tempest-VolumeTypesAccessTest-1547930951 None] Flow 'volume_create_manager' (a67c6625-1b51-4272-aa62-881523f8e87c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:06:52 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-e027ff9e-f6d5-4650-8859-eb355a5acd5f tempest-VolumeTypesAccessTest-1547930951 None] Created volume successfully.
Apr 15 20:06:52 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-6083988f-7799-4ff4-b814-3134f318688a tempest-VolumeTypesAccessTest-1547930951 None] Acquiring lock "cinder-3cb1ebff-06f1-4a97-a15e-6d0ffe87e665-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:06:52 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-6083988f-7799-4ff4-b814-3134f318688a tempest-VolumeTypesAccessTest-1547930951 None] Lock "cinder-3cb1ebff-06f1-4a97-a15e-6d0ffe87e665-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:06:52 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-6083988f-7799-4ff4-b814-3134f318688a tempest-VolumeTypesAccessTest-1547930951 None] Acquiring lock "cinder-quobyte-3cb1ebff-06f1-4a97-a15e-6d0ffe87e665" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:06:52 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-6083988f-7799-4ff4-b814-3134f318688a tempest-VolumeTypesAccessTest-1547930951 None] Lock "cinder-quobyte-3cb1ebff-06f1-4a97-a15e-6d0ffe87e665" acquired by "delete_volume" :: waited 0.015s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:06:53 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[617b6413-3df2-4fd6-b4ad-15909522b9fe]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:06:53 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6083988f-7799-4ff4-b814-3134f318688a tempest-VolumeTypesAccessTest-1547930951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3cb1ebff-06f1-4a97-a15e-6d0ffe87e665 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:06:53 devstack sudo[85009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3cb1ebff-06f1-4a97-a15e-6d0ffe87e665
Apr 15 20:06:53 devstack sudo[85009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:06:54 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-f55a7cb2-d332-4277-8f49-2324bf2f5b78 tempest-ServersNegativeTestJSON-1417584242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:06:54 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f55a7cb2-d332-4277-8f49-2324bf2f5b78 tempest-ServersNegativeTestJSON-1417584242 None] Flow 'volume_create_manager' (32fafc2d-b43b-491e-b0b8-9bb7f1637d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:06:54 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f55a7cb2-d332-4277-8f49-2324bf2f5b78 tempest-ServersNegativeTestJSON-1417584242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78b6737b-a73d-4bd1-819e-c82e80e953f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:06:54 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f55a7cb2-d332-4277-8f49-2324bf2f5b78 tempest-ServersNegativeTestJSON-1417584242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78b6737b-a73d-4bd1-819e-c82e80e953f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-664906837',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f05d4cd-86b7-4532-bb00-cfb0fcb331de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8268afdfb67b48dbb17e59495aefd324',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:06:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:06:54Z,use_quota=True,user_id='6b3baa60c5cd4555afd69df502b48c06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:06:54 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f55a7cb2-d332-4277-8f49-2324bf2f5b78 tempest-ServersNegativeTestJSON-1417584242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26e8d83e-52f5-42ab-828a-5d74b005eff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:06:54 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f55a7cb2-d332-4277-8f49-2324bf2f5b78 tempest-ServersNegativeTestJSON-1417584242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26e8d83e-52f5-42ab-828a-5d74b005eff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:06:54 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f55a7cb2-d332-4277-8f49-2324bf2f5b78 tempest-ServersNegativeTestJSON-1417584242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7125d2df-1422-489a-bf40-55b91f3accc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:06:54 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f55a7cb2-d332-4277-8f49-2324bf2f5b78 tempest-ServersNegativeTestJSON-1417584242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7125d2df-1422-489a-bf40-55b91f3accc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f05d4cd-86b7-4532-bb00-cfb0fcb331de', 'volume_name': 'volume-1f05d4cd-86b7-4532-bb00-cfb0fcb331de', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:06:54 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f55a7cb2-d332-4277-8f49-2324bf2f5b78 tempest-ServersNegativeTestJSON-1417584242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bd3632a-33c3-4c5e-bc5c-27d6c9e7eeae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:06:54 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f55a7cb2-d332-4277-8f49-2324bf2f5b78 tempest-ServersNegativeTestJSON-1417584242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bd3632a-33c3-4c5e-bc5c-27d6c9e7eeae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:06:54 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f55a7cb2-d332-4277-8f49-2324bf2f5b78 tempest-ServersNegativeTestJSON-1417584242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adb58704-3312-4e59-af79-fc161daeafbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:06:54 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-f55a7cb2-d332-4277-8f49-2324bf2f5b78 tempest-ServersNegativeTestJSON-1417584242 None] Volume 1f05d4cd-86b7-4532-bb00-cfb0fcb331de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f05d4cd-86b7-4532-bb00-cfb0fcb331de', 'volume_size': 1}
Apr 15 20:06:54 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-f55a7cb2-d332-4277-8f49-2324bf2f5b78 tempest-ServersNegativeTestJSON-1417584242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:06:54 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-f55a7cb2-d332-4277-8f49-2324bf2f5b78 tempest-ServersNegativeTestJSON-1417584242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:06:54 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-f55a7cb2-d332-4277-8f49-2324bf2f5b78 tempest-ServersNegativeTestJSON-1417584242 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-664906837',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f05d4cd-86b7-4532-bb00-cfb0fcb331de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8268afdfb67b48dbb17e59495aefd324',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:06:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:06:54Z,use_quota=True,user_id='6b3baa60c5cd4555afd69df502b48c06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:06:54 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-f55a7cb2-d332-4277-8f49-2324bf2f5b78 tempest-ServersNegativeTestJSON-1417584242 None] Creating volume 1f05d4cd-86b7-4532-bb00-cfb0fcb331de {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:06:54 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-f55a7cb2-d332-4277-8f49-2324bf2f5b78 tempest-ServersNegativeTestJSON-1417584242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:06:54 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-f55a7cb2-d332-4277-8f49-2324bf2f5b78 tempest-ServersNegativeTestJSON-1417584242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:06:54 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-f55a7cb2-d332-4277-8f49-2324bf2f5b78 tempest-ServersNegativeTestJSON-1417584242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:06:54 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-f55a7cb2-d332-4277-8f49-2324bf2f5b78 tempest-ServersNegativeTestJSON-1417584242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:06:54 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-f55a7cb2-d332-4277-8f49-2324bf2f5b78 tempest-ServersNegativeTestJSON-1417584242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:06:54 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-f55a7cb2-d332-4277-8f49-2324bf2f5b78 tempest-ServersNegativeTestJSON-1417584242 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:06:54 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-f55a7cb2-d332-4277-8f49-2324bf2f5b78 tempest-ServersNegativeTestJSON-1417584242 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:06:54 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-f55a7cb2-d332-4277-8f49-2324bf2f5b78 tempest-ServersNegativeTestJSON-1417584242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-1f05d4cd-86b7-4532-bb00-cfb0fcb331de 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:06:54 devstack sudo[85049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-1f05d4cd-86b7-4532-bb00-cfb0fcb331de 1073741824
Apr 15 20:06:54 devstack sudo[85049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:06:54 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [req-96714462-c84f-41a1-adf0-0cb119179768 req-e39ec818-693d-4472-92c7-6e533a71b7a6 tempest-DeleteServersTestJSON-1742452567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:06:54 devstack sudo[85009]: pam_unix(sudo:session): session closed for user root
Apr 15 20:06:54 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6083988f-7799-4ff4-b814-3134f318688a tempest-VolumeTypesAccessTest-1547930951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3cb1ebff-06f1-4a97-a15e-6d0ffe87e665" returned: 0 in 1.607s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:06:54 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6083988f-7799-4ff4-b814-3134f318688a tempest-VolumeTypesAccessTest-1547930951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3cb1ebff-06f1-4a97-a15e-6d0ffe87e665 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:06:54 devstack sudo[85053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3cb1ebff-06f1-4a97-a15e-6d0ffe87e665
Apr 15 20:06:54 devstack sudo[85053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:06:55 devstack sudo[85053]: pam_unix(sudo:session): session closed for user root
Apr 15 20:06:55 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6083988f-7799-4ff4-b814-3134f318688a tempest-VolumeTypesAccessTest-1547930951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3cb1ebff-06f1-4a97-a15e-6d0ffe87e665" returned: 0 in 0.703s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:06:55 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-6083988f-7799-4ff4-b814-3134f318688a tempest-VolumeTypesAccessTest-1547930951 None] Lock "cinder-quobyte-3cb1ebff-06f1-4a97-a15e-6d0ffe87e665" released by "delete_volume" :: held 2.402s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:06:55 devstack cinder-volume[82646]: WARNING cinder.quota [None req-6083988f-7799-4ff4-b814-3134f318688a tempest-VolumeTypesAccessTest-1547930951 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1085125860 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1085125860, it is now deprecated. Please use the default quota class for default quota.
Apr 15 20:06:55 devstack cinder-volume[82646]: WARNING cinder.quota [None req-6083988f-7799-4ff4-b814-3134f318688a tempest-VolumeTypesAccessTest-1547930951 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1085125860 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1085125860, it is now deprecated. Please use the default quota class for default quota.
Apr 15 20:06:55 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-6083988f-7799-4ff4-b814-3134f318688a tempest-VolumeTypesAccessTest-1547930951 None] Created reservations ['3bdd6070-06b9-43d4-a679-0fa272d9bffc', '1522896c-91a1-4c46-bac9-27152cbba821', '6fe262d8-aa37-4212-9f5f-8ecc4a5be2c0', 'f2685f16-1324-4add-afee-9b7740906ca1'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:06:55 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-6083988f-7799-4ff4-b814-3134f318688a tempest-VolumeTypesAccessTest-1547930951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:06:55 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-6083988f-7799-4ff4-b814-3134f318688a tempest-VolumeTypesAccessTest-1547930951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:06:55 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-6083988f-7799-4ff4-b814-3134f318688a tempest-VolumeTypesAccessTest-1547930951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:06:55 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-6083988f-7799-4ff4-b814-3134f318688a tempest-VolumeTypesAccessTest-1547930951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:06:55 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-6083988f-7799-4ff4-b814-3134f318688a tempest-VolumeTypesAccessTest-1547930951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:06:55 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6083988f-7799-4ff4-b814-3134f318688a tempest-VolumeTypesAccessTest-1547930951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:06:55 devstack sudo[85059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:06:55 devstack sudo[85059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:06:55 devstack sudo[85049]: pam_unix(sudo:session): session closed for user root
Apr 15 20:06:55 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-f55a7cb2-d332-4277-8f49-2324bf2f5b78 tempest-ServersNegativeTestJSON-1417584242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-1f05d4cd-86b7-4532-bb00-cfb0fcb331de 1073741824" returned: 0 in 1.210s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:06:55 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-f55a7cb2-d332-4277-8f49-2324bf2f5b78 tempest-ServersNegativeTestJSON-1417584242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-1f05d4cd-86b7-4532-bb00-cfb0fcb331de {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:06:55 devstack sudo[85061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-1f05d4cd-86b7-4532-bb00-cfb0fcb331de
Apr 15 20:06:55 devstack sudo[85061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:06:56 devstack sudo[85059]: pam_unix(sudo:session): session closed for user root
Apr 15 20:06:56 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6083988f-7799-4ff4-b814-3134f318688a tempest-VolumeTypesAccessTest-1547930951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.585s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:06:56 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-6083988f-7799-4ff4-b814-3134f318688a tempest-VolumeTypesAccessTest-1547930951 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:06:56 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-6083988f-7799-4ff4-b814-3134f318688a tempest-VolumeTypesAccessTest-1547930951 None] Deleted volume successfully.
Apr 15 20:06:56 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-6083988f-7799-4ff4-b814-3134f318688a tempest-VolumeTypesAccessTest-1547930951 None] Lock "cinder-3cb1ebff-06f1-4a97-a15e-6d0ffe87e665-delete_volume" released by "delete_volume" :: held 3.236s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:06:56 devstack sudo[85061]: pam_unix(sudo:session): session closed for user root
Apr 15 20:06:56 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-f55a7cb2-d332-4277-8f49-2324bf2f5b78 tempest-ServersNegativeTestJSON-1417584242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-1f05d4cd-86b7-4532-bb00-cfb0fcb331de" returned: 0 in 0.570s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:06:56 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-f55a7cb2-d332-4277-8f49-2324bf2f5b78 tempest-ServersNegativeTestJSON-1417584242 None] <== create_volume: return (1813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:06:56 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-f55a7cb2-d332-4277-8f49-2324bf2f5b78 tempest-ServersNegativeTestJSON-1417584242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.816s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:06:56 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [req-96714462-c84f-41a1-adf0-0cb119179768 req-e39ec818-693d-4472-92c7-6e533a71b7a6 tempest-DeleteServersTestJSON-1742452567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.553s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:06:56 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f55a7cb2-d332-4277-8f49-2324bf2f5b78 tempest-ServersNegativeTestJSON-1417584242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adb58704-3312-4e59-af79-fc161daeafbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f05d4cd-86b7-4532-bb00-cfb0fcb331de', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:06:56 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f55a7cb2-d332-4277-8f49-2324bf2f5b78 tempest-ServersNegativeTestJSON-1417584242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1af613e-5258-4ba2-b4fa-cb61ed1c42c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:06:56 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ffa539a-77d4-49a9-8f15-e9753246d2f6]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:06:56 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-96714462-c84f-41a1-adf0-0cb119179768 req-e39ec818-693d-4472-92c7-6e533a71b7a6 tempest-DeleteServersTestJSON-1742452567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6c331ef6-ce7a-47da-9924-6c2587376472 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:06:56 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-f55a7cb2-d332-4277-8f49-2324bf2f5b78 tempest-ServersNegativeTestJSON-1417584242 None] Volume volume-1f05d4cd-86b7-4532-bb00-cfb0fcb331de (1f05d4cd-86b7-4532-bb00-cfb0fcb331de): created successfully
Apr 15 20:06:56 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f55a7cb2-d332-4277-8f49-2324bf2f5b78 tempest-ServersNegativeTestJSON-1417584242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1af613e-5258-4ba2-b4fa-cb61ed1c42c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:06:56 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f55a7cb2-d332-4277-8f49-2324bf2f5b78 tempest-ServersNegativeTestJSON-1417584242 None] Flow 'volume_create_manager' (32fafc2d-b43b-491e-b0b8-9bb7f1637d3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:06:56 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-f55a7cb2-d332-4277-8f49-2324bf2f5b78 tempest-ServersNegativeTestJSON-1417584242 None] Created volume successfully.
Apr 15 20:06:56 devstack sudo[85067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6c331ef6-ce7a-47da-9924-6c2587376472
Apr 15 20:06:56 devstack sudo[85067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:06:56 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-58c95e5f-4629-469f-8378-a49ed5b7935c tempest-ServersNegativeTestJSON-1417584242 None] Acquiring lock "cinder-1f05d4cd-86b7-4532-bb00-cfb0fcb331de-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:06:56 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-58c95e5f-4629-469f-8378-a49ed5b7935c tempest-ServersNegativeTestJSON-1417584242 None] Lock "cinder-1f05d4cd-86b7-4532-bb00-cfb0fcb331de-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:06:57 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-58c95e5f-4629-469f-8378-a49ed5b7935c tempest-ServersNegativeTestJSON-1417584242 None] Acquiring lock "cinder-quobyte-1f05d4cd-86b7-4532-bb00-cfb0fcb331de" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:06:57 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-58c95e5f-4629-469f-8378-a49ed5b7935c tempest-ServersNegativeTestJSON-1417584242 None] Lock "cinder-quobyte-1f05d4cd-86b7-4532-bb00-cfb0fcb331de" acquired by "delete_volume" :: waited 0.032s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:06:57 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf160fd-aec3-4dad-af54-cc9378905d47]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:06:57 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-58c95e5f-4629-469f-8378-a49ed5b7935c tempest-ServersNegativeTestJSON-1417584242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-1f05d4cd-86b7-4532-bb00-cfb0fcb331de {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:06:57 devstack sudo[85067]: pam_unix(sudo:session): session closed for user root
Apr 15 20:06:57 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-96714462-c84f-41a1-adf0-0cb119179768 req-e39ec818-693d-4472-92c7-6e533a71b7a6 tempest-DeleteServersTestJSON-1742452567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6c331ef6-ce7a-47da-9924-6c2587376472" returned: 0 in 0.980s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:06:57 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [req-96714462-c84f-41a1-adf0-0cb119179768 req-e39ec818-693d-4472-92c7-6e533a71b7a6 tempest-DeleteServersTestJSON-1742452567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.998s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:06:57 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [req-96714462-c84f-41a1-adf0-0cb119179768 req-e39ec818-693d-4472-92c7-6e533a71b7a6 tempest-DeleteServersTestJSON-1742452567 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450', 'name': 'volume-6c331ef6-ce7a-47da-9924-6c2587376472', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5bbdae04-a6a5-4329-87bc-e17c6afda347', 'enforce_multipath': True} {{(pid=82646) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 15 20:06:57 devstack sudo[85072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-1f05d4cd-86b7-4532-bb00-cfb0fcb331de
Apr 15 20:06:57 devstack sudo[85072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:06:57 devstack cinder-volume[82646]: INFO cinder.volume.manager [req-96714462-c84f-41a1-adf0-0cb119179768 req-e39ec818-693d-4472-92c7-6e533a71b7a6 tempest-DeleteServersTestJSON-1742452567 None] attachment_update completed successfully.
Apr 15 20:06:58 devstack sudo[85072]: pam_unix(sudo:session): session closed for user root
Apr 15 20:06:58 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-58c95e5f-4629-469f-8378-a49ed5b7935c tempest-ServersNegativeTestJSON-1417584242 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-1f05d4cd-86b7-4532-bb00-cfb0fcb331de" returned: 0 in 1.093s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:06:58 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-58c95e5f-4629-469f-8378-a49ed5b7935c tempest-ServersNegativeTestJSON-1417584242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-1f05d4cd-86b7-4532-bb00-cfb0fcb331de {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:06:58 devstack sudo[85081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-1f05d4cd-86b7-4532-bb00-cfb0fcb331de
Apr 15 20:06:58 devstack sudo[85081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:06:58 devstack sudo[85081]: pam_unix(sudo:session): session closed for user root
Apr 15 20:06:58 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-58c95e5f-4629-469f-8378-a49ed5b7935c tempest-ServersNegativeTestJSON-1417584242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-1f05d4cd-86b7-4532-bb00-cfb0fcb331de" returned: 0 in 0.473s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:06:58 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-58c95e5f-4629-469f-8378-a49ed5b7935c tempest-ServersNegativeTestJSON-1417584242 None] Lock "cinder-quobyte-1f05d4cd-86b7-4532-bb00-cfb0fcb331de" released by "delete_volume" :: held 1.663s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:06:58 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-58c95e5f-4629-469f-8378-a49ed5b7935c tempest-ServersNegativeTestJSON-1417584242 None] Created reservations ['4ab3c2ef-2002-4e65-b8d5-1c2195feb21f', '0ba7a972-071c-4131-aa2f-799b5888e229', '08eda0a8-fba0-4e93-88ab-2be9dfd1a744', '64a7d71c-a3d9-442c-95bf-1ab222c1b677'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:06:58 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-58c95e5f-4629-469f-8378-a49ed5b7935c tempest-ServersNegativeTestJSON-1417584242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:06:58 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-58c95e5f-4629-469f-8378-a49ed5b7935c tempest-ServersNegativeTestJSON-1417584242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:06:58 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-58c95e5f-4629-469f-8378-a49ed5b7935c tempest-ServersNegativeTestJSON-1417584242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:06:58 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-58c95e5f-4629-469f-8378-a49ed5b7935c tempest-ServersNegativeTestJSON-1417584242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:06:58 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-58c95e5f-4629-469f-8378-a49ed5b7935c tempest-ServersNegativeTestJSON-1417584242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:06:58 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-58c95e5f-4629-469f-8378-a49ed5b7935c tempest-ServersNegativeTestJSON-1417584242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:06:58 devstack sudo[85085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:06:58 devstack sudo[85085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:06:59 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-d1b1b21a-b768-4dfe-93d7-54b1118f2e73 tempest-ServersNegativeTestJSON-1417584242 None] Acquiring lock "cinder-359973b0-b3cc-452c-bd4c-8be9256b317a-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:06:59 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-d1b1b21a-b768-4dfe-93d7-54b1118f2e73 tempest-ServersNegativeTestJSON-1417584242 None] Lock "cinder-359973b0-b3cc-452c-bd4c-8be9256b317a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:06:59 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-d1b1b21a-b768-4dfe-93d7-54b1118f2e73 tempest-ServersNegativeTestJSON-1417584242 None] Acquiring lock "cinder-quobyte-359973b0-b3cc-452c-bd4c-8be9256b317a" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:06:59 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-d1b1b21a-b768-4dfe-93d7-54b1118f2e73 tempest-ServersNegativeTestJSON-1417584242 None] Lock "cinder-quobyte-359973b0-b3cc-452c-bd4c-8be9256b317a" acquired by "delete_volume" :: waited 0.019s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:06:59 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3aaf1b-2329-44bb-9800-e0dbf4b7b226]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:06:59 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d1b1b21a-b768-4dfe-93d7-54b1118f2e73 tempest-ServersNegativeTestJSON-1417584242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-359973b0-b3cc-452c-bd4c-8be9256b317a {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:06:59 devstack sudo[85085]: pam_unix(sudo:session): session closed for user root
Apr 15 20:06:59 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-58c95e5f-4629-469f-8378-a49ed5b7935c tempest-ServersNegativeTestJSON-1417584242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.657s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:06:59 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-58c95e5f-4629-469f-8378-a49ed5b7935c tempest-ServersNegativeTestJSON-1417584242 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:06:59 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-58c95e5f-4629-469f-8378-a49ed5b7935c tempest-ServersNegativeTestJSON-1417584242 None] Deleted volume successfully.
Apr 15 20:06:59 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-58c95e5f-4629-469f-8378-a49ed5b7935c tempest-ServersNegativeTestJSON-1417584242 None] Lock "cinder-1f05d4cd-86b7-4532-bb00-cfb0fcb331de-delete_volume" released by "delete_volume" :: held 2.613s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:06:59 devstack sudo[85088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-359973b0-b3cc-452c-bd4c-8be9256b317a
Apr 15 20:06:59 devstack sudo[85088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:00 devstack sudo[85088]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:00 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d1b1b21a-b768-4dfe-93d7-54b1118f2e73 tempest-ServersNegativeTestJSON-1417584242 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-359973b0-b3cc-452c-bd4c-8be9256b317a" returned: 0 in 0.796s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:00 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d1b1b21a-b768-4dfe-93d7-54b1118f2e73 tempest-ServersNegativeTestJSON-1417584242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-359973b0-b3cc-452c-bd4c-8be9256b317a {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:00 devstack sudo[85093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-359973b0-b3cc-452c-bd4c-8be9256b317a
Apr 15 20:07:00 devstack sudo[85093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:00 devstack sudo[85093]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:00 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d1b1b21a-b768-4dfe-93d7-54b1118f2e73 tempest-ServersNegativeTestJSON-1417584242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-359973b0-b3cc-452c-bd4c-8be9256b317a" returned: 0 in 0.566s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:00 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-d1b1b21a-b768-4dfe-93d7-54b1118f2e73 tempest-ServersNegativeTestJSON-1417584242 None] Lock "cinder-quobyte-359973b0-b3cc-452c-bd4c-8be9256b317a" released by "delete_volume" :: held 1.402s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:07:00 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-d1b1b21a-b768-4dfe-93d7-54b1118f2e73 tempest-ServersNegativeTestJSON-1417584242 None] Created reservations ['2a7c6cbf-f383-441c-bc48-91c5c17dcb50', 'a6803840-3a5f-4d0d-a3c8-d07289a3ee83', '66d0ad30-8cc1-4f7b-b7df-5da114f766d5', '1c35ea35-671b-4d8f-b473-92189d006652'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:07:00 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-d1b1b21a-b768-4dfe-93d7-54b1118f2e73 tempest-ServersNegativeTestJSON-1417584242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:07:00 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-d1b1b21a-b768-4dfe-93d7-54b1118f2e73 tempest-ServersNegativeTestJSON-1417584242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:07:00 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-d1b1b21a-b768-4dfe-93d7-54b1118f2e73 tempest-ServersNegativeTestJSON-1417584242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:07:00 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-d1b1b21a-b768-4dfe-93d7-54b1118f2e73 tempest-ServersNegativeTestJSON-1417584242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:07:00 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-d1b1b21a-b768-4dfe-93d7-54b1118f2e73 tempest-ServersNegativeTestJSON-1417584242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:07:00 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d1b1b21a-b768-4dfe-93d7-54b1118f2e73 tempest-ServersNegativeTestJSON-1417584242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:00 devstack sudo[85096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:07:00 devstack sudo[85096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:01 devstack sudo[85096]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:01 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d1b1b21a-b768-4dfe-93d7-54b1118f2e73 tempest-ServersNegativeTestJSON-1417584242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.555s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:01 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-d1b1b21a-b768-4dfe-93d7-54b1118f2e73 tempest-ServersNegativeTestJSON-1417584242 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:07:01 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-d1b1b21a-b768-4dfe-93d7-54b1118f2e73 tempest-ServersNegativeTestJSON-1417584242 None] Deleted volume successfully.
Apr 15 20:07:01 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-d1b1b21a-b768-4dfe-93d7-54b1118f2e73 tempest-ServersNegativeTestJSON-1417584242 None] Lock "cinder-359973b0-b3cc-452c-bd4c-8be9256b317a-delete_volume" released by "delete_volume" :: held 2.209s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:07:06 devstack cinder-volume[82646]: INFO cinder.volume.manager [req-519575c8-0010-4e47-be69-3131a178b4e1 req-8ff9451f-b833-4b41-94d0-d8fe358e1282 tempest-DeleteServersTestJSON-1742452567 None] Terminate volume connection completed successfully.
Apr 15 20:07:06 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [req-519575c8-0010-4e47-be69-3131a178b4e1 req-8ff9451f-b833-4b41-94d0-d8fe358e1282 tempest-DeleteServersTestJSON-1742452567 None] Deleting attachment 5bbdae04-a6a5-4329-87bc-e17c6afda347. {{(pid=82646) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 15 20:07:10 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-4d889944-26ea-4ee2-bfb0-fffdf8258941 tempest-DeleteServersTestJSON-1742452567 None] Acquiring lock "cinder-6c331ef6-ce7a-47da-9924-6c2587376472-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:07:10 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-4d889944-26ea-4ee2-bfb0-fffdf8258941 tempest-DeleteServersTestJSON-1742452567 None] Lock "cinder-6c331ef6-ce7a-47da-9924-6c2587376472-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:07:10 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-4d889944-26ea-4ee2-bfb0-fffdf8258941 tempest-DeleteServersTestJSON-1742452567 None] Acquiring lock "cinder-quobyte-6c331ef6-ce7a-47da-9924-6c2587376472" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:07:10 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-4d889944-26ea-4ee2-bfb0-fffdf8258941 tempest-DeleteServersTestJSON-1742452567 None] Lock "cinder-quobyte-6c331ef6-ce7a-47da-9924-6c2587376472" acquired by "delete_volume" :: waited 0.007s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:07:10 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[a582d355-4f2b-4174-b92e-d9230554765b]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:07:10 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-4d889944-26ea-4ee2-bfb0-fffdf8258941 tempest-DeleteServersTestJSON-1742452567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6c331ef6-ce7a-47da-9924-6c2587376472 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:10 devstack sudo[85220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6c331ef6-ce7a-47da-9924-6c2587376472
Apr 15 20:07:10 devstack sudo[85220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:11 devstack sudo[85220]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:11 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-4d889944-26ea-4ee2-bfb0-fffdf8258941 tempest-DeleteServersTestJSON-1742452567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6c331ef6-ce7a-47da-9924-6c2587376472" returned: 0 in 0.696s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:11 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-4d889944-26ea-4ee2-bfb0-fffdf8258941 tempest-DeleteServersTestJSON-1742452567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6c331ef6-ce7a-47da-9924-6c2587376472 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:11 devstack sudo[85225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6c331ef6-ce7a-47da-9924-6c2587376472
Apr 15 20:07:11 devstack sudo[85225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:11 devstack sudo[85225]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:11 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-4d889944-26ea-4ee2-bfb0-fffdf8258941 tempest-DeleteServersTestJSON-1742452567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6c331ef6-ce7a-47da-9924-6c2587376472" returned: 0 in 0.664s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:11 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-4d889944-26ea-4ee2-bfb0-fffdf8258941 tempest-DeleteServersTestJSON-1742452567 None] Lock "cinder-quobyte-6c331ef6-ce7a-47da-9924-6c2587376472" released by "delete_volume" :: held 1.390s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:07:11 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-4d889944-26ea-4ee2-bfb0-fffdf8258941 tempest-DeleteServersTestJSON-1742452567 None] Created reservations ['7d6357f3-87d8-4d68-9442-a2b5b66e6963', '629ea940-dcaf-49d6-938f-6f78322025dd', '9941b258-11b4-44a1-8712-11909bf50e74', 'b20821f4-87f7-4f72-8614-f48b8b0abc0f'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:07:11 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-4d889944-26ea-4ee2-bfb0-fffdf8258941 tempest-DeleteServersTestJSON-1742452567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:07:11 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-4d889944-26ea-4ee2-bfb0-fffdf8258941 tempest-DeleteServersTestJSON-1742452567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:07:11 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-4d889944-26ea-4ee2-bfb0-fffdf8258941 tempest-DeleteServersTestJSON-1742452567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:07:11 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-4d889944-26ea-4ee2-bfb0-fffdf8258941 tempest-DeleteServersTestJSON-1742452567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:07:11 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-4d889944-26ea-4ee2-bfb0-fffdf8258941 tempest-DeleteServersTestJSON-1742452567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:07:11 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-4d889944-26ea-4ee2-bfb0-fffdf8258941 tempest-DeleteServersTestJSON-1742452567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:11 devstack sudo[85230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:07:11 devstack sudo[85230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:12 devstack sudo[85230]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:12 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-4d889944-26ea-4ee2-bfb0-fffdf8258941 tempest-DeleteServersTestJSON-1742452567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.729s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:12 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-4d889944-26ea-4ee2-bfb0-fffdf8258941 tempest-DeleteServersTestJSON-1742452567 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:07:12 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-4d889944-26ea-4ee2-bfb0-fffdf8258941 tempest-DeleteServersTestJSON-1742452567 None] Deleted volume successfully.
Apr 15 20:07:12 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-4d889944-26ea-4ee2-bfb0-fffdf8258941 tempest-DeleteServersTestJSON-1742452567 None] Lock "cinder-6c331ef6-ce7a-47da-9924-6c2587376472-delete_volume" released by "delete_volume" :: held 2.369s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:07:14 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-1ed1651e-0131-47ed-afa4-c02247b84b4d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:07:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-1ed1651e-0131-47ed-afa4-c02247b84b4d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Flow 'volume_create_manager' (9e6d369c-b85c-4e84-af7a-23030e2c8b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:07:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-1ed1651e-0131-47ed-afa4-c02247b84b4d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (652e9877-eab9-49fe-b4f3-a956025ba603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-1ed1651e-0131-47ed-afa4-c02247b84b4d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (652e9877-eab9-49fe-b4f3-a956025ba603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:07:14Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8341f71a-cabe-4251-8fe6-fa688c7e6371,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='227dbfbe5f9d44169b11cda58a2477f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:07:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:07:14Z,use_quota=True,user_id='261582d0c7e14b41bb27d528cdd754db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-1ed1651e-0131-47ed-afa4-c02247b84b4d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd0650c5-64e7-44b4-b37e-12e564c7fd57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-1ed1651e-0131-47ed-afa4-c02247b84b4d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd0650c5-64e7-44b4-b37e-12e564c7fd57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-1ed1651e-0131-47ed-afa4-c02247b84b4d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1da70c7f-0d4c-4765-8ef3-9bbb233c0d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:14 devstack cinder-volume[82646]: DEBUG cinder.image.glance [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-1ed1651e-0131-47ed-afa4-c02247b84b4d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Creating Keystone auth plugin from conf {{(pid=82646) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 15 20:07:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-1ed1651e-0131-47ed-afa4-c02247b84b4d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1da70c7f-0d4c-4765-8ef3-9bbb233c0d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8341f71a-cabe-4251-8fe6-fa688c7e6371', 'volume_name': 'volume-8341f71a-cabe-4251-8fe6-fa688c7e6371', 'volume_size': 1, 'image_id': '565a23e3-dcfa-4a62-b361-219578b0cd92', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/565a23e3-dcfa-4a62-b361-219578b0cd92', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '27d9c820db6c4abea4324fe8ea0f90e6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '565a23e3-dcfa-4a62-b361-219578b0cd92', 'created_at': datetime.datetime(2026, 4, 15, 18, 0, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 18, 0, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/565a23e3-dcfa-4a62-b361-219578b0cd92/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe16767e620>}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-1ed1651e-0131-47ed-afa4-c02247b84b4d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cc01f44-8c6f-47d3-926c-1660f8dadd9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-1ed1651e-0131-47ed-afa4-c02247b84b4d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cc01f44-8c6f-47d3-926c-1660f8dadd9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-1ed1651e-0131-47ed-afa4-c02247b84b4d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc38b47c-618f-4962-9aba-89d64e4cfe7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:14 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-1ed1651e-0131-47ed-afa4-c02247b84b4d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Volume 8341f71a-cabe-4251-8fe6-fa688c7e6371: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8341f71a-cabe-4251-8fe6-fa688c7e6371', 'volume_size': 1, 'image_id': '565a23e3-dcfa-4a62-b361-219578b0cd92', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/565a23e3-dcfa-4a62-b361-219578b0cd92', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '27d9c820db6c4abea4324fe8ea0f90e6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '565a23e3-dcfa-4a62-b361-219578b0cd92', 'created_at': datetime.datetime(2026, 4, 15, 18, 0, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 18, 0, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/565a23e3-dcfa-4a62-b361-219578b0cd92/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe16767e620>}
Apr 15 20:07:14 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-1ed1651e-0131-47ed-afa4-c02247b84b4d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Trying to clone 8341f71a-cabe-4251-8fe6-fa688c7e6371 from image 565a23e3-dcfa-4a62-b361-219578b0cd92 at location (None, [{'url': 'file:///opt/stack/data/glance/images/565a23e3-dcfa-4a62-b361-219578b0cd92', 'metadata': {}}]). {{(pid=82646) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 15 20:07:15 devstack cinder-volume[82646]: DEBUG cinder.image.image_utils [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-1ed1651e-0131-47ed-afa4-c02247b84b4d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_565a23e3-dcfa-4a62-b361-219578b0cd92_xngk1f_6devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82646) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 15 20:07:15 devstack cinder-volume[82646]: INFO cinder.image.image_utils [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-1ed1651e-0131-47ed-afa4-c02247b84b4d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Image download 20.69 MB at 20.69 MB/s
Apr 15 20:07:15 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f069e0-0793-4868-a873-f43343702ed8]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:07:15 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-1ed1651e-0131-47ed-afa4-c02247b84b4d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_565a23e3-dcfa-4a62-b361-219578b0cd92_xngk1f_6devstack@QuobyteHD {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:15 devstack sudo[85256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_565a23e3-dcfa-4a62-b361-219578b0cd92_xngk1f_6devstack@QuobyteHD
Apr 15 20:07:15 devstack sudo[85256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:16 devstack sudo[85256]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:16 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-1ed1651e-0131-47ed-afa4-c02247b84b4d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_565a23e3-dcfa-4a62-b361-219578b0cd92_xngk1f_6devstack@QuobyteHD" returned: 0 in 1.013s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:16 devstack cinder-volume[82646]: DEBUG cinder.image.image_utils [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-1ed1651e-0131-47ed-afa4-c02247b84b4d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Temporary image 565a23e3-dcfa-4a62-b361-219578b0cd92 is fetched for user 261582d0c7e14b41bb27d528cdd754db. {{(pid=82646) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 15 20:07:16 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[cadbef31-b48b-40d0-994c-11af0a244dee]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:07:16 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-1ed1651e-0131-47ed-afa4-c02247b84b4d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_565a23e3-dcfa-4a62-b361-219578b0cd92_xngk1f_6devstack@QuobyteHD {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:16 devstack sudo[85265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_565a23e3-dcfa-4a62-b361-219578b0cd92_xngk1f_6devstack@QuobyteHD
Apr 15 20:07:16 devstack sudo[85265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:17 devstack sudo[85265]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-1ed1651e-0131-47ed-afa4-c02247b84b4d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_565a23e3-dcfa-4a62-b361-219578b0cd92_xngk1f_6devstack@QuobyteHD" returned: 0 in 0.706s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-1ed1651e-0131-47ed-afa4-c02247b84b4d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:07:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-1ed1651e-0131-47ed-afa4-c02247b84b4d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:07:17 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-1ed1651e-0131-47ed-afa4-c02247b84b4d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:07:14Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8341f71a-cabe-4251-8fe6-fa688c7e6371,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='227dbfbe5f9d44169b11cda58a2477f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:07:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:07:14Z,use_quota=True,user_id='261582d0c7e14b41bb27d528cdd754db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:07:17 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-1ed1651e-0131-47ed-afa4-c02247b84b4d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Creating volume 8341f71a-cabe-4251-8fe6-fa688c7e6371 {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:07:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-1ed1651e-0131-47ed-afa4-c02247b84b4d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:07:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-1ed1651e-0131-47ed-afa4-c02247b84b4d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:07:17 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-1ed1651e-0131-47ed-afa4-c02247b84b4d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:07:17 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-1ed1651e-0131-47ed-afa4-c02247b84b4d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:07:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-1ed1651e-0131-47ed-afa4-c02247b84b4d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:07:17 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-1ed1651e-0131-47ed-afa4-c02247b84b4d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:07:17 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-1ed1651e-0131-47ed-afa4-c02247b84b4d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:07:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-1ed1651e-0131-47ed-afa4-c02247b84b4d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8341f71a-cabe-4251-8fe6-fa688c7e6371 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:17 devstack sudo[85270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8341f71a-cabe-4251-8fe6-fa688c7e6371 1073741824
Apr 15 20:07:17 devstack sudo[85270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:18 devstack sudo[85270]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:18 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-b37a19ec-5f76-4dfd-9019-9b349cb8fe9f tempest-GroupSnapshotsTest-234173950 None] Group tempest-GroupSnapshotsTest-Group-463647167: creating
Apr 15 20:07:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-1ed1651e-0131-47ed-afa4-c02247b84b4d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8341f71a-cabe-4251-8fe6-fa688c7e6371 1073741824" returned: 0 in 1.136s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:18 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-b37a19ec-5f76-4dfd-9019-9b349cb8fe9f tempest-GroupSnapshotsTest-234173950 None] Group tempest-GroupSnapshotsTest-Group-463647167: created successfully
Apr 15 20:07:18 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-b37a19ec-5f76-4dfd-9019-9b349cb8fe9f tempest-GroupSnapshotsTest-234173950 None] Create group completed successfully.
Apr 15 20:07:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-1ed1651e-0131-47ed-afa4-c02247b84b4d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8341f71a-cabe-4251-8fe6-fa688c7e6371 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:18 devstack sudo[85276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8341f71a-cabe-4251-8fe6-fa688c7e6371
Apr 15 20:07:18 devstack sudo[85276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:18 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-55b04bb2-6b3f-4f0d-8bcf-733a49790d69 tempest-VolumesTransfersV357Test-646466744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:07:18 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-55b04bb2-6b3f-4f0d-8bcf-733a49790d69 tempest-VolumesTransfersV357Test-646466744 None] Flow 'volume_create_manager' (f4f8107a-9578-40e5-9c6b-97903fac8f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:07:18 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-55b04bb2-6b3f-4f0d-8bcf-733a49790d69 tempest-VolumesTransfersV357Test-646466744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ce67470-783b-4608-8c70-bf3a40474205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:18 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-55b04bb2-6b3f-4f0d-8bcf-733a49790d69 tempest-VolumesTransfersV357Test-646466744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ce67470-783b-4608-8c70-bf3a40474205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:07:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-937751977',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee3cc2ee-77e2-4da7-9126-f2a6db533452,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ddb9a83c62246f7874bb7e709a3f28c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:07:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:07:19Z,use_quota=True,user_id='5d3dbb2878a542ba9d1d17720bdd654b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:18 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-55b04bb2-6b3f-4f0d-8bcf-733a49790d69 tempest-VolumesTransfersV357Test-646466744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88ae16c5-cfb1-43c5-a673-3c8ce4ba230b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:18 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-55b04bb2-6b3f-4f0d-8bcf-733a49790d69 tempest-VolumesTransfersV357Test-646466744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88ae16c5-cfb1-43c5-a673-3c8ce4ba230b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:18 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-55b04bb2-6b3f-4f0d-8bcf-733a49790d69 tempest-VolumesTransfersV357Test-646466744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (701cdf01-427a-4ff5-9e37-c246a021a93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:18 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-55b04bb2-6b3f-4f0d-8bcf-733a49790d69 tempest-VolumesTransfersV357Test-646466744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (701cdf01-427a-4ff5-9e37-c246a021a93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee3cc2ee-77e2-4da7-9126-f2a6db533452', 'volume_name': 'volume-ee3cc2ee-77e2-4da7-9126-f2a6db533452', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:18 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-55b04bb2-6b3f-4f0d-8bcf-733a49790d69 tempest-VolumesTransfersV357Test-646466744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1367d99-f0a5-4985-b68e-7d6d8a8d62e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:18 devstack sudo[85276]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:18 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-55b04bb2-6b3f-4f0d-8bcf-733a49790d69 tempest-VolumesTransfersV357Test-646466744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1367d99-f0a5-4985-b68e-7d6d8a8d62e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:18 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-55b04bb2-6b3f-4f0d-8bcf-733a49790d69 tempest-VolumesTransfersV357Test-646466744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba80ccce-d1b5-4046-b67e-456edef05f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:18 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-55b04bb2-6b3f-4f0d-8bcf-733a49790d69 tempest-VolumesTransfersV357Test-646466744 None] Volume ee3cc2ee-77e2-4da7-9126-f2a6db533452: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee3cc2ee-77e2-4da7-9126-f2a6db533452', 'volume_size': 1}
Apr 15 20:07:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-55b04bb2-6b3f-4f0d-8bcf-733a49790d69 tempest-VolumesTransfersV357Test-646466744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:07:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-1ed1651e-0131-47ed-afa4-c02247b84b4d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8341f71a-cabe-4251-8fe6-fa688c7e6371" returned: 0 in 0.721s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:18 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-1ed1651e-0131-47ed-afa4-c02247b84b4d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] <== create_volume: return (1901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:07:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-1ed1651e-0131-47ed-afa4-c02247b84b4d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.905s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:07:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-55b04bb2-6b3f-4f0d-8bcf-733a49790d69 tempest-VolumesTransfersV357Test-646466744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:07:18 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-55b04bb2-6b3f-4f0d-8bcf-733a49790d69 tempest-VolumesTransfersV357Test-646466744 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:07:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-937751977',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee3cc2ee-77e2-4da7-9126-f2a6db533452,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ddb9a83c62246f7874bb7e709a3f28c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:07:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:07:19Z,use_quota=True,user_id='5d3dbb2878a542ba9d1d17720bdd654b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:07:18 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-55b04bb2-6b3f-4f0d-8bcf-733a49790d69 tempest-VolumesTransfersV357Test-646466744 None] Creating volume ee3cc2ee-77e2-4da7-9126-f2a6db533452 {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:07:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-55b04bb2-6b3f-4f0d-8bcf-733a49790d69 tempest-VolumesTransfersV357Test-646466744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:07:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-55b04bb2-6b3f-4f0d-8bcf-733a49790d69 tempest-VolumesTransfersV357Test-646466744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:07:18 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-55b04bb2-6b3f-4f0d-8bcf-733a49790d69 tempest-VolumesTransfersV357Test-646466744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:07:18 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-55b04bb2-6b3f-4f0d-8bcf-733a49790d69 tempest-VolumesTransfersV357Test-646466744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:07:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-55b04bb2-6b3f-4f0d-8bcf-733a49790d69 tempest-VolumesTransfersV357Test-646466744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:07:18 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-55b04bb2-6b3f-4f0d-8bcf-733a49790d69 tempest-VolumesTransfersV357Test-646466744 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:07:18 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-55b04bb2-6b3f-4f0d-8bcf-733a49790d69 tempest-VolumesTransfersV357Test-646466744 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:07:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-55b04bb2-6b3f-4f0d-8bcf-733a49790d69 tempest-VolumesTransfersV357Test-646466744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-ee3cc2ee-77e2-4da7-9126-f2a6db533452 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:19 devstack cinder-volume[82646]: DEBUG cinder.volume.volume_utils [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-1ed1651e-0131-47ed-afa4-c02247b84b4d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Attempting download of 565a23e3-dcfa-4a62-b361-219578b0cd92 ((None, [{'url': 'file:///opt/stack/data/glance/images/565a23e3-dcfa-4a62-b361-219578b0cd92', 'metadata': {}}])) to volume 8341f71a-cabe-4251-8fe6-fa688c7e6371. {{(pid=82646) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 15 20:07:19 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee4aafd-367a-480a-aaea-e29c2e58580a]: (4, 'raw') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:07:19 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-1ed1651e-0131-47ed-afa4-c02247b84b4d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_565a23e3-dcfa-4a62-b361-219578b0cd92_l9n9pv83 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:19 devstack sudo[85281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-ee3cc2ee-77e2-4da7-9126-f2a6db533452 1073741824
Apr 15 20:07:19 devstack sudo[85281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:19 devstack sudo[85282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_565a23e3-dcfa-4a62-b361-219578b0cd92_l9n9pv83
Apr 15 20:07:19 devstack sudo[85282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:19 devstack sudo[85281]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:19 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-55b04bb2-6b3f-4f0d-8bcf-733a49790d69 tempest-VolumesTransfersV357Test-646466744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-ee3cc2ee-77e2-4da7-9126-f2a6db533452 1073741824" returned: 0 in 0.705s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:19 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-55b04bb2-6b3f-4f0d-8bcf-733a49790d69 tempest-VolumesTransfersV357Test-646466744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-ee3cc2ee-77e2-4da7-9126-f2a6db533452 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:19 devstack sudo[85289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-ee3cc2ee-77e2-4da7-9126-f2a6db533452
Apr 15 20:07:19 devstack sudo[85289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:19 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb907507-7645-4efc-a624-81a3b74aaf0c tempest-GroupSnapshotsTest-234173950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:07:19 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-eb907507-7645-4efc-a624-81a3b74aaf0c tempest-GroupSnapshotsTest-234173950 None] Flow 'volume_create_manager' (414a8def-5bd2-4c65-8934-774aad89f9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:07:19 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-eb907507-7645-4efc-a624-81a3b74aaf0c tempest-GroupSnapshotsTest-234173950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7afa75ff-abcd-40c6-a982-f15e13057203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:20 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-eb907507-7645-4efc-a624-81a3b74aaf0c tempest-GroupSnapshotsTest-234173950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7afa75ff-abcd-40c6-a982-f15e13057203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2030985191',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=dee35a0b-a6a8-4053-8629-c4a7bb69d60b,host='devstack@QuobyteHD#QuobyteHD',id=e692e42f-4944-4216-bb3e-b65acec806da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98edbdfcd7444227b1af4887df1acf45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:07:20Z,use_quota=True,user_id='9250ca46a4b44ce3a19386920797e916',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e27db8d-c502-4a54-9d0f-c42caeaf70cd),volume_type_id=9e27db8d-c502-4a54-9d0f-c42caeaf70cd)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:20 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-eb907507-7645-4efc-a624-81a3b74aaf0c tempest-GroupSnapshotsTest-234173950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4e8a960-deb1-4538-9c6e-fabd2976792a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:20 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-eb907507-7645-4efc-a624-81a3b74aaf0c tempest-GroupSnapshotsTest-234173950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4e8a960-deb1-4538-9c6e-fabd2976792a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:20 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-eb907507-7645-4efc-a624-81a3b74aaf0c tempest-GroupSnapshotsTest-234173950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a934fe39-eccd-417d-859a-3426486d9a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:20 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-eb907507-7645-4efc-a624-81a3b74aaf0c tempest-GroupSnapshotsTest-234173950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a934fe39-eccd-417d-859a-3426486d9a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e692e42f-4944-4216-bb3e-b65acec806da', 'volume_name': 'volume-e692e42f-4944-4216-bb3e-b65acec806da', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:20 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-eb907507-7645-4efc-a624-81a3b74aaf0c tempest-GroupSnapshotsTest-234173950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98c142ea-5d3a-4f26-9836-985cba835fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:20 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-eb907507-7645-4efc-a624-81a3b74aaf0c tempest-GroupSnapshotsTest-234173950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98c142ea-5d3a-4f26-9836-985cba835fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:20 devstack sudo[85282]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:20 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-eb907507-7645-4efc-a624-81a3b74aaf0c tempest-GroupSnapshotsTest-234173950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e613df60-6c33-4435-ae1c-e2583441fa3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:20 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-eb907507-7645-4efc-a624-81a3b74aaf0c tempest-GroupSnapshotsTest-234173950 None] Volume e692e42f-4944-4216-bb3e-b65acec806da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e692e42f-4944-4216-bb3e-b65acec806da', 'volume_size': 1}
Apr 15 20:07:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-eb907507-7645-4efc-a624-81a3b74aaf0c tempest-GroupSnapshotsTest-234173950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:07:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-1ed1651e-0131-47ed-afa4-c02247b84b4d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_565a23e3-dcfa-4a62-b361-219578b0cd92_l9n9pv83" returned: 0 in 1.072s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-1ed1651e-0131-47ed-afa4-c02247b84b4d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_565a23e3-dcfa-4a62-b361-219578b0cd92_l9n9pv83 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:20 devstack sudo[85294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_565a23e3-dcfa-4a62-b361-219578b0cd92_l9n9pv83
Apr 15 20:07:20 devstack sudo[85294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:20 devstack sudo[85289]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-55b04bb2-6b3f-4f0d-8bcf-733a49790d69 tempest-VolumesTransfersV357Test-646466744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-ee3cc2ee-77e2-4da7-9126-f2a6db533452" returned: 0 in 0.628s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:20 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-55b04bb2-6b3f-4f0d-8bcf-733a49790d69 tempest-VolumesTransfersV357Test-646466744 None] <== create_volume: return (1363ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:07:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-55b04bb2-6b3f-4f0d-8bcf-733a49790d69 tempest-VolumesTransfersV357Test-646466744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.366s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:07:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-eb907507-7645-4efc-a624-81a3b74aaf0c tempest-GroupSnapshotsTest-234173950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.223s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:07:20 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-eb907507-7645-4efc-a624-81a3b74aaf0c tempest-GroupSnapshotsTest-234173950 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=dee35a0b-a6a8-4053-8629-c4a7bb69d60b,created_at=2026-04-15T18:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2030985191',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=dee35a0b-a6a8-4053-8629-c4a7bb69d60b,host='devstack@QuobyteHD#QuobyteHD',id=e692e42f-4944-4216-bb3e-b65acec806da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98edbdfcd7444227b1af4887df1acf45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:07:20Z,use_quota=True,user_id='9250ca46a4b44ce3a19386920797e916',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e27db8d-c502-4a54-9d0f-c42caeaf70cd),volume_type_id=9e27db8d-c502-4a54-9d0f-c42caeaf70cd)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:07:20 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-eb907507-7645-4efc-a624-81a3b74aaf0c tempest-GroupSnapshotsTest-234173950 None] Creating volume e692e42f-4944-4216-bb3e-b65acec806da {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:07:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-eb907507-7645-4efc-a624-81a3b74aaf0c tempest-GroupSnapshotsTest-234173950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:07:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-eb907507-7645-4efc-a624-81a3b74aaf0c tempest-GroupSnapshotsTest-234173950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:07:20 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-eb907507-7645-4efc-a624-81a3b74aaf0c tempest-GroupSnapshotsTest-234173950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:07:20 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-eb907507-7645-4efc-a624-81a3b74aaf0c tempest-GroupSnapshotsTest-234173950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:07:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-eb907507-7645-4efc-a624-81a3b74aaf0c tempest-GroupSnapshotsTest-234173950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:07:20 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-eb907507-7645-4efc-a624-81a3b74aaf0c tempest-GroupSnapshotsTest-234173950 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:07:20 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-eb907507-7645-4efc-a624-81a3b74aaf0c tempest-GroupSnapshotsTest-234173950 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:07:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-eb907507-7645-4efc-a624-81a3b74aaf0c tempest-GroupSnapshotsTest-234173950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e692e42f-4944-4216-bb3e-b65acec806da 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:20 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-55b04bb2-6b3f-4f0d-8bcf-733a49790d69 tempest-VolumesTransfersV357Test-646466744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba80ccce-d1b5-4046-b67e-456edef05f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee3cc2ee-77e2-4da7-9126-f2a6db533452', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:20 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-55b04bb2-6b3f-4f0d-8bcf-733a49790d69 tempest-VolumesTransfersV357Test-646466744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (042c5a48-1dec-4d83-bdaa-6146b8ea28d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:20 devstack sudo[85297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e692e42f-4944-4216-bb3e-b65acec806da 1073741824
Apr 15 20:07:20 devstack sudo[85297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:20 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-55b04bb2-6b3f-4f0d-8bcf-733a49790d69 tempest-VolumesTransfersV357Test-646466744 None] Volume volume-ee3cc2ee-77e2-4da7-9126-f2a6db533452 (ee3cc2ee-77e2-4da7-9126-f2a6db533452): created successfully
Apr 15 20:07:20 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-55b04bb2-6b3f-4f0d-8bcf-733a49790d69 tempest-VolumesTransfersV357Test-646466744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (042c5a48-1dec-4d83-bdaa-6146b8ea28d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:20 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-55b04bb2-6b3f-4f0d-8bcf-733a49790d69 tempest-VolumesTransfersV357Test-646466744 None] Flow 'volume_create_manager' (f4f8107a-9578-40e5-9c6b-97903fac8f8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:07:20 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-55b04bb2-6b3f-4f0d-8bcf-733a49790d69 tempest-VolumesTransfersV357Test-646466744 None] Created volume successfully.
Apr 15 20:07:20 devstack sudo[85294]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-1ed1651e-0131-47ed-afa4-c02247b84b4d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_565a23e3-dcfa-4a62-b361-219578b0cd92_l9n9pv83" returned: 1 in 0.685s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-1ed1651e-0131-47ed-afa4-c02247b84b4d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_565a23e3-dcfa-4a62-b361-219578b0cd92_l9n9pv83' failed. Not Retrying. {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 20:07:20 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae96bd6-7d57-44c4-8ec3-0780306260bc]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:07:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-1ed1651e-0131-47ed-afa4-c02247b84b4d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_565a23e3-dcfa-4a62-b361-219578b0cd92_xngk1f_6devstack@QuobyteHD {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:20 devstack sudo[85308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_565a23e3-dcfa-4a62-b361-219578b0cd92_xngk1f_6devstack@QuobyteHD
Apr 15 20:07:20 devstack sudo[85308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:21 devstack sudo[85297]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-eb907507-7645-4efc-a624-81a3b74aaf0c tempest-GroupSnapshotsTest-234173950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e692e42f-4944-4216-bb3e-b65acec806da 1073741824" returned: 0 in 0.871s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-eb907507-7645-4efc-a624-81a3b74aaf0c tempest-GroupSnapshotsTest-234173950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e692e42f-4944-4216-bb3e-b65acec806da {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:21 devstack sudo[85313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e692e42f-4944-4216-bb3e-b65acec806da
Apr 15 20:07:21 devstack sudo[85313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:21 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [req-8cefee83-31da-4dbd-b452-bb4f4fb0c3de req-a473fa5a-bcd0-401a-9fca-ce50e83df818 tempest-VolumesGetTestJSON-1175173800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:07:21 devstack sudo[85308]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:21 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [req-8cefee83-31da-4dbd-b452-bb4f4fb0c3de req-a473fa5a-bcd0-401a-9fca-ce50e83df818 tempest-VolumesGetTestJSON-1175173800 None] Flow 'volume_create_manager' (88b05f20-ebd5-4357-bf98-6a4d3031cdaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:07:21 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [req-8cefee83-31da-4dbd-b452-bb4f4fb0c3de req-a473fa5a-bcd0-401a-9fca-ce50e83df818 tempest-VolumesGetTestJSON-1175173800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80774e16-e0ea-4d89-acfd-2c813c1876a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-1ed1651e-0131-47ed-afa4-c02247b84b4d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_565a23e3-dcfa-4a62-b361-219578b0cd92_xngk1f_6devstack@QuobyteHD" returned: 0 in 0.987s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:21 devstack cinder-volume[82646]: DEBUG cinder.image.image_utils [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-1ed1651e-0131-47ed-afa4-c02247b84b4d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] 565a23e3-dcfa-4a62-b361-219578b0cd92 was qcow2, converting to raw {{(pid=82646) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 15 20:07:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-1ed1651e-0131-47ed-afa4-c02247b84b4d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_565a23e3-dcfa-4a62-b361-219578b0cd92_xngk1f_6devstack@QuobyteHD /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8341f71a-cabe-4251-8fe6-fa688c7e6371 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:21 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [req-8cefee83-31da-4dbd-b452-bb4f4fb0c3de req-a473fa5a-bcd0-401a-9fca-ce50e83df818 tempest-VolumesGetTestJSON-1175173800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80774e16-e0ea-4d89-acfd-2c813c1876a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:07:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1853734634',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1bfc4ac-3eda-4e81-9009-f20a5694e1de,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='85c8182c27c64a30a42fc37f36ad396c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:07:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:07:22Z,use_quota=True,user_id='0cfa8d2ea5db488a91ac1800f3a52c10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:21 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [req-8cefee83-31da-4dbd-b452-bb4f4fb0c3de req-a473fa5a-bcd0-401a-9fca-ce50e83df818 tempest-VolumesGetTestJSON-1175173800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc974672-56df-49e5-b09d-51f0caa4b4f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:21 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [req-8cefee83-31da-4dbd-b452-bb4f4fb0c3de req-a473fa5a-bcd0-401a-9fca-ce50e83df818 tempest-VolumesGetTestJSON-1175173800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc974672-56df-49e5-b09d-51f0caa4b4f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:21 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [req-8cefee83-31da-4dbd-b452-bb4f4fb0c3de req-a473fa5a-bcd0-401a-9fca-ce50e83df818 tempest-VolumesGetTestJSON-1175173800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d1ac1c9-dcea-4b55-9647-b621be5e4a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:21 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [req-8cefee83-31da-4dbd-b452-bb4f4fb0c3de req-a473fa5a-bcd0-401a-9fca-ce50e83df818 tempest-VolumesGetTestJSON-1175173800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d1ac1c9-dcea-4b55-9647-b621be5e4a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1bfc4ac-3eda-4e81-9009-f20a5694e1de', 'volume_name': 'volume-f1bfc4ac-3eda-4e81-9009-f20a5694e1de', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:21 devstack sudo[85318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_565a23e3-dcfa-4a62-b361-219578b0cd92_xngk1f_6devstack@QuobyteHD /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8341f71a-cabe-4251-8fe6-fa688c7e6371
Apr 15 20:07:21 devstack sudo[85318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:21 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [req-8cefee83-31da-4dbd-b452-bb4f4fb0c3de req-a473fa5a-bcd0-401a-9fca-ce50e83df818 tempest-VolumesGetTestJSON-1175173800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d366318-2f07-45b5-8a63-4e98dc68a5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:21 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [req-8cefee83-31da-4dbd-b452-bb4f4fb0c3de req-a473fa5a-bcd0-401a-9fca-ce50e83df818 tempest-VolumesGetTestJSON-1175173800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d366318-2f07-45b5-8a63-4e98dc68a5f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:21 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [req-8cefee83-31da-4dbd-b452-bb4f4fb0c3de req-a473fa5a-bcd0-401a-9fca-ce50e83df818 tempest-VolumesGetTestJSON-1175173800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1a7ff45-dbb8-4c26-bae9-a2b241587ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:21 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [req-8cefee83-31da-4dbd-b452-bb4f4fb0c3de req-a473fa5a-bcd0-401a-9fca-ce50e83df818 tempest-VolumesGetTestJSON-1175173800 None] Volume f1bfc4ac-3eda-4e81-9009-f20a5694e1de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1bfc4ac-3eda-4e81-9009-f20a5694e1de', 'volume_size': 1}
Apr 15 20:07:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [req-8cefee83-31da-4dbd-b452-bb4f4fb0c3de req-a473fa5a-bcd0-401a-9fca-ce50e83df818 tempest-VolumesGetTestJSON-1175173800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:07:21 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-baad889a-0b3f-44a6-b803-d8706d95a7f8 tempest-VolumesTransfersV357Test-514848740 None] Transfer volume completed successfully.
Apr 15 20:07:22 devstack sudo[85313]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-eb907507-7645-4efc-a624-81a3b74aaf0c tempest-GroupSnapshotsTest-234173950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e692e42f-4944-4216-bb3e-b65acec806da" returned: 0 in 0.887s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:22 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-eb907507-7645-4efc-a624-81a3b74aaf0c tempest-GroupSnapshotsTest-234173950 None] <== create_volume: return (1801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:07:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-eb907507-7645-4efc-a624-81a3b74aaf0c tempest-GroupSnapshotsTest-234173950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.806s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:07:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [req-8cefee83-31da-4dbd-b452-bb4f4fb0c3de req-a473fa5a-bcd0-401a-9fca-ce50e83df818 tempest-VolumesGetTestJSON-1175173800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.277s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:07:22 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [req-8cefee83-31da-4dbd-b452-bb4f4fb0c3de req-a473fa5a-bcd0-401a-9fca-ce50e83df818 tempest-VolumesGetTestJSON-1175173800 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:07:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1853734634',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1bfc4ac-3eda-4e81-9009-f20a5694e1de,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='85c8182c27c64a30a42fc37f36ad396c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:07:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:07:22Z,use_quota=True,user_id='0cfa8d2ea5db488a91ac1800f3a52c10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:07:22 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [req-8cefee83-31da-4dbd-b452-bb4f4fb0c3de req-a473fa5a-bcd0-401a-9fca-ce50e83df818 tempest-VolumesGetTestJSON-1175173800 None] Creating volume f1bfc4ac-3eda-4e81-9009-f20a5694e1de {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:07:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [req-8cefee83-31da-4dbd-b452-bb4f4fb0c3de req-a473fa5a-bcd0-401a-9fca-ce50e83df818 tempest-VolumesGetTestJSON-1175173800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:07:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [req-8cefee83-31da-4dbd-b452-bb4f4fb0c3de req-a473fa5a-bcd0-401a-9fca-ce50e83df818 tempest-VolumesGetTestJSON-1175173800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:07:22 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [req-8cefee83-31da-4dbd-b452-bb4f4fb0c3de req-a473fa5a-bcd0-401a-9fca-ce50e83df818 tempest-VolumesGetTestJSON-1175173800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:07:22 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [req-8cefee83-31da-4dbd-b452-bb4f4fb0c3de req-a473fa5a-bcd0-401a-9fca-ce50e83df818 tempest-VolumesGetTestJSON-1175173800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:07:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [req-8cefee83-31da-4dbd-b452-bb4f4fb0c3de req-a473fa5a-bcd0-401a-9fca-ce50e83df818 tempest-VolumesGetTestJSON-1175173800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:07:22 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [req-8cefee83-31da-4dbd-b452-bb4f4fb0c3de req-a473fa5a-bcd0-401a-9fca-ce50e83df818 tempest-VolumesGetTestJSON-1175173800 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:07:22 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [req-8cefee83-31da-4dbd-b452-bb4f4fb0c3de req-a473fa5a-bcd0-401a-9fca-ce50e83df818 tempest-VolumesGetTestJSON-1175173800 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:07:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-8cefee83-31da-4dbd-b452-bb4f4fb0c3de req-a473fa5a-bcd0-401a-9fca-ce50e83df818 tempest-VolumesGetTestJSON-1175173800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f1bfc4ac-3eda-4e81-9009-f20a5694e1de 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:22 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-eb907507-7645-4efc-a624-81a3b74aaf0c tempest-GroupSnapshotsTest-234173950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e613df60-6c33-4435-ae1c-e2583441fa3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e692e42f-4944-4216-bb3e-b65acec806da', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:22 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-eb907507-7645-4efc-a624-81a3b74aaf0c tempest-GroupSnapshotsTest-234173950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43a78be8-1e37-4f59-ba44-2ea8f544884e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:22 devstack sudo[85321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f1bfc4ac-3eda-4e81-9009-f20a5694e1de 1073741824
Apr 15 20:07:22 devstack sudo[85321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:22 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-eb907507-7645-4efc-a624-81a3b74aaf0c tempest-GroupSnapshotsTest-234173950 None] Volume volume-e692e42f-4944-4216-bb3e-b65acec806da (e692e42f-4944-4216-bb3e-b65acec806da): created successfully
Apr 15 20:07:22 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-eb907507-7645-4efc-a624-81a3b74aaf0c tempest-GroupSnapshotsTest-234173950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43a78be8-1e37-4f59-ba44-2ea8f544884e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:22 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-eb907507-7645-4efc-a624-81a3b74aaf0c tempest-GroupSnapshotsTest-234173950 None] Flow 'volume_create_manager' (414a8def-5bd2-4c65-8934-774aad89f9e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:07:22 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-eb907507-7645-4efc-a624-81a3b74aaf0c tempest-GroupSnapshotsTest-234173950 None] Created volume successfully.
Apr 15 20:07:22 devstack sudo[85321]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-8cefee83-31da-4dbd-b452-bb4f4fb0c3de req-a473fa5a-bcd0-401a-9fca-ce50e83df818 tempest-VolumesGetTestJSON-1175173800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f1bfc4ac-3eda-4e81-9009-f20a5694e1de 1073741824" returned: 0 in 0.795s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-8cefee83-31da-4dbd-b452-bb4f4fb0c3de req-a473fa5a-bcd0-401a-9fca-ce50e83df818 tempest-VolumesGetTestJSON-1175173800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f1bfc4ac-3eda-4e81-9009-f20a5694e1de {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:23 devstack sudo[85341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f1bfc4ac-3eda-4e81-9009-f20a5694e1de
Apr 15 20:07:23 devstack sudo[85341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:23 devstack sudo[85318]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:23 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-1ed1651e-0131-47ed-afa4-c02247b84b4d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_565a23e3-dcfa-4a62-b361-219578b0cd92_xngk1f_6devstack@QuobyteHD /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8341f71a-cabe-4251-8fe6-fa688c7e6371" returned: 0 in 1.266s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:23 devstack cinder-volume[82646]: DEBUG cinder.image.image_utils [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-1ed1651e-0131-47ed-afa4-c02247b84b4d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_565a23e3-dcfa-4a62-b361-219578b0cd92_xngk1f_6devstack@QuobyteHD, size 112.00 MB, duration 1.27 sec, destination /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8341f71a-cabe-4251-8fe6-fa688c7e6371 {{(pid=82646) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 20:07:23 devstack cinder-volume[82646]: INFO cinder.image.image_utils [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-1ed1651e-0131-47ed-afa4-c02247b84b4d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Converted 112.00 MB image at 88.23 MB/s
Apr 15 20:07:23 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-1ed1651e-0131-47ed-afa4-c02247b84b4d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8341f71a-cabe-4251-8fe6-fa688c7e6371 1G {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:23 devstack sudo[85343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8341f71a-cabe-4251-8fe6-fa688c7e6371 1G
Apr 15 20:07:23 devstack sudo[85343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:23 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-14a290d9-0a0a-46fa-8257-39ea0077fa26 tempest-VolumesTransfersV357Test-1421080196 None] Acquiring lock "cinder-ee3cc2ee-77e2-4da7-9126-f2a6db533452-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:07:23 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-14a290d9-0a0a-46fa-8257-39ea0077fa26 tempest-VolumesTransfersV357Test-1421080196 None] Lock "cinder-ee3cc2ee-77e2-4da7-9126-f2a6db533452-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:07:23 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-14a290d9-0a0a-46fa-8257-39ea0077fa26 tempest-VolumesTransfersV357Test-1421080196 None] Acquiring lock "cinder-quobyte-ee3cc2ee-77e2-4da7-9126-f2a6db533452" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:07:23 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-14a290d9-0a0a-46fa-8257-39ea0077fa26 tempest-VolumesTransfersV357Test-1421080196 None] Lock "cinder-quobyte-ee3cc2ee-77e2-4da7-9126-f2a6db533452" acquired by "delete_volume" :: waited 0.015s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:07:23 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c36ded-ca91-42a9-8e20-f044f7db3bd1]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:07:23 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-14a290d9-0a0a-46fa-8257-39ea0077fa26 tempest-VolumesTransfersV357Test-1421080196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-ee3cc2ee-77e2-4da7-9126-f2a6db533452 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:23 devstack sudo[85345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-ee3cc2ee-77e2-4da7-9126-f2a6db533452
Apr 15 20:07:23 devstack sudo[85345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:23 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-0b92d090-185e-4211-95e4-304c0a532df3 tempest-GroupSnapshotsTest-234173950 None] GroupSnapshot 6c5156d3-760a-44cb-97cd-5ca2b752fa1c: creating.
Apr 15 20:07:23 devstack sudo[85341]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:23 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-8cefee83-31da-4dbd-b452-bb4f4fb0c3de req-a473fa5a-bcd0-401a-9fca-ce50e83df818 tempest-VolumesGetTestJSON-1175173800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f1bfc4ac-3eda-4e81-9009-f20a5694e1de" returned: 0 in 0.863s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:23 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [req-8cefee83-31da-4dbd-b452-bb4f4fb0c3de req-a473fa5a-bcd0-401a-9fca-ce50e83df818 tempest-VolumesGetTestJSON-1175173800 None] <== create_volume: return (1703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:07:23 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [req-8cefee83-31da-4dbd-b452-bb4f4fb0c3de req-a473fa5a-bcd0-401a-9fca-ce50e83df818 tempest-VolumesGetTestJSON-1175173800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.708s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:07:23 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [req-8cefee83-31da-4dbd-b452-bb4f4fb0c3de req-a473fa5a-bcd0-401a-9fca-ce50e83df818 tempest-VolumesGetTestJSON-1175173800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1a7ff45-dbb8-4c26-bae9-a2b241587ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1bfc4ac-3eda-4e81-9009-f20a5694e1de', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:23 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [req-8cefee83-31da-4dbd-b452-bb4f4fb0c3de req-a473fa5a-bcd0-401a-9fca-ce50e83df818 tempest-VolumesGetTestJSON-1175173800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5797f51b-e724-49bc-a068-ece36a59e8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:23 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-0b92d090-185e-4211-95e4-304c0a532df3 tempest-GroupSnapshotsTest-234173950 None] Group snapshot 6c5156d3-760a-44cb-97cd-5ca2b752fa1c: creating. {{(pid=82646) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 15 20:07:23 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-0b92d090-185e-4211-95e4-304c0a532df3 tempest-GroupSnapshotsTest-234173950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:07:23 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-0b92d090-185e-4211-95e4-304c0a532df3 tempest-GroupSnapshotsTest-234173950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:07:23 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [req-8cefee83-31da-4dbd-b452-bb4f4fb0c3de req-a473fa5a-bcd0-401a-9fca-ce50e83df818 tempest-VolumesGetTestJSON-1175173800 None] Volume volume-f1bfc4ac-3eda-4e81-9009-f20a5694e1de (f1bfc4ac-3eda-4e81-9009-f20a5694e1de): created successfully
Apr 15 20:07:23 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [req-8cefee83-31da-4dbd-b452-bb4f4fb0c3de req-a473fa5a-bcd0-401a-9fca-ce50e83df818 tempest-VolumesGetTestJSON-1175173800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5797f51b-e724-49bc-a068-ece36a59e8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:23 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [req-8cefee83-31da-4dbd-b452-bb4f4fb0c3de req-a473fa5a-bcd0-401a-9fca-ce50e83df818 tempest-VolumesGetTestJSON-1175173800 None] Flow 'volume_create_manager' (88b05f20-ebd5-4357-bf98-6a4d3031cdaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:07:23 devstack cinder-volume[82646]: INFO cinder.volume.manager [req-8cefee83-31da-4dbd-b452-bb4f4fb0c3de req-a473fa5a-bcd0-401a-9fca-ce50e83df818 tempest-VolumesGetTestJSON-1175173800 None] Created volume successfully.
Apr 15 20:07:23 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-0b92d090-185e-4211-95e4-304c0a532df3 tempest-GroupSnapshotsTest-234173950 None] Creating offline snapshot b81db88b-1581-4603-9853-77df3e02f388 of volume e692e42f-4944-4216-bb3e-b65acec806da {{(pid=82646) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 20:07:23 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[7872a363-9b3f-46fd-9fd3-ecf39efd735c]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:07:23 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-0b92d090-185e-4211-95e4-304c0a532df3 tempest-GroupSnapshotsTest-234173950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e692e42f-4944-4216-bb3e-b65acec806da {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:23 devstack sudo[85345]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:23 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-14a290d9-0a0a-46fa-8257-39ea0077fa26 tempest-VolumesTransfersV357Test-1421080196 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-ee3cc2ee-77e2-4da7-9126-f2a6db533452" returned: 0 in 0.733s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:23 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-14a290d9-0a0a-46fa-8257-39ea0077fa26 tempest-VolumesTransfersV357Test-1421080196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-ee3cc2ee-77e2-4da7-9126-f2a6db533452 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:24 devstack sudo[85343]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-1ed1651e-0131-47ed-afa4-c02247b84b4d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8341f71a-cabe-4251-8fe6-fa688c7e6371 1G" returned: 0 in 0.951s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:24 devstack sudo[85355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-ee3cc2ee-77e2-4da7-9126-f2a6db533452
Apr 15 20:07:24 devstack sudo[85355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:24 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5fefa5-cc26-4dff-81df-fcbd81c2778e]: (4, 'raw') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:07:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-1ed1651e-0131-47ed-afa4-c02247b84b4d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8341f71a-cabe-4251-8fe6-fa688c7e6371 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:24 devstack sudo[85354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e692e42f-4944-4216-bb3e-b65acec806da
Apr 15 20:07:24 devstack sudo[85354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:24 devstack sudo[85358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8341f71a-cabe-4251-8fe6-fa688c7e6371
Apr 15 20:07:24 devstack sudo[85358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:24 devstack sudo[85354]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-0b92d090-185e-4211-95e4-304c0a532df3 tempest-GroupSnapshotsTest-234173950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e692e42f-4944-4216-bb3e-b65acec806da" returned: 0 in 0.587s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-0b92d090-185e-4211-95e4-304c0a532df3 tempest-GroupSnapshotsTest-234173950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e692e42f-4944-4216-bb3e-b65acec806da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e692e42f-4944-4216-bb3e-b65acec806da.b81db88b-1581-4603-9853-77df3e02f388 1G {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:24 devstack sudo[85364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e692e42f-4944-4216-bb3e-b65acec806da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e692e42f-4944-4216-bb3e-b65acec806da.b81db88b-1581-4603-9853-77df3e02f388 1G
Apr 15 20:07:24 devstack sudo[85364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:24 devstack sudo[85355]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-14a290d9-0a0a-46fa-8257-39ea0077fa26 tempest-VolumesTransfersV357Test-1421080196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-ee3cc2ee-77e2-4da7-9126-f2a6db533452" returned: 0 in 0.741s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:24 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-14a290d9-0a0a-46fa-8257-39ea0077fa26 tempest-VolumesTransfersV357Test-1421080196 None] Lock "cinder-quobyte-ee3cc2ee-77e2-4da7-9126-f2a6db533452" released by "delete_volume" :: held 1.503s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:07:24 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-14a290d9-0a0a-46fa-8257-39ea0077fa26 tempest-VolumesTransfersV357Test-1421080196 None] Created reservations ['abdca02a-e812-4807-b116-5695bebc83a5', '03d58baf-cf45-493f-a3a4-656ff163df4d', '51b561ac-b99a-4d11-82fb-879598d0970d', '8923e903-3ce0-45f0-95c9-7215825d6c04'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:07:24 devstack sudo[85358]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-1ed1651e-0131-47ed-afa4-c02247b84b4d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8341f71a-cabe-4251-8fe6-fa688c7e6371" returned: 0 in 0.796s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-1ed1651e-0131-47ed-afa4-c02247b84b4d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8341f71a-cabe-4251-8fe6-fa688c7e6371 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-14a290d9-0a0a-46fa-8257-39ea0077fa26 tempest-VolumesTransfersV357Test-1421080196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:07:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-14a290d9-0a0a-46fa-8257-39ea0077fa26 tempest-VolumesTransfersV357Test-1421080196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:07:24 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-14a290d9-0a0a-46fa-8257-39ea0077fa26 tempest-VolumesTransfersV357Test-1421080196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:07:24 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-14a290d9-0a0a-46fa-8257-39ea0077fa26 tempest-VolumesTransfersV357Test-1421080196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:07:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-14a290d9-0a0a-46fa-8257-39ea0077fa26 tempest-VolumesTransfersV357Test-1421080196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:07:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-14a290d9-0a0a-46fa-8257-39ea0077fa26 tempest-VolumesTransfersV357Test-1421080196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:24 devstack sudo[85369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:07:24 devstack sudo[85369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:24 devstack sudo[85368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8341f71a-cabe-4251-8fe6-fa688c7e6371
Apr 15 20:07:24 devstack sudo[85368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:25 devstack sudo[85364]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:25 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-0b92d090-185e-4211-95e4-304c0a532df3 tempest-GroupSnapshotsTest-234173950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e692e42f-4944-4216-bb3e-b65acec806da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e692e42f-4944-4216-bb3e-b65acec806da.b81db88b-1581-4603-9853-77df3e02f388 1G" returned: 0 in 0.760s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:25 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-0b92d090-185e-4211-95e4-304c0a532df3 tempest-GroupSnapshotsTest-234173950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e692e42f-4944-4216-bb3e-b65acec806da -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e692e42f-4944-4216-bb3e-b65acec806da.b81db88b-1581-4603-9853-77df3e02f388 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:25 devstack cinder-volume[82646]: DEBUG cinder.coordination [req-936d8943-1f9a-471f-ac7c-1466d27ff44f req-470d4c74-36a9-462e-9d49-7130b21c4136 tempest-VolumesGetTestJSON-1175173800 None] Acquiring lock "cinder-f1bfc4ac-3eda-4e81-9009-f20a5694e1de-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:07:25 devstack sudo[85375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e692e42f-4944-4216-bb3e-b65acec806da -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e692e42f-4944-4216-bb3e-b65acec806da.b81db88b-1581-4603-9853-77df3e02f388
Apr 15 20:07:25 devstack sudo[85375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:25 devstack cinder-volume[82646]: DEBUG cinder.coordination [req-936d8943-1f9a-471f-ac7c-1466d27ff44f req-470d4c74-36a9-462e-9d49-7130b21c4136 tempest-VolumesGetTestJSON-1175173800 None] Lock "cinder-f1bfc4ac-3eda-4e81-9009-f20a5694e1de-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:07:25 devstack cinder-volume[82646]: DEBUG cinder.coordination [req-936d8943-1f9a-471f-ac7c-1466d27ff44f req-470d4c74-36a9-462e-9d49-7130b21c4136 tempest-VolumesGetTestJSON-1175173800 None] Acquiring lock "cinder-quobyte-f1bfc4ac-3eda-4e81-9009-f20a5694e1de" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:07:25 devstack cinder-volume[82646]: DEBUG cinder.coordination [req-936d8943-1f9a-471f-ac7c-1466d27ff44f req-470d4c74-36a9-462e-9d49-7130b21c4136 tempest-VolumesGetTestJSON-1175173800 None] Lock "cinder-quobyte-f1bfc4ac-3eda-4e81-9009-f20a5694e1de" acquired by "delete_volume" :: waited 0.012s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:07:25 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5d216d-7dc2-4386-ba0b-c1e3906506bc]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:07:25 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-936d8943-1f9a-471f-ac7c-1466d27ff44f req-470d4c74-36a9-462e-9d49-7130b21c4136 tempest-VolumesGetTestJSON-1175173800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f1bfc4ac-3eda-4e81-9009-f20a5694e1de {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:25 devstack sudo[85379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f1bfc4ac-3eda-4e81-9009-f20a5694e1de
Apr 15 20:07:25 devstack sudo[85379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:25 devstack sudo[85369]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:25 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-14a290d9-0a0a-46fa-8257-39ea0077fa26 tempest-VolumesTransfersV357Test-1421080196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.694s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:25 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-14a290d9-0a0a-46fa-8257-39ea0077fa26 tempest-VolumesTransfersV357Test-1421080196 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:07:25 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-14a290d9-0a0a-46fa-8257-39ea0077fa26 tempest-VolumesTransfersV357Test-1421080196 None] Deleted volume successfully.
Apr 15 20:07:25 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-14a290d9-0a0a-46fa-8257-39ea0077fa26 tempest-VolumesTransfersV357Test-1421080196 None] Lock "cinder-ee3cc2ee-77e2-4da7-9126-f2a6db533452-delete_volume" released by "delete_volume" :: held 2.420s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:07:25 devstack sudo[85368]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:25 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-1ed1651e-0131-47ed-afa4-c02247b84b4d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8341f71a-cabe-4251-8fe6-fa688c7e6371" returned: 1 in 0.776s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:25 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-1ed1651e-0131-47ed-afa4-c02247b84b4d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8341f71a-cabe-4251-8fe6-fa688c7e6371' failed. Not Retrying. {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 20:07:25 devstack cinder-volume[82646]: DEBUG cinder.volume.volume_utils [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-1ed1651e-0131-47ed-afa4-c02247b84b4d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Downloaded image 565a23e3-dcfa-4a62-b361-219578b0cd92 ((None, [{'url': 'file:///opt/stack/data/glance/images/565a23e3-dcfa-4a62-b361-219578b0cd92', 'metadata': {}}])) to volume 8341f71a-cabe-4251-8fe6-fa688c7e6371 successfully. {{(pid=82646) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 15 20:07:25 devstack cinder-volume[82646]: DEBUG cinder.image.image_utils [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-1ed1651e-0131-47ed-afa4-c02247b84b4d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Temporary image 565a23e3-dcfa-4a62-b361-219578b0cd92 for user 261582d0c7e14b41bb27d528cdd754db is deleted. {{(pid=82646) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 15 20:07:25 devstack cinder-volume[82646]: DEBUG cinder.volume.volume_utils [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-1ed1651e-0131-47ed-afa4-c02247b84b4d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Marking volume 8341f71a-cabe-4251-8fe6-fa688c7e6371 as bootable. {{(pid=82646) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 15 20:07:25 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-1ed1651e-0131-47ed-afa4-c02247b84b4d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Copying metadata from image 565a23e3-dcfa-4a62-b361-219578b0cd92 to 8341f71a-cabe-4251-8fe6-fa688c7e6371. {{(pid=82646) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 15 20:07:25 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-1ed1651e-0131-47ed-afa4-c02247b84b4d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Creating volume glance metadata for volume 8341f71a-cabe-4251-8fe6-fa688c7e6371 backed by image 565a23e3-dcfa-4a62-b361-219578b0cd92 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '565a23e3-dcfa-4a62-b361-219578b0cd92', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82646) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 15 20:07:25 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-1ed1651e-0131-47ed-afa4-c02247b84b4d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc38b47c-618f-4962-9aba-89d64e4cfe7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8341f71a-cabe-4251-8fe6-fa688c7e6371', 'volume_size': 1, 'image_id': '565a23e3-dcfa-4a62-b361-219578b0cd92', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/565a23e3-dcfa-4a62-b361-219578b0cd92', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '27d9c820db6c4abea4324fe8ea0f90e6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '565a23e3-dcfa-4a62-b361-219578b0cd92', 'created_at': datetime.datetime(2026, 4, 15, 18, 0, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 18, 0, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/565a23e3-dcfa-4a62-b361-219578b0cd92/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe16767e620>}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:25 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-1ed1651e-0131-47ed-afa4-c02247b84b4d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6373398e-89e1-4530-ac7f-f3dbed7cd723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:25 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-1ed1651e-0131-47ed-afa4-c02247b84b4d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Volume volume-8341f71a-cabe-4251-8fe6-fa688c7e6371 (8341f71a-cabe-4251-8fe6-fa688c7e6371): created successfully
Apr 15 20:07:25 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-1ed1651e-0131-47ed-afa4-c02247b84b4d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6373398e-89e1-4530-ac7f-f3dbed7cd723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:25 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-1ed1651e-0131-47ed-afa4-c02247b84b4d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Flow 'volume_create_manager' (9e6d369c-b85c-4e84-af7a-23030e2c8b0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:07:25 devstack cinder-volume[82646]: INFO cinder.volume.manager [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-1ed1651e-0131-47ed-afa4-c02247b84b4d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Created volume successfully.
Apr 15 20:07:26 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dcef9ef-9a0f-432d-9c02-e503facc9a9f tempest-VolumesTransfersV357Test-646466744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:07:26 devstack sudo[85379]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:26 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-3dcef9ef-9a0f-432d-9c02-e503facc9a9f tempest-VolumesTransfersV357Test-646466744 None] Flow 'volume_create_manager' (1742a6f1-1d3a-497d-a62f-8494d8e3ada3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:07:26 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-3dcef9ef-9a0f-432d-9c02-e503facc9a9f tempest-VolumesTransfersV357Test-646466744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb8a0672-f5ac-4ff5-bffc-48e6b60a6524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:26 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-3dcef9ef-9a0f-432d-9c02-e503facc9a9f tempest-VolumesTransfersV357Test-646466744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb8a0672-f5ac-4ff5-bffc-48e6b60a6524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:07:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1172462958',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9de3960c-2a48-422f-9bb0-2c21119a928b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ddb9a83c62246f7874bb7e709a3f28c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:07:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:07:26Z,use_quota=True,user_id='5d3dbb2878a542ba9d1d17720bdd654b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:26 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-3dcef9ef-9a0f-432d-9c02-e503facc9a9f tempest-VolumesTransfersV357Test-646466744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa17ff53-e019-43ec-8250-8916b764b392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:26 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-3dcef9ef-9a0f-432d-9c02-e503facc9a9f tempest-VolumesTransfersV357Test-646466744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa17ff53-e019-43ec-8250-8916b764b392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:26 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-3dcef9ef-9a0f-432d-9c02-e503facc9a9f tempest-VolumesTransfersV357Test-646466744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26d64f47-ac75-4f1b-bcbe-d1f04d0265cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:26 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-3dcef9ef-9a0f-432d-9c02-e503facc9a9f tempest-VolumesTransfersV357Test-646466744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26d64f47-ac75-4f1b-bcbe-d1f04d0265cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9de3960c-2a48-422f-9bb0-2c21119a928b', 'volume_name': 'volume-9de3960c-2a48-422f-9bb0-2c21119a928b', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:26 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-3dcef9ef-9a0f-432d-9c02-e503facc9a9f tempest-VolumesTransfersV357Test-646466744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdd57c5e-49e5-409c-8cc3-f6cc7f018474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:26 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-3dcef9ef-9a0f-432d-9c02-e503facc9a9f tempest-VolumesTransfersV357Test-646466744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdd57c5e-49e5-409c-8cc3-f6cc7f018474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:26 devstack sudo[85375]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:26 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-3dcef9ef-9a0f-432d-9c02-e503facc9a9f tempest-VolumesTransfersV357Test-646466744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13134030-df52-4945-b1e0-06f53adbd403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:26 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-3dcef9ef-9a0f-432d-9c02-e503facc9a9f tempest-VolumesTransfersV357Test-646466744 None] Volume 9de3960c-2a48-422f-9bb0-2c21119a928b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9de3960c-2a48-422f-9bb0-2c21119a928b', 'volume_size': 1}
Apr 15 20:07:26 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-3dcef9ef-9a0f-432d-9c02-e503facc9a9f tempest-VolumesTransfersV357Test-646466744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:07:26 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-936d8943-1f9a-471f-ac7c-1466d27ff44f req-470d4c74-36a9-462e-9d49-7130b21c4136 tempest-VolumesGetTestJSON-1175173800 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f1bfc4ac-3eda-4e81-9009-f20a5694e1de" returned: 0 in 0.754s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:26 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-936d8943-1f9a-471f-ac7c-1466d27ff44f req-470d4c74-36a9-462e-9d49-7130b21c4136 tempest-VolumesGetTestJSON-1175173800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f1bfc4ac-3eda-4e81-9009-f20a5694e1de {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:26 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-0b92d090-185e-4211-95e4-304c0a532df3 tempest-GroupSnapshotsTest-234173950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e692e42f-4944-4216-bb3e-b65acec806da -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e692e42f-4944-4216-bb3e-b65acec806da.b81db88b-1581-4603-9853-77df3e02f388" returned: 0 in 0.923s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:26 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-0b92d090-185e-4211-95e4-304c0a532df3 tempest-GroupSnapshotsTest-234173950 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e692e42f-4944-4216-bb3e-b65acec806da.b81db88b-1581-4603-9853-77df3e02f388 is being set with open permissions: ugo+rw: NotImplementedError
Apr 15 20:07:26 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-0b92d090-185e-4211-95e4-304c0a532df3 tempest-GroupSnapshotsTest-234173950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e692e42f-4944-4216-bb3e-b65acec806da.b81db88b-1581-4603-9853-77df3e02f388 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:26 devstack sudo[85390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f1bfc4ac-3eda-4e81-9009-f20a5694e1de
Apr 15 20:07:26 devstack sudo[85390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:26 devstack sudo[85391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e692e42f-4944-4216-bb3e-b65acec806da.b81db88b-1581-4603-9853-77df3e02f388
Apr 15 20:07:26 devstack sudo[85391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:26 devstack sudo[85391]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:26 devstack sudo[85390]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:26 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-0b92d090-185e-4211-95e4-304c0a532df3 tempest-GroupSnapshotsTest-234173950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e692e42f-4944-4216-bb3e-b65acec806da.b81db88b-1581-4603-9853-77df3e02f388" returned: 0 in 0.456s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:26 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-936d8943-1f9a-471f-ac7c-1466d27ff44f req-470d4c74-36a9-462e-9d49-7130b21c4136 tempest-VolumesGetTestJSON-1175173800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f1bfc4ac-3eda-4e81-9009-f20a5694e1de" returned: 0 in 0.483s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:26 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-0b92d090-185e-4211-95e4-304c0a532df3 tempest-GroupSnapshotsTest-234173950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e692e42f-4944-4216-bb3e-b65acec806da.info {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:26 devstack cinder-volume[82646]: DEBUG cinder.coordination [req-936d8943-1f9a-471f-ac7c-1466d27ff44f req-470d4c74-36a9-462e-9d49-7130b21c4136 tempest-VolumesGetTestJSON-1175173800 None] Lock "cinder-quobyte-f1bfc4ac-3eda-4e81-9009-f20a5694e1de" released by "delete_volume" :: held 1.293s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:07:26 devstack sudo[85396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e692e42f-4944-4216-bb3e-b65acec806da.info
Apr 15 20:07:26 devstack sudo[85396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:26 devstack cinder-volume[82646]: DEBUG cinder.quota [req-936d8943-1f9a-471f-ac7c-1466d27ff44f req-470d4c74-36a9-462e-9d49-7130b21c4136 tempest-VolumesGetTestJSON-1175173800 None] Created reservations ['216bb127-05a3-4561-9750-adb2eb98f8e7', 'd6116032-9fca-4b10-a6c8-a9a6268c7e8a', 'c819094c-fb17-4571-aa5d-e3801a776749', 'c4297999-5c12-4f67-8446-1edea666ef6f'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:07:26 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [req-936d8943-1f9a-471f-ac7c-1466d27ff44f req-470d4c74-36a9-462e-9d49-7130b21c4136 tempest-VolumesGetTestJSON-1175173800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:07:26 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [req-936d8943-1f9a-471f-ac7c-1466d27ff44f req-470d4c74-36a9-462e-9d49-7130b21c4136 tempest-VolumesGetTestJSON-1175173800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:07:26 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [req-936d8943-1f9a-471f-ac7c-1466d27ff44f req-470d4c74-36a9-462e-9d49-7130b21c4136 tempest-VolumesGetTestJSON-1175173800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:07:26 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [req-936d8943-1f9a-471f-ac7c-1466d27ff44f req-470d4c74-36a9-462e-9d49-7130b21c4136 tempest-VolumesGetTestJSON-1175173800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:07:26 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [req-936d8943-1f9a-471f-ac7c-1466d27ff44f req-470d4c74-36a9-462e-9d49-7130b21c4136 tempest-VolumesGetTestJSON-1175173800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:07:26 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-936d8943-1f9a-471f-ac7c-1466d27ff44f req-470d4c74-36a9-462e-9d49-7130b21c4136 tempest-VolumesGetTestJSON-1175173800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:26 devstack sudo[85398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:07:26 devstack sudo[85398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:27 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-4e49a54d-1d35-4d9d-82cf-5c12e5d4f01e tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:07:27 devstack sudo[85396]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:27 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-0b92d090-185e-4211-95e4-304c0a532df3 tempest-GroupSnapshotsTest-234173950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e692e42f-4944-4216-bb3e-b65acec806da.info" returned: 0 in 0.515s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:27 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-0b92d090-185e-4211-95e4-304c0a532df3 tempest-GroupSnapshotsTest-234173950 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e692e42f-4944-4216-bb3e-b65acec806da.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 15 20:07:27 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-0b92d090-185e-4211-95e4-304c0a532df3 tempest-GroupSnapshotsTest-234173950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e692e42f-4944-4216-bb3e-b65acec806da.info {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:27 devstack sudo[85409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e692e42f-4944-4216-bb3e-b65acec806da.info
Apr 15 20:07:27 devstack sudo[85409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:27 devstack sudo[85398]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:27 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-936d8943-1f9a-471f-ac7c-1466d27ff44f req-470d4c74-36a9-462e-9d49-7130b21c4136 tempest-VolumesGetTestJSON-1175173800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.536s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:27 devstack cinder-volume[82646]: DEBUG cinder.manager [req-936d8943-1f9a-471f-ac7c-1466d27ff44f req-470d4c74-36a9-462e-9d49-7130b21c4136 tempest-VolumesGetTestJSON-1175173800 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:07:27 devstack cinder-volume[82646]: INFO cinder.volume.manager [req-936d8943-1f9a-471f-ac7c-1466d27ff44f req-470d4c74-36a9-462e-9d49-7130b21c4136 tempest-VolumesGetTestJSON-1175173800 None] Deleted volume successfully.
Apr 15 20:07:27 devstack cinder-volume[82646]: DEBUG cinder.coordination [req-936d8943-1f9a-471f-ac7c-1466d27ff44f req-470d4c74-36a9-462e-9d49-7130b21c4136 tempest-VolumesGetTestJSON-1175173800 None] Lock "cinder-f1bfc4ac-3eda-4e81-9009-f20a5694e1de-delete_volume" released by "delete_volume" :: held 2.030s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:07:27 devstack sudo[85409]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:27 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-0b92d090-185e-4211-95e4-304c0a532df3 tempest-GroupSnapshotsTest-234173950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e692e42f-4944-4216-bb3e-b65acec806da.info" returned: 0 in 0.491s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:27 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-0b92d090-185e-4211-95e4-304c0a532df3 tempest-GroupSnapshotsTest-234173950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.835s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:07:27 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-3dcef9ef-9a0f-432d-9c02-e503facc9a9f tempest-VolumesTransfersV357Test-646466744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.529s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:07:27 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-3dcef9ef-9a0f-432d-9c02-e503facc9a9f tempest-VolumesTransfersV357Test-646466744 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:07:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1172462958',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9de3960c-2a48-422f-9bb0-2c21119a928b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ddb9a83c62246f7874bb7e709a3f28c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:07:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:07:26Z,use_quota=True,user_id='5d3dbb2878a542ba9d1d17720bdd654b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:07:27 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-3dcef9ef-9a0f-432d-9c02-e503facc9a9f tempest-VolumesTransfersV357Test-646466744 None] Creating volume 9de3960c-2a48-422f-9bb0-2c21119a928b {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:07:27 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-3dcef9ef-9a0f-432d-9c02-e503facc9a9f tempest-VolumesTransfersV357Test-646466744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:07:27 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-3dcef9ef-9a0f-432d-9c02-e503facc9a9f tempest-VolumesTransfersV357Test-646466744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:07:27 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-3dcef9ef-9a0f-432d-9c02-e503facc9a9f tempest-VolumesTransfersV357Test-646466744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:07:27 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-3dcef9ef-9a0f-432d-9c02-e503facc9a9f tempest-VolumesTransfersV357Test-646466744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:07:27 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-3dcef9ef-9a0f-432d-9c02-e503facc9a9f tempest-VolumesTransfersV357Test-646466744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:07:27 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-3dcef9ef-9a0f-432d-9c02-e503facc9a9f tempest-VolumesTransfersV357Test-646466744 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:07:27 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-3dcef9ef-9a0f-432d-9c02-e503facc9a9f tempest-VolumesTransfersV357Test-646466744 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:07:27 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-3dcef9ef-9a0f-432d-9c02-e503facc9a9f tempest-VolumesTransfersV357Test-646466744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9de3960c-2a48-422f-9bb0-2c21119a928b 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:27 devstack sudo[85413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9de3960c-2a48-422f-9bb0-2c21119a928b 1073741824
Apr 15 20:07:27 devstack sudo[85413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:27 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-0b92d090-185e-4211-95e4-304c0a532df3 tempest-GroupSnapshotsTest-234173950 None] group_snapshot 6c5156d3-760a-44cb-97cd-5ca2b752fa1c: created successfully
Apr 15 20:07:28 devstack sudo[85413]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:28 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-3dcef9ef-9a0f-432d-9c02-e503facc9a9f tempest-VolumesTransfersV357Test-646466744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9de3960c-2a48-422f-9bb0-2c21119a928b 1073741824" returned: 0 in 0.744s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:28 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-3dcef9ef-9a0f-432d-9c02-e503facc9a9f tempest-VolumesTransfersV357Test-646466744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9de3960c-2a48-422f-9bb0-2c21119a928b {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:28 devstack sudo[85418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9de3960c-2a48-422f-9bb0-2c21119a928b
Apr 15 20:07:28 devstack sudo[85418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:29 devstack sudo[85418]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-3dcef9ef-9a0f-432d-9c02-e503facc9a9f tempest-VolumesTransfersV357Test-646466744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9de3960c-2a48-422f-9bb0-2c21119a928b" returned: 0 in 0.682s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:29 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-3dcef9ef-9a0f-432d-9c02-e503facc9a9f tempest-VolumesTransfersV357Test-646466744 None] <== create_volume: return (1458ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:07:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-3dcef9ef-9a0f-432d-9c02-e503facc9a9f tempest-VolumesTransfersV357Test-646466744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.463s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:07:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-4e49a54d-1d35-4d9d-82cf-5c12e5d4f01e tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.138s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:07:29 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-3dcef9ef-9a0f-432d-9c02-e503facc9a9f tempest-VolumesTransfersV357Test-646466744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13134030-df52-4945-b1e0-06f53adbd403) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9de3960c-2a48-422f-9bb0-2c21119a928b', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:29 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-3dcef9ef-9a0f-432d-9c02-e503facc9a9f tempest-VolumesTransfersV357Test-646466744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5faf0bb7-7ddd-4978-9d66-39652bb0690e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-60df4091-a789-4bb9-bae8-3e8c2b8d4948 tempest-GroupSnapshotsTest-234173950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:07:29 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[775da1a8-805f-4f9d-8065-f97f0d3401a2]: (4, 'raw') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:07:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-4e49a54d-1d35-4d9d-82cf-5c12e5d4f01e tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8341f71a-cabe-4251-8fe6-fa688c7e6371 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:29 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-3dcef9ef-9a0f-432d-9c02-e503facc9a9f tempest-VolumesTransfersV357Test-646466744 None] Volume volume-9de3960c-2a48-422f-9bb0-2c21119a928b (9de3960c-2a48-422f-9bb0-2c21119a928b): created successfully
Apr 15 20:07:29 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-3dcef9ef-9a0f-432d-9c02-e503facc9a9f tempest-VolumesTransfersV357Test-646466744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5faf0bb7-7ddd-4978-9d66-39652bb0690e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:29 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-3dcef9ef-9a0f-432d-9c02-e503facc9a9f tempest-VolumesTransfersV357Test-646466744 None] Flow 'volume_create_manager' (1742a6f1-1d3a-497d-a62f-8494d8e3ada3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:07:29 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-3dcef9ef-9a0f-432d-9c02-e503facc9a9f tempest-VolumesTransfersV357Test-646466744 None] Created volume successfully.
Apr 15 20:07:29 devstack sudo[85421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8341f71a-cabe-4251-8fe6-fa688c7e6371
Apr 15 20:07:29 devstack sudo[85421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:29 devstack sudo[85421]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-4e49a54d-1d35-4d9d-82cf-5c12e5d4f01e tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8341f71a-cabe-4251-8fe6-fa688c7e6371" returned: 0 in 0.698s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-4e49a54d-1d35-4d9d-82cf-5c12e5d4f01e tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8341f71a-cabe-4251-8fe6-fa688c7e6371 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:30 devstack sudo[85425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8341f71a-cabe-4251-8fe6-fa688c7e6371
Apr 15 20:07:30 devstack sudo[85425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:30 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7d8258a-1de2-427c-ac80-f96f711e2c76 tempest-VolumesTestJSON-368222462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:07:30 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f7d8258a-1de2-427c-ac80-f96f711e2c76 tempest-VolumesTestJSON-368222462 None] Flow 'volume_create_manager' (e71660d4-aa1b-401c-87d2-a60fbad6738c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:07:30 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f7d8258a-1de2-427c-ac80-f96f711e2c76 tempest-VolumesTestJSON-368222462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7291571e-5bae-48a7-b524-3086a1f4ea8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:30 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f7d8258a-1de2-427c-ac80-f96f711e2c76 tempest-VolumesTestJSON-368222462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7291571e-5bae-48a7-b524-3086a1f4ea8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:07:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2123070838',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8944c24b-0f7f-4bfc-86a9-3ec873675e0c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='12e499e5037c48d89c994865b9ca3d2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:07:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:07:30Z,use_quota=True,user_id='7a774ba3d61840c28cb3250626f0ba42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:30 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f7d8258a-1de2-427c-ac80-f96f711e2c76 tempest-VolumesTestJSON-368222462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb30d0fe-fa47-49b2-8d59-b2ed4518843f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:30 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f7d8258a-1de2-427c-ac80-f96f711e2c76 tempest-VolumesTestJSON-368222462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb30d0fe-fa47-49b2-8d59-b2ed4518843f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:30 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f7d8258a-1de2-427c-ac80-f96f711e2c76 tempest-VolumesTestJSON-368222462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4df9e42-c7c1-4ff3-ba92-cb7c4177c6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:30 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f7d8258a-1de2-427c-ac80-f96f711e2c76 tempest-VolumesTestJSON-368222462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4df9e42-c7c1-4ff3-ba92-cb7c4177c6e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8944c24b-0f7f-4bfc-86a9-3ec873675e0c', 'volume_name': 'volume-8944c24b-0f7f-4bfc-86a9-3ec873675e0c', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:30 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f7d8258a-1de2-427c-ac80-f96f711e2c76 tempest-VolumesTestJSON-368222462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec7051a4-5e1e-4495-a2fb-8305e5c113a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:30 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f7d8258a-1de2-427c-ac80-f96f711e2c76 tempest-VolumesTestJSON-368222462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec7051a4-5e1e-4495-a2fb-8305e5c113a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:30 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f7d8258a-1de2-427c-ac80-f96f711e2c76 tempest-VolumesTestJSON-368222462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d803923e-7401-4e39-9598-593e05ccc70c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:30 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-f7d8258a-1de2-427c-ac80-f96f711e2c76 tempest-VolumesTestJSON-368222462 None] Volume 8944c24b-0f7f-4bfc-86a9-3ec873675e0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8944c24b-0f7f-4bfc-86a9-3ec873675e0c', 'volume_size': 1}
Apr 15 20:07:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-f7d8258a-1de2-427c-ac80-f96f711e2c76 tempest-VolumesTestJSON-368222462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:07:30 devstack sudo[85425]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-4e49a54d-1d35-4d9d-82cf-5c12e5d4f01e tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8341f71a-cabe-4251-8fe6-fa688c7e6371" returned: 1 in 0.599s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-4e49a54d-1d35-4d9d-82cf-5c12e5d4f01e tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8341f71a-cabe-4251-8fe6-fa688c7e6371' failed. Not Retrying. {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 20:07:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-4e49a54d-1d35-4d9d-82cf-5c12e5d4f01e tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.339s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:07:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-60df4091-a789-4bb9-bae8-3e8c2b8d4948 tempest-GroupSnapshotsTest-234173950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.307s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:07:30 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-60df4091-a789-4bb9-bae8-3e8c2b8d4948 tempest-GroupSnapshotsTest-234173950 None] Acquiring lock "cinder-quobyte-b81db88b-1581-4603-9853-77df3e02f388-ebcade98-1aca-4e32-ba3e-bcd77824362e" by "_create_volume_from_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:07:30 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-60df4091-a789-4bb9-bae8-3e8c2b8d4948 tempest-GroupSnapshotsTest-234173950 None] Lock "cinder-quobyte-b81db88b-1581-4603-9853-77df3e02f388-ebcade98-1aca-4e32-ba3e-bcd77824362e" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:07:30 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-60df4091-a789-4bb9-bae8-3e8c2b8d4948 tempest-GroupSnapshotsTest-234173950 None] Creating volume ebcade98-1aca-4e32-ba3e-bcd77824362e from snapshot b81db88b-1581-4603-9853-77df3e02f388 {{(pid=82646) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 15 20:07:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-60df4091-a789-4bb9-bae8-3e8c2b8d4948 tempest-GroupSnapshotsTest-234173950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:07:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-60df4091-a789-4bb9-bae8-3e8c2b8d4948 tempest-GroupSnapshotsTest-234173950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:07:30 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-60df4091-a789-4bb9-bae8-3e8c2b8d4948 tempest-GroupSnapshotsTest-234173950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:07:30 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-60df4091-a789-4bb9-bae8-3e8c2b8d4948 tempest-GroupSnapshotsTest-234173950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:07:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-60df4091-a789-4bb9-bae8-3e8c2b8d4948 tempest-GroupSnapshotsTest-234173950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:07:30 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-60df4091-a789-4bb9-bae8-3e8c2b8d4948 tempest-GroupSnapshotsTest-234173950 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:07:30 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-60df4091-a789-4bb9-bae8-3e8c2b8d4948 tempest-GroupSnapshotsTest-234173950 None] Acquiring lock "cinder-quobyte-ebcade98-1aca-4e32-ba3e-bcd77824362e" by "_copy_volume_from_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:07:30 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-4e49a54d-1d35-4d9d-82cf-5c12e5d4f01e tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450', 'name': 'volume-8341f71a-cabe-4251-8fe6-fa688c7e6371', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e516e01e-7738-49f1-ae41-3e71adc90b0a', 'enforce_multipath': True} {{(pid=82646) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 15 20:07:30 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-60df4091-a789-4bb9-bae8-3e8c2b8d4948 tempest-GroupSnapshotsTest-234173950 None] Lock "cinder-quobyte-ebcade98-1aca-4e32-ba3e-bcd77824362e" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:07:30 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-60df4091-a789-4bb9-bae8-3e8c2b8d4948 tempest-GroupSnapshotsTest-234173950 None] snapshot: b81db88b-1581-4603-9853-77df3e02f388, volume: ebcade98-1aca-4e32-ba3e-bcd77824362e,  {{(pid=82646) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 15 20:07:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-60df4091-a789-4bb9-bae8-3e8c2b8d4948 tempest-GroupSnapshotsTest-234173950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:07:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-60df4091-a789-4bb9-bae8-3e8c2b8d4948 tempest-GroupSnapshotsTest-234173950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:07:30 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-60df4091-a789-4bb9-bae8-3e8c2b8d4948 tempest-GroupSnapshotsTest-234173950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:07:30 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-60df4091-a789-4bb9-bae8-3e8c2b8d4948 tempest-GroupSnapshotsTest-234173950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:07:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-60df4091-a789-4bb9-bae8-3e8c2b8d4948 tempest-GroupSnapshotsTest-234173950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:07:30 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b48da1-0190-4cef-9b38-c55e2116844f]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:07:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-60df4091-a789-4bb9-bae8-3e8c2b8d4948 tempest-GroupSnapshotsTest-234173950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e692e42f-4944-4216-bb3e-b65acec806da.b81db88b-1581-4603-9853-77df3e02f388 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:30 devstack cinder-volume[82646]: INFO cinder.volume.manager [req-429e0aaa-0aaf-4693-bb08-1d5c7dd96a52 req-4e49a54d-1d35-4d9d-82cf-5c12e5d4f01e tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] attachment_update completed successfully.
Apr 15 20:07:30 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-5179d9d0-457d-48a1-ae7d-16a2ddb4a6ae tempest-VolumesTransfersV357Test-1421080196 None] Acquiring lock "cinder-9de3960c-2a48-422f-9bb0-2c21119a928b-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:07:30 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-5179d9d0-457d-48a1-ae7d-16a2ddb4a6ae tempest-VolumesTransfersV357Test-1421080196 None] Lock "cinder-9de3960c-2a48-422f-9bb0-2c21119a928b-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:07:30 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-5179d9d0-457d-48a1-ae7d-16a2ddb4a6ae tempest-VolumesTransfersV357Test-1421080196 None] Acquiring lock "cinder-quobyte-9de3960c-2a48-422f-9bb0-2c21119a928b" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:07:30 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-5179d9d0-457d-48a1-ae7d-16a2ddb4a6ae tempest-VolumesTransfersV357Test-1421080196 None] Lock "cinder-quobyte-9de3960c-2a48-422f-9bb0-2c21119a928b" acquired by "delete_volume" :: waited 0.011s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:07:30 devstack sudo[85430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e692e42f-4944-4216-bb3e-b65acec806da.b81db88b-1581-4603-9853-77df3e02f388
Apr 15 20:07:30 devstack sudo[85430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:30 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[12622047-eb17-48b8-a2c0-348ac862cdca]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:07:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5179d9d0-457d-48a1-ae7d-16a2ddb4a6ae tempest-VolumesTransfersV357Test-1421080196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9de3960c-2a48-422f-9bb0-2c21119a928b {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:30 devstack sudo[85432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9de3960c-2a48-422f-9bb0-2c21119a928b
Apr 15 20:07:30 devstack sudo[85432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:31 devstack sudo[85430]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-60df4091-a789-4bb9-bae8-3e8c2b8d4948 tempest-GroupSnapshotsTest-234173950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e692e42f-4944-4216-bb3e-b65acec806da.b81db88b-1581-4603-9853-77df3e02f388" returned: 0 in 0.601s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:31 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-60df4091-a789-4bb9-bae8-3e8c2b8d4948 tempest-GroupSnapshotsTest-234173950 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e692e42f-4944-4216-bb3e-b65acec806da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82646) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 20:07:31 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-60df4091-a789-4bb9-bae8-3e8c2b8d4948 tempest-GroupSnapshotsTest-234173950 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e692e42f-4944-4216-bb3e-b65acec806da {{(pid=82646) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 15 20:07:31 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-60df4091-a789-4bb9-bae8-3e8c2b8d4948 tempest-GroupSnapshotsTest-234173950 None] Creating direct copy from snapshot {{(pid=82646) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 15 20:07:31 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b89ef68-b3fb-47fd-a5fa-eef25a4df7fb]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:07:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-60df4091-a789-4bb9-bae8-3e8c2b8d4948 tempest-GroupSnapshotsTest-234173950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e692e42f-4944-4216-bb3e-b65acec806da {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:31 devstack sudo[85432]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5179d9d0-457d-48a1-ae7d-16a2ddb4a6ae tempest-VolumesTransfersV357Test-1421080196 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9de3960c-2a48-422f-9bb0-2c21119a928b" returned: 0 in 0.604s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5179d9d0-457d-48a1-ae7d-16a2ddb4a6ae tempest-VolumesTransfersV357Test-1421080196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9de3960c-2a48-422f-9bb0-2c21119a928b {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:31 devstack sudo[85440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e692e42f-4944-4216-bb3e-b65acec806da
Apr 15 20:07:31 devstack sudo[85440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:31 devstack sudo[85441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9de3960c-2a48-422f-9bb0-2c21119a928b
Apr 15 20:07:31 devstack sudo[85441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:31 devstack sudo[85440]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-60df4091-a789-4bb9-bae8-3e8c2b8d4948 tempest-GroupSnapshotsTest-234173950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e692e42f-4944-4216-bb3e-b65acec806da" returned: 0 in 0.555s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:31 devstack cinder-volume[82646]: DEBUG cinder.utils [None req-60df4091-a789-4bb9-bae8-3e8c2b8d4948 tempest-GroupSnapshotsTest-234173950 None] Path /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-ebcade98-1aca-4e32-ba3e-bcd77824362e not found in is_blk_device check {{(pid=82646) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 15 20:07:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-60df4091-a789-4bb9-bae8-3e8c2b8d4948 tempest-GroupSnapshotsTest-234173950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e692e42f-4944-4216-bb3e-b65acec806da /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-ebcade98-1aca-4e32-ba3e-bcd77824362e {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:31 devstack sudo[85448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e692e42f-4944-4216-bb3e-b65acec806da /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-ebcade98-1aca-4e32-ba3e-bcd77824362e
Apr 15 20:07:31 devstack sudo[85448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:31 devstack sudo[85441]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5179d9d0-457d-48a1-ae7d-16a2ddb4a6ae tempest-VolumesTransfersV357Test-1421080196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9de3960c-2a48-422f-9bb0-2c21119a928b" returned: 0 in 0.534s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:31 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-5179d9d0-457d-48a1-ae7d-16a2ddb4a6ae tempest-VolumesTransfersV357Test-1421080196 None] Lock "cinder-quobyte-9de3960c-2a48-422f-9bb0-2c21119a928b" released by "delete_volume" :: held 1.164s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:07:31 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-5179d9d0-457d-48a1-ae7d-16a2ddb4a6ae tempest-VolumesTransfersV357Test-1421080196 None] Created reservations ['550f2c17-e510-4574-bd42-17766b8a8661', '43ba74a9-9e5e-4aca-9907-e04f865de921', 'a83a4b6f-d4b4-4bb1-8f0e-dd68629b4387', '2d61dc0c-cfc7-40be-a883-6f48374be29a'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:07:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-5179d9d0-457d-48a1-ae7d-16a2ddb4a6ae tempest-VolumesTransfersV357Test-1421080196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:07:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-5179d9d0-457d-48a1-ae7d-16a2ddb4a6ae tempest-VolumesTransfersV357Test-1421080196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:07:32 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-5179d9d0-457d-48a1-ae7d-16a2ddb4a6ae tempest-VolumesTransfersV357Test-1421080196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:07:32 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-5179d9d0-457d-48a1-ae7d-16a2ddb4a6ae tempest-VolumesTransfersV357Test-1421080196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:07:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-5179d9d0-457d-48a1-ae7d-16a2ddb4a6ae tempest-VolumesTransfersV357Test-1421080196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:07:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5179d9d0-457d-48a1-ae7d-16a2ddb4a6ae tempest-VolumesTransfersV357Test-1421080196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:32 devstack sudo[85450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:07:32 devstack sudo[85450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:32 devstack sudo[85450]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5179d9d0-457d-48a1-ae7d-16a2ddb4a6ae tempest-VolumesTransfersV357Test-1421080196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.651s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:32 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-5179d9d0-457d-48a1-ae7d-16a2ddb4a6ae tempest-VolumesTransfersV357Test-1421080196 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:07:32 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-5179d9d0-457d-48a1-ae7d-16a2ddb4a6ae tempest-VolumesTransfersV357Test-1421080196 None] Deleted volume successfully.
Apr 15 20:07:32 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-5179d9d0-457d-48a1-ae7d-16a2ddb4a6ae tempest-VolumesTransfersV357Test-1421080196 None] Lock "cinder-9de3960c-2a48-422f-9bb0-2c21119a928b-delete_volume" released by "delete_volume" :: held 1.951s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:07:34 devstack sudo[85448]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:34 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-60df4091-a789-4bb9-bae8-3e8c2b8d4948 tempest-GroupSnapshotsTest-234173950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e692e42f-4944-4216-bb3e-b65acec806da /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-ebcade98-1aca-4e32-ba3e-bcd77824362e" returned: 0 in 2.986s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:34 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[05dbcc9c-2501-4cf9-b26f-8f11c62aba7e]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:07:34 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-60df4091-a789-4bb9-bae8-3e8c2b8d4948 tempest-GroupSnapshotsTest-234173950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e692e42f-4944-4216-bb3e-b65acec806da {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:34 devstack sudo[85499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e692e42f-4944-4216-bb3e-b65acec806da
Apr 15 20:07:34 devstack sudo[85499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:35 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-60df4091-a789-4bb9-bae8-3e8c2b8d4948 tempest-GroupSnapshotsTest-234173950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e692e42f-4944-4216-bb3e-b65acec806da" returned: 0 in 0.780s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:35 devstack cinder-volume[82646]: DEBUG cinder.image.image_utils [None req-60df4091-a789-4bb9-bae8-3e8c2b8d4948 tempest-GroupSnapshotsTest-234173950 None] Image conversion details: src /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e692e42f-4944-4216-bb3e-b65acec806da, size 1024.00 MB, duration 2.99 sec, destination /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-ebcade98-1aca-4e32-ba3e-bcd77824362e {{(pid=82646) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 20:07:35 devstack cinder-volume[82646]: INFO cinder.image.image_utils [None req-60df4091-a789-4bb9-bae8-3e8c2b8d4948 tempest-GroupSnapshotsTest-234173950 None] Converted 1024.00 MB image at 342.85 MB/s
Apr 15 20:07:35 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-60df4091-a789-4bb9-bae8-3e8c2b8d4948 tempest-GroupSnapshotsTest-234173950 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-ebcade98-1aca-4e32-ba3e-bcd77824362e is being set with open permissions: ugo+rw: NotImplementedError
Apr 15 20:07:35 devstack sudo[85499]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:35 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-60df4091-a789-4bb9-bae8-3e8c2b8d4948 tempest-GroupSnapshotsTest-234173950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-ebcade98-1aca-4e32-ba3e-bcd77824362e {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:35 devstack sudo[85526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-ebcade98-1aca-4e32-ba3e-bcd77824362e
Apr 15 20:07:35 devstack sudo[85526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:36 devstack sudo[85526]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:36 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-60df4091-a789-4bb9-bae8-3e8c2b8d4948 tempest-GroupSnapshotsTest-234173950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-ebcade98-1aca-4e32-ba3e-bcd77824362e" returned: 0 in 0.680s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:36 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-60df4091-a789-4bb9-bae8-3e8c2b8d4948 tempest-GroupSnapshotsTest-234173950 None] Lock "cinder-quobyte-ebcade98-1aca-4e32-ba3e-bcd77824362e" released by "_copy_volume_from_snapshot" :: held 5.693s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:07:36 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-60df4091-a789-4bb9-bae8-3e8c2b8d4948 tempest-GroupSnapshotsTest-234173950 None] Lock "cinder-quobyte-b81db88b-1581-4603-9853-77df3e02f388-ebcade98-1aca-4e32-ba3e-bcd77824362e" released by "_create_volume_from_snapshot" :: held 5.746s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:07:36 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-60df4091-a789-4bb9-bae8-3e8c2b8d4948 tempest-GroupSnapshotsTest-234173950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.768s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:07:36 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-f7d8258a-1de2-427c-ac80-f96f711e2c76 tempest-VolumesTestJSON-368222462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.931s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:07:36 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-f7d8258a-1de2-427c-ac80-f96f711e2c76 tempest-VolumesTestJSON-368222462 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:07:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2123070838',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8944c24b-0f7f-4bfc-86a9-3ec873675e0c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='12e499e5037c48d89c994865b9ca3d2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:07:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:07:30Z,use_quota=True,user_id='7a774ba3d61840c28cb3250626f0ba42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:07:36 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-f7d8258a-1de2-427c-ac80-f96f711e2c76 tempest-VolumesTestJSON-368222462 None] Creating volume 8944c24b-0f7f-4bfc-86a9-3ec873675e0c {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:07:36 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-f7d8258a-1de2-427c-ac80-f96f711e2c76 tempest-VolumesTestJSON-368222462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:07:36 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-f7d8258a-1de2-427c-ac80-f96f711e2c76 tempest-VolumesTestJSON-368222462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:07:36 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-f7d8258a-1de2-427c-ac80-f96f711e2c76 tempest-VolumesTestJSON-368222462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:07:36 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-f7d8258a-1de2-427c-ac80-f96f711e2c76 tempest-VolumesTestJSON-368222462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:07:36 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-f7d8258a-1de2-427c-ac80-f96f711e2c76 tempest-VolumesTestJSON-368222462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:07:36 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-f7d8258a-1de2-427c-ac80-f96f711e2c76 tempest-VolumesTestJSON-368222462 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:07:36 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-f7d8258a-1de2-427c-ac80-f96f711e2c76 tempest-VolumesTestJSON-368222462 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:07:36 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-f7d8258a-1de2-427c-ac80-f96f711e2c76 tempest-VolumesTestJSON-368222462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8944c24b-0f7f-4bfc-86a9-3ec873675e0c 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:36 devstack sudo[85535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8944c24b-0f7f-4bfc-86a9-3ec873675e0c 1073741824
Apr 15 20:07:36 devstack sudo[85535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:36 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-60df4091-a789-4bb9-bae8-3e8c2b8d4948 tempest-GroupSnapshotsTest-234173950 None] Create group from source-snapshot-6c5156d3-760a-44cb-97cd-5ca2b752fa1c completed successfully.
Apr 15 20:07:37 devstack sudo[85535]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:37 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-f7d8258a-1de2-427c-ac80-f96f711e2c76 tempest-VolumesTestJSON-368222462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8944c24b-0f7f-4bfc-86a9-3ec873675e0c 1073741824" returned: 0 in 0.813s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:37 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-f7d8258a-1de2-427c-ac80-f96f711e2c76 tempest-VolumesTestJSON-368222462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8944c24b-0f7f-4bfc-86a9-3ec873675e0c {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:37 devstack sudo[85541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8944c24b-0f7f-4bfc-86a9-3ec873675e0c
Apr 15 20:07:37 devstack sudo[85541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:37 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-deb15dfb-6e04-4687-b688-034a2363bf44 tempest-GroupSnapshotsTest-234173950 None] Acquiring lock "cinder-quobyte-ebcade98-1aca-4e32-ba3e-bcd77824362e" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:07:37 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-deb15dfb-6e04-4687-b688-034a2363bf44 tempest-GroupSnapshotsTest-234173950 None] Lock "cinder-quobyte-ebcade98-1aca-4e32-ba3e-bcd77824362e" acquired by "delete_volume" :: waited 0.032s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:07:37 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[e535e840-686e-497a-8ea5-7c2873f910d9]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:07:37 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-deb15dfb-6e04-4687-b688-034a2363bf44 tempest-GroupSnapshotsTest-234173950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-ebcade98-1aca-4e32-ba3e-bcd77824362e {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:37 devstack sudo[85541]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:37 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-f7d8258a-1de2-427c-ac80-f96f711e2c76 tempest-VolumesTestJSON-368222462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8944c24b-0f7f-4bfc-86a9-3ec873675e0c" returned: 0 in 0.693s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:37 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-f7d8258a-1de2-427c-ac80-f96f711e2c76 tempest-VolumesTestJSON-368222462 None] <== create_volume: return (1541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:07:37 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-f7d8258a-1de2-427c-ac80-f96f711e2c76 tempest-VolumesTestJSON-368222462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.544s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:07:37 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f7d8258a-1de2-427c-ac80-f96f711e2c76 tempest-VolumesTestJSON-368222462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d803923e-7401-4e39-9598-593e05ccc70c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8944c24b-0f7f-4bfc-86a9-3ec873675e0c', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:37 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f7d8258a-1de2-427c-ac80-f96f711e2c76 tempest-VolumesTestJSON-368222462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dd3474d-9983-43a3-8227-6d03d59fe8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:37 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-f7d8258a-1de2-427c-ac80-f96f711e2c76 tempest-VolumesTestJSON-368222462 None] Volume volume-8944c24b-0f7f-4bfc-86a9-3ec873675e0c (8944c24b-0f7f-4bfc-86a9-3ec873675e0c): created successfully
Apr 15 20:07:37 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f7d8258a-1de2-427c-ac80-f96f711e2c76 tempest-VolumesTestJSON-368222462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dd3474d-9983-43a3-8227-6d03d59fe8e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:37 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f7d8258a-1de2-427c-ac80-f96f711e2c76 tempest-VolumesTestJSON-368222462 None] Flow 'volume_create_manager' (e71660d4-aa1b-401c-87d2-a60fbad6738c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:07:37 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-f7d8258a-1de2-427c-ac80-f96f711e2c76 tempest-VolumesTestJSON-368222462 None] Created volume successfully.
Apr 15 20:07:37 devstack sudo[85544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-ebcade98-1aca-4e32-ba3e-bcd77824362e
Apr 15 20:07:37 devstack sudo[85544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:38 devstack sudo[85544]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:38 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-deb15dfb-6e04-4687-b688-034a2363bf44 tempest-GroupSnapshotsTest-234173950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-ebcade98-1aca-4e32-ba3e-bcd77824362e" returned: 0 in 0.642s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:38 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-deb15dfb-6e04-4687-b688-034a2363bf44 tempest-GroupSnapshotsTest-234173950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-ebcade98-1aca-4e32-ba3e-bcd77824362e {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:38 devstack sudo[85550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-ebcade98-1aca-4e32-ba3e-bcd77824362e
Apr 15 20:07:38 devstack sudo[85550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:39 devstack sudo[85550]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:39 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-deb15dfb-6e04-4687-b688-034a2363bf44 tempest-GroupSnapshotsTest-234173950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-ebcade98-1aca-4e32-ba3e-bcd77824362e" returned: 0 in 0.973s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:39 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-deb15dfb-6e04-4687-b688-034a2363bf44 tempest-GroupSnapshotsTest-234173950 None] Lock "cinder-quobyte-ebcade98-1aca-4e32-ba3e-bcd77824362e" released by "delete_volume" :: held 1.659s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:07:39 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-deb15dfb-6e04-4687-b688-034a2363bf44 tempest-GroupSnapshotsTest-234173950 None] Created reservations ['16839469-ca73-475b-8622-29374476455c'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:07:39 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-67efa82e-fbec-4ec1-854a-c93f223b48da tempest-VolumesTestJSON-368222462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:07:39 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-67efa82e-fbec-4ec1-854a-c93f223b48da tempest-VolumesTestJSON-368222462 None] Flow 'volume_create_manager' (0aa33bdb-b31e-413b-b106-c9b3447506ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:07:39 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-67efa82e-fbec-4ec1-854a-c93f223b48da tempest-VolumesTestJSON-368222462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27ebe050-ed27-4634-974f-8970ea79f599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:39 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-67efa82e-fbec-4ec1-854a-c93f223b48da tempest-VolumesTestJSON-368222462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27ebe050-ed27-4634-974f-8970ea79f599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:07:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1287974233',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65e83954-a522-4067-b7a5-3ba656eaab3f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='12e499e5037c48d89c994865b9ca3d2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:07:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:07:40Z,use_quota=True,user_id='7a774ba3d61840c28cb3250626f0ba42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:39 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-67efa82e-fbec-4ec1-854a-c93f223b48da tempest-VolumesTestJSON-368222462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f1ec465-e135-4db3-b5cb-6cf04d69154b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:39 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-67efa82e-fbec-4ec1-854a-c93f223b48da tempest-VolumesTestJSON-368222462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f1ec465-e135-4db3-b5cb-6cf04d69154b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:39 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-67efa82e-fbec-4ec1-854a-c93f223b48da tempest-VolumesTestJSON-368222462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3431a943-c109-4341-b8c7-22b707985fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:39 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-67efa82e-fbec-4ec1-854a-c93f223b48da tempest-VolumesTestJSON-368222462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3431a943-c109-4341-b8c7-22b707985fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65e83954-a522-4067-b7a5-3ba656eaab3f', 'volume_name': 'volume-65e83954-a522-4067-b7a5-3ba656eaab3f', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:39 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-67efa82e-fbec-4ec1-854a-c93f223b48da tempest-VolumesTestJSON-368222462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39f1e3bf-0846-4b9b-a0e8-c7d0da4184eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:39 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-67efa82e-fbec-4ec1-854a-c93f223b48da tempest-VolumesTestJSON-368222462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39f1e3bf-0846-4b9b-a0e8-c7d0da4184eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:39 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-67efa82e-fbec-4ec1-854a-c93f223b48da tempest-VolumesTestJSON-368222462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07bd57c4-323d-4a89-a674-19fe1d5a4af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:39 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-67efa82e-fbec-4ec1-854a-c93f223b48da tempest-VolumesTestJSON-368222462 None] Volume 65e83954-a522-4067-b7a5-3ba656eaab3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65e83954-a522-4067-b7a5-3ba656eaab3f', 'volume_size': 1}
Apr 15 20:07:39 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-67efa82e-fbec-4ec1-854a-c93f223b48da tempest-VolumesTestJSON-368222462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:07:39 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-67efa82e-fbec-4ec1-854a-c93f223b48da tempest-VolumesTestJSON-368222462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:07:39 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-67efa82e-fbec-4ec1-854a-c93f223b48da tempest-VolumesTestJSON-368222462 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:07:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1287974233',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65e83954-a522-4067-b7a5-3ba656eaab3f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='12e499e5037c48d89c994865b9ca3d2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:07:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:07:40Z,use_quota=True,user_id='7a774ba3d61840c28cb3250626f0ba42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:07:39 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-67efa82e-fbec-4ec1-854a-c93f223b48da tempest-VolumesTestJSON-368222462 None] Creating volume 65e83954-a522-4067-b7a5-3ba656eaab3f {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:07:39 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-67efa82e-fbec-4ec1-854a-c93f223b48da tempest-VolumesTestJSON-368222462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:07:39 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-67efa82e-fbec-4ec1-854a-c93f223b48da tempest-VolumesTestJSON-368222462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:07:39 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-67efa82e-fbec-4ec1-854a-c93f223b48da tempest-VolumesTestJSON-368222462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:07:39 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-67efa82e-fbec-4ec1-854a-c93f223b48da tempest-VolumesTestJSON-368222462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:07:39 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-67efa82e-fbec-4ec1-854a-c93f223b48da tempest-VolumesTestJSON-368222462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:07:39 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-67efa82e-fbec-4ec1-854a-c93f223b48da tempest-VolumesTestJSON-368222462 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:07:39 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-67efa82e-fbec-4ec1-854a-c93f223b48da tempest-VolumesTestJSON-368222462 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:07:39 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-67efa82e-fbec-4ec1-854a-c93f223b48da tempest-VolumesTestJSON-368222462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-65e83954-a522-4067-b7a5-3ba656eaab3f 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:39 devstack sudo[85554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-65e83954-a522-4067-b7a5-3ba656eaab3f 1073741824
Apr 15 20:07:39 devstack sudo[85554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:39 devstack cinder-volume[82646]: WARNING cinder.quota [None req-deb15dfb-6e04-4687-b688-034a2363bf44 tempest-GroupSnapshotsTest-234173950 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1568452487 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1568452487, it is now deprecated. Please use the default quota class for default quota.
Apr 15 20:07:39 devstack cinder-volume[82646]: WARNING cinder.quota [None req-deb15dfb-6e04-4687-b688-034a2363bf44 tempest-GroupSnapshotsTest-234173950 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1568452487 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1568452487, it is now deprecated. Please use the default quota class for default quota.
Apr 15 20:07:39 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-deb15dfb-6e04-4687-b688-034a2363bf44 tempest-GroupSnapshotsTest-234173950 None] Created reservations ['47f94faa-39f9-421e-b362-6d1ffa80be9d', '71d0853c-bc90-4274-a5e0-881cc7fdfcb1', '9a2c6b4a-6245-4508-acdb-8759595dd19d', '57cb62a5-1e94-4dd3-9b34-900a8664d610'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:07:39 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-deb15dfb-6e04-4687-b688-034a2363bf44 tempest-GroupSnapshotsTest-234173950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:07:39 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-deb15dfb-6e04-4687-b688-034a2363bf44 tempest-GroupSnapshotsTest-234173950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:07:39 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-deb15dfb-6e04-4687-b688-034a2363bf44 tempest-GroupSnapshotsTest-234173950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:07:40 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-deb15dfb-6e04-4687-b688-034a2363bf44 tempest-GroupSnapshotsTest-234173950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:07:40 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-deb15dfb-6e04-4687-b688-034a2363bf44 tempest-GroupSnapshotsTest-234173950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:07:40 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-deb15dfb-6e04-4687-b688-034a2363bf44 tempest-GroupSnapshotsTest-234173950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:40 devstack sudo[85556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:07:40 devstack sudo[85556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:40 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-f5a2c900-57ef-4dc0-9810-63b95c01c379 tempest-GroupSnapshotsTest-234173950 None] group_snapshot 6c5156d3-760a-44cb-97cd-5ca2b752fa1c: deleting
Apr 15 20:07:40 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f5a2c900-57ef-4dc0-9810-63b95c01c379 tempest-GroupSnapshotsTest-234173950 None] group_snapshot 6c5156d3-760a-44cb-97cd-5ca2b752fa1c: deleting {{(pid=82646) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 15 20:07:40 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-f5a2c900-57ef-4dc0-9810-63b95c01c379 tempest-GroupSnapshotsTest-234173950 None] Acquiring lock "cinder-quobyte-e692e42f-4944-4216-bb3e-b65acec806da" by "delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:07:40 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-f5a2c900-57ef-4dc0-9810-63b95c01c379 tempest-GroupSnapshotsTest-234173950 None] Lock "cinder-quobyte-e692e42f-4944-4216-bb3e-b65acec806da" acquired by "delete_snapshot" :: waited 0.033s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:07:40 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-f5a2c900-57ef-4dc0-9810-63b95c01c379 tempest-GroupSnapshotsTest-234173950 None] Acquiring lock "cinder-quobyte-b81db88b-1581-4603-9853-77df3e02f388" by "_delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:07:40 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-f5a2c900-57ef-4dc0-9810-63b95c01c379 tempest-GroupSnapshotsTest-234173950 None] Lock "cinder-quobyte-b81db88b-1581-4603-9853-77df3e02f388" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:07:40 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-f5a2c900-57ef-4dc0-9810-63b95c01c379 tempest-GroupSnapshotsTest-234173950 None] Deleting offline snapshot b81db88b-1581-4603-9853-77df3e02f388 of volume e692e42f-4944-4216-bb3e-b65acec806da {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 20:07:40 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-f5a2c900-57ef-4dc0-9810-63b95c01c379 tempest-GroupSnapshotsTest-234173950 None] snapshot_file for this snap is: volume-e692e42f-4944-4216-bb3e-b65acec806da.b81db88b-1581-4603-9853-77df3e02f388 {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 20:07:40 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d89622-4970-4c1f-940a-cf472127ac9a]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:07:40 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-f5a2c900-57ef-4dc0-9810-63b95c01c379 tempest-GroupSnapshotsTest-234173950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e692e42f-4944-4216-bb3e-b65acec806da.b81db88b-1581-4603-9853-77df3e02f388 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:40 devstack sudo[85558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e692e42f-4944-4216-bb3e-b65acec806da.b81db88b-1581-4603-9853-77df3e02f388
Apr 15 20:07:40 devstack sudo[85558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:41 devstack sudo[85556]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:41 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-deb15dfb-6e04-4687-b688-034a2363bf44 tempest-GroupSnapshotsTest-234173950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 1.013s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:41 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-deb15dfb-6e04-4687-b688-034a2363bf44 tempest-GroupSnapshotsTest-234173950 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:07:41 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-deb15dfb-6e04-4687-b688-034a2363bf44 tempest-GroupSnapshotsTest-234173950 None] Delete group completed successfully.
Apr 15 20:07:41 devstack sudo[85554]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:41 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-67efa82e-fbec-4ec1-854a-c93f223b48da tempest-VolumesTestJSON-368222462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-65e83954-a522-4067-b7a5-3ba656eaab3f 1073741824" returned: 0 in 1.334s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:41 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-67efa82e-fbec-4ec1-854a-c93f223b48da tempest-VolumesTestJSON-368222462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-65e83954-a522-4067-b7a5-3ba656eaab3f {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:41 devstack sudo[85564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-65e83954-a522-4067-b7a5-3ba656eaab3f
Apr 15 20:07:41 devstack sudo[85564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:41 devstack sudo[85558]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:41 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-f5a2c900-57ef-4dc0-9810-63b95c01c379 tempest-GroupSnapshotsTest-234173950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e692e42f-4944-4216-bb3e-b65acec806da.b81db88b-1581-4603-9853-77df3e02f388" returned: 0 in 0.868s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:41 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-f5a2c900-57ef-4dc0-9810-63b95c01c379 tempest-GroupSnapshotsTest-234173950 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e692e42f-4944-4216-bb3e-b65acec806da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82646) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 20:07:41 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[075d897a-4d61-4fea-b711-2a49f38ba1e0]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:07:41 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-f5a2c900-57ef-4dc0-9810-63b95c01c379 tempest-GroupSnapshotsTest-234173950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e692e42f-4944-4216-bb3e-b65acec806da {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:41 devstack sudo[85569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e692e42f-4944-4216-bb3e-b65acec806da
Apr 15 20:07:41 devstack sudo[85569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:41 devstack sudo[85564]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:41 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-67efa82e-fbec-4ec1-854a-c93f223b48da tempest-VolumesTestJSON-368222462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-65e83954-a522-4067-b7a5-3ba656eaab3f" returned: 0 in 0.600s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:41 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-67efa82e-fbec-4ec1-854a-c93f223b48da tempest-VolumesTestJSON-368222462 None] <== create_volume: return (1965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:07:41 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-67efa82e-fbec-4ec1-854a-c93f223b48da tempest-VolumesTestJSON-368222462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.968s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:07:41 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-67efa82e-fbec-4ec1-854a-c93f223b48da tempest-VolumesTestJSON-368222462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07bd57c4-323d-4a89-a674-19fe1d5a4af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65e83954-a522-4067-b7a5-3ba656eaab3f', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:41 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-67efa82e-fbec-4ec1-854a-c93f223b48da tempest-VolumesTestJSON-368222462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a20b143a-1019-4a37-8f88-7db40a265bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:41 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-67efa82e-fbec-4ec1-854a-c93f223b48da tempest-VolumesTestJSON-368222462 None] Volume volume-65e83954-a522-4067-b7a5-3ba656eaab3f (65e83954-a522-4067-b7a5-3ba656eaab3f): created successfully
Apr 15 20:07:41 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-67efa82e-fbec-4ec1-854a-c93f223b48da tempest-VolumesTestJSON-368222462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a20b143a-1019-4a37-8f88-7db40a265bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:41 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-67efa82e-fbec-4ec1-854a-c93f223b48da tempest-VolumesTestJSON-368222462 None] Flow 'volume_create_manager' (0aa33bdb-b31e-413b-b106-c9b3447506ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:07:41 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-67efa82e-fbec-4ec1-854a-c93f223b48da tempest-VolumesTestJSON-368222462 None] Created volume successfully.
Apr 15 20:07:42 devstack sudo[85569]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:42 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-f5a2c900-57ef-4dc0-9810-63b95c01c379 tempest-GroupSnapshotsTest-234173950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e692e42f-4944-4216-bb3e-b65acec806da" returned: 0 in 0.707s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:42 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-f5a2c900-57ef-4dc0-9810-63b95c01c379 tempest-GroupSnapshotsTest-234173950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e692e42f-4944-4216-bb3e-b65acec806da.b81db88b-1581-4603-9853-77df3e02f388 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:42 devstack sudo[85575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e692e42f-4944-4216-bb3e-b65acec806da.b81db88b-1581-4603-9853-77df3e02f388
Apr 15 20:07:42 devstack sudo[85575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:42 devstack sudo[85575]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:42 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-f5a2c900-57ef-4dc0-9810-63b95c01c379 tempest-GroupSnapshotsTest-234173950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e692e42f-4944-4216-bb3e-b65acec806da.b81db88b-1581-4603-9853-77df3e02f388" returned: 0 in 0.613s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:42 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-f5a2c900-57ef-4dc0-9810-63b95c01c379 tempest-GroupSnapshotsTest-234173950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e692e42f-4944-4216-bb3e-b65acec806da.b81db88b-1581-4603-9853-77df3e02f388 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:42 devstack sudo[85614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e692e42f-4944-4216-bb3e-b65acec806da.b81db88b-1581-4603-9853-77df3e02f388
Apr 15 20:07:42 devstack sudo[85614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:43 devstack sudo[85614]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:43 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-f5a2c900-57ef-4dc0-9810-63b95c01c379 tempest-GroupSnapshotsTest-234173950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e692e42f-4944-4216-bb3e-b65acec806da.b81db88b-1581-4603-9853-77df3e02f388" returned: 0 in 0.569s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:43 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-f5a2c900-57ef-4dc0-9810-63b95c01c379 tempest-GroupSnapshotsTest-234173950 None] Lock "cinder-quobyte-b81db88b-1581-4603-9853-77df3e02f388" released by "_delete_snapshot" :: held 2.855s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:07:43 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-f5a2c900-57ef-4dc0-9810-63b95c01c379 tempest-GroupSnapshotsTest-234173950 None] Lock "cinder-quobyte-e692e42f-4944-4216-bb3e-b65acec806da" released by "delete_snapshot" :: held 2.901s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:07:43 devstack cinder-volume[82646]: WARNING cinder.quota [None req-f5a2c900-57ef-4dc0-9810-63b95c01c379 tempest-GroupSnapshotsTest-234173950 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1568452487 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1568452487, it is now deprecated. Please use the default quota class for default quota.
Apr 15 20:07:43 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-f5a2c900-57ef-4dc0-9810-63b95c01c379 tempest-GroupSnapshotsTest-234173950 None] Created reservations ['2f2f8e39-92cc-42a6-9078-2944acd3de6e', '2ccafda7-bc2c-47ee-81c6-2b24ec30332e', '59fa4834-9eb3-4e59-bde7-ca4d3b1a0f97', '414fe6de-0ca2-4690-aa55-bebb9d79cafd'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:07:43 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae485bd8-9006-4ca0-9245-c55b934fd8a1 tempest-VolumesTestJSON-368222462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:07:43 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ae485bd8-9006-4ca0-9245-c55b934fd8a1 tempest-VolumesTestJSON-368222462 None] Flow 'volume_create_manager' (df7697a5-46cd-4486-a527-385393ebf100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:07:43 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ae485bd8-9006-4ca0-9245-c55b934fd8a1 tempest-VolumesTestJSON-368222462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (916af60f-a10a-43d9-8b5a-dcfe5e2f1eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:43 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ae485bd8-9006-4ca0-9245-c55b934fd8a1 tempest-VolumesTestJSON-368222462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (916af60f-a10a-43d9-8b5a-dcfe5e2f1eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:07:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1330987',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b335e2a5-89bb-4421-804b-829df666d871,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='12e499e5037c48d89c994865b9ca3d2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:07:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:07:43Z,use_quota=True,user_id='7a774ba3d61840c28cb3250626f0ba42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:43 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ae485bd8-9006-4ca0-9245-c55b934fd8a1 tempest-VolumesTestJSON-368222462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d064f61d-03cf-4666-bc17-633a5a0ec5d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:43 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ae485bd8-9006-4ca0-9245-c55b934fd8a1 tempest-VolumesTestJSON-368222462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d064f61d-03cf-4666-bc17-633a5a0ec5d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:43 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ae485bd8-9006-4ca0-9245-c55b934fd8a1 tempest-VolumesTestJSON-368222462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (512a7ee9-b56f-4521-94eb-81d2cc4c0c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:43 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ae485bd8-9006-4ca0-9245-c55b934fd8a1 tempest-VolumesTestJSON-368222462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (512a7ee9-b56f-4521-94eb-81d2cc4c0c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b335e2a5-89bb-4421-804b-829df666d871', 'volume_name': 'volume-b335e2a5-89bb-4421-804b-829df666d871', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:43 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ae485bd8-9006-4ca0-9245-c55b934fd8a1 tempest-VolumesTestJSON-368222462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80591d2f-36b0-4ed9-8617-c1b75d1ca338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:43 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ae485bd8-9006-4ca0-9245-c55b934fd8a1 tempest-VolumesTestJSON-368222462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80591d2f-36b0-4ed9-8617-c1b75d1ca338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:43 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ae485bd8-9006-4ca0-9245-c55b934fd8a1 tempest-VolumesTestJSON-368222462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20ae87fb-9c3c-4e69-84c8-5d06033a205c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:43 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-ae485bd8-9006-4ca0-9245-c55b934fd8a1 tempest-VolumesTestJSON-368222462 None] Volume b335e2a5-89bb-4421-804b-829df666d871: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b335e2a5-89bb-4421-804b-829df666d871', 'volume_size': 1}
Apr 15 20:07:43 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-ae485bd8-9006-4ca0-9245-c55b934fd8a1 tempest-VolumesTestJSON-368222462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:07:43 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-ae485bd8-9006-4ca0-9245-c55b934fd8a1 tempest-VolumesTestJSON-368222462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:07:43 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-ae485bd8-9006-4ca0-9245-c55b934fd8a1 tempest-VolumesTestJSON-368222462 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:07:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1330987',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b335e2a5-89bb-4421-804b-829df666d871,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='12e499e5037c48d89c994865b9ca3d2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:07:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:07:43Z,use_quota=True,user_id='7a774ba3d61840c28cb3250626f0ba42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:07:43 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-ae485bd8-9006-4ca0-9245-c55b934fd8a1 tempest-VolumesTestJSON-368222462 None] Creating volume b335e2a5-89bb-4421-804b-829df666d871 {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:07:43 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-ae485bd8-9006-4ca0-9245-c55b934fd8a1 tempest-VolumesTestJSON-368222462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:07:43 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-ae485bd8-9006-4ca0-9245-c55b934fd8a1 tempest-VolumesTestJSON-368222462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:07:43 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-ae485bd8-9006-4ca0-9245-c55b934fd8a1 tempest-VolumesTestJSON-368222462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:07:43 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-ae485bd8-9006-4ca0-9245-c55b934fd8a1 tempest-VolumesTestJSON-368222462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:07:43 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-ae485bd8-9006-4ca0-9245-c55b934fd8a1 tempest-VolumesTestJSON-368222462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:07:43 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-ae485bd8-9006-4ca0-9245-c55b934fd8a1 tempest-VolumesTestJSON-368222462 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:07:43 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-ae485bd8-9006-4ca0-9245-c55b934fd8a1 tempest-VolumesTestJSON-368222462 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:07:43 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-ae485bd8-9006-4ca0-9245-c55b934fd8a1 tempest-VolumesTestJSON-368222462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b335e2a5-89bb-4421-804b-829df666d871 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:43 devstack sudo[85640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b335e2a5-89bb-4421-804b-829df666d871 1073741824
Apr 15 20:07:43 devstack sudo[85640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:43 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-f5a2c900-57ef-4dc0-9810-63b95c01c379 tempest-GroupSnapshotsTest-234173950 None] group_snapshot 6c5156d3-760a-44cb-97cd-5ca2b752fa1c: deleted successfully
Apr 15 20:07:44 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-def05360-a1a2-4cc5-b3f5-fb5a6d9f94f2 tempest-GroupSnapshotsTest-234173950 None] Acquiring lock "cinder-quobyte-e692e42f-4944-4216-bb3e-b65acec806da" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:07:44 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-def05360-a1a2-4cc5-b3f5-fb5a6d9f94f2 tempest-GroupSnapshotsTest-234173950 None] Lock "cinder-quobyte-e692e42f-4944-4216-bb3e-b65acec806da" acquired by "delete_volume" :: waited 0.012s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:07:44 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcaf02ca-ad6a-42c1-8bc7-24053b9fe675]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:07:44 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-def05360-a1a2-4cc5-b3f5-fb5a6d9f94f2 tempest-GroupSnapshotsTest-234173950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e692e42f-4944-4216-bb3e-b65acec806da {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:44 devstack sudo[85640]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:44 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-ae485bd8-9006-4ca0-9245-c55b934fd8a1 tempest-VolumesTestJSON-368222462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b335e2a5-89bb-4421-804b-829df666d871 1073741824" returned: 0 in 0.671s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:44 devstack sudo[85647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e692e42f-4944-4216-bb3e-b65acec806da
Apr 15 20:07:44 devstack sudo[85647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:44 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-ae485bd8-9006-4ca0-9245-c55b934fd8a1 tempest-VolumesTestJSON-368222462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b335e2a5-89bb-4421-804b-829df666d871 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:44 devstack sudo[85649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b335e2a5-89bb-4421-804b-829df666d871
Apr 15 20:07:44 devstack sudo[85649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:44 devstack sudo[85647]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:44 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-def05360-a1a2-4cc5-b3f5-fb5a6d9f94f2 tempest-GroupSnapshotsTest-234173950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e692e42f-4944-4216-bb3e-b65acec806da" returned: 0 in 0.645s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:44 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-def05360-a1a2-4cc5-b3f5-fb5a6d9f94f2 tempest-GroupSnapshotsTest-234173950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e692e42f-4944-4216-bb3e-b65acec806da {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:44 devstack sudo[85655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e692e42f-4944-4216-bb3e-b65acec806da
Apr 15 20:07:44 devstack sudo[85655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:44 devstack sudo[85649]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:44 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-ae485bd8-9006-4ca0-9245-c55b934fd8a1 tempest-VolumesTestJSON-368222462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b335e2a5-89bb-4421-804b-829df666d871" returned: 0 in 0.612s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:44 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-ae485bd8-9006-4ca0-9245-c55b934fd8a1 tempest-VolumesTestJSON-368222462 None] <== create_volume: return (1315ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:07:44 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-ae485bd8-9006-4ca0-9245-c55b934fd8a1 tempest-VolumesTestJSON-368222462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.317s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:07:44 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ae485bd8-9006-4ca0-9245-c55b934fd8a1 tempest-VolumesTestJSON-368222462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20ae87fb-9c3c-4e69-84c8-5d06033a205c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b335e2a5-89bb-4421-804b-829df666d871', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:44 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ae485bd8-9006-4ca0-9245-c55b934fd8a1 tempest-VolumesTestJSON-368222462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a74dd36-b4d1-4491-890b-e8a0cb4695f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:44 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-ae485bd8-9006-4ca0-9245-c55b934fd8a1 tempest-VolumesTestJSON-368222462 None] Volume volume-b335e2a5-89bb-4421-804b-829df666d871 (b335e2a5-89bb-4421-804b-829df666d871): created successfully
Apr 15 20:07:44 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ae485bd8-9006-4ca0-9245-c55b934fd8a1 tempest-VolumesTestJSON-368222462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a74dd36-b4d1-4491-890b-e8a0cb4695f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:44 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ae485bd8-9006-4ca0-9245-c55b934fd8a1 tempest-VolumesTestJSON-368222462 None] Flow 'volume_create_manager' (df7697a5-46cd-4486-a527-385393ebf100) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:07:44 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-ae485bd8-9006-4ca0-9245-c55b934fd8a1 tempest-VolumesTestJSON-368222462 None] Created volume successfully.
Apr 15 20:07:45 devstack sudo[85655]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:45 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-def05360-a1a2-4cc5-b3f5-fb5a6d9f94f2 tempest-GroupSnapshotsTest-234173950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e692e42f-4944-4216-bb3e-b65acec806da" returned: 0 in 0.538s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:45 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-def05360-a1a2-4cc5-b3f5-fb5a6d9f94f2 tempest-GroupSnapshotsTest-234173950 None] Lock "cinder-quobyte-e692e42f-4944-4216-bb3e-b65acec806da" released by "delete_volume" :: held 1.239s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:07:45 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-def05360-a1a2-4cc5-b3f5-fb5a6d9f94f2 tempest-GroupSnapshotsTest-234173950 None] Created reservations ['182fbb9d-0ded-476b-bb43-2e346dff5708'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:07:45 devstack cinder-volume[82646]: WARNING cinder.db.sqlalchemy.api [None req-def05360-a1a2-4cc5-b3f5-fb5a6d9f94f2 tempest-GroupSnapshotsTest-234173950 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1568452487']
Apr 15 20:07:45 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-def05360-a1a2-4cc5-b3f5-fb5a6d9f94f2 tempest-GroupSnapshotsTest-234173950 None] Created reservations ['63bec35e-fcce-4b25-a73c-4f5efe78b558', 'c7a78aab-04f0-4474-8e52-62f1da0ce132', '6c0643d9-6b01-4f59-8b09-4362b7c3f89f', '84358cc1-3ab3-4f13-86bd-dc53a85027f4'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:07:45 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-def05360-a1a2-4cc5-b3f5-fb5a6d9f94f2 tempest-GroupSnapshotsTest-234173950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:07:45 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-def05360-a1a2-4cc5-b3f5-fb5a6d9f94f2 tempest-GroupSnapshotsTest-234173950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:07:45 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-def05360-a1a2-4cc5-b3f5-fb5a6d9f94f2 tempest-GroupSnapshotsTest-234173950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:07:45 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-def05360-a1a2-4cc5-b3f5-fb5a6d9f94f2 tempest-GroupSnapshotsTest-234173950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:07:45 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-def05360-a1a2-4cc5-b3f5-fb5a6d9f94f2 tempest-GroupSnapshotsTest-234173950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:07:45 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-def05360-a1a2-4cc5-b3f5-fb5a6d9f94f2 tempest-GroupSnapshotsTest-234173950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:45 devstack sudo[85677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:07:45 devstack sudo[85677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:46 devstack sudo[85677]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-def05360-a1a2-4cc5-b3f5-fb5a6d9f94f2 tempest-GroupSnapshotsTest-234173950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.658s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:46 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-def05360-a1a2-4cc5-b3f5-fb5a6d9f94f2 tempest-GroupSnapshotsTest-234173950 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:07:46 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-def05360-a1a2-4cc5-b3f5-fb5a6d9f94f2 tempest-GroupSnapshotsTest-234173950 None] Delete group completed successfully.
Apr 15 20:07:46 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-b8179419-c832-4e0c-8318-0a673ac011be tempest-VolumesTestJSON-368222462 None] Acquiring lock "cinder-b335e2a5-89bb-4421-804b-829df666d871-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:07:46 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-b8179419-c832-4e0c-8318-0a673ac011be tempest-VolumesTestJSON-368222462 None] Lock "cinder-b335e2a5-89bb-4421-804b-829df666d871-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:07:46 devstack cinder-volume[82646]: DEBUG dbcounter [-] [82646] Writing DB stats cinder:UPDATE=140,cinder:SELECT=119,cinder:DELETE=11,cinder:INSERT=35 {{(pid=82646) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 20:07:46 devstack cinder-volume[82646]: DEBUG dbcounter [-] [82646] Writing DB stats cinder:SELECT=115,cinder:INSERT=33,cinder:UPDATE=117,cinder:DELETE=8 {{(pid=82646) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 20:07:46 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-b8179419-c832-4e0c-8318-0a673ac011be tempest-VolumesTestJSON-368222462 None] Acquiring lock "cinder-quobyte-b335e2a5-89bb-4421-804b-829df666d871" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:07:46 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-b8179419-c832-4e0c-8318-0a673ac011be tempest-VolumesTestJSON-368222462 None] Lock "cinder-quobyte-b335e2a5-89bb-4421-804b-829df666d871" acquired by "delete_volume" :: waited 0.019s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:07:46 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab311f0d-a124-4f72-9aa9-3cd1058a40b2]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:07:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b8179419-c832-4e0c-8318-0a673ac011be tempest-VolumesTestJSON-368222462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b335e2a5-89bb-4421-804b-829df666d871 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:46 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-67d4bc45-19df-4444-b5f0-57c1a1ea1299 tempest-GroupSnapshotsTest-234173950 None] Group tempest-GroupSnapshotsTest-Group-1788931259: creating
Apr 15 20:07:46 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-67d4bc45-19df-4444-b5f0-57c1a1ea1299 tempest-GroupSnapshotsTest-234173950 None] Group tempest-GroupSnapshotsTest-Group-1788931259: created successfully
Apr 15 20:07:46 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-67d4bc45-19df-4444-b5f0-57c1a1ea1299 tempest-GroupSnapshotsTest-234173950 None] Create group completed successfully.
Apr 15 20:07:46 devstack sudo[85682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b335e2a5-89bb-4421-804b-829df666d871
Apr 15 20:07:46 devstack sudo[85682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:47 devstack sudo[85682]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:47 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b8179419-c832-4e0c-8318-0a673ac011be tempest-VolumesTestJSON-368222462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b335e2a5-89bb-4421-804b-829df666d871" returned: 0 in 0.573s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:47 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b8179419-c832-4e0c-8318-0a673ac011be tempest-VolumesTestJSON-368222462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b335e2a5-89bb-4421-804b-829df666d871 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:47 devstack sudo[85687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b335e2a5-89bb-4421-804b-829df666d871
Apr 15 20:07:47 devstack sudo[85687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:47 devstack sudo[85687]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:47 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b8179419-c832-4e0c-8318-0a673ac011be tempest-VolumesTestJSON-368222462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b335e2a5-89bb-4421-804b-829df666d871" returned: 0 in 0.601s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:47 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-b8179419-c832-4e0c-8318-0a673ac011be tempest-VolumesTestJSON-368222462 None] Lock "cinder-quobyte-b335e2a5-89bb-4421-804b-829df666d871" released by "delete_volume" :: held 1.201s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:07:47 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-b8179419-c832-4e0c-8318-0a673ac011be tempest-VolumesTestJSON-368222462 None] Created reservations ['d62789d2-6f8d-43af-823d-a0409fa50452', 'bdde4aab-1dab-4171-a1ff-443d0b1d0216', 'f4176575-218d-4b27-88ea-0e7fabcc6af6', '60f2eb44-44a6-4ed0-adfb-4daaea05e501'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:07:47 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-b8179419-c832-4e0c-8318-0a673ac011be tempest-VolumesTestJSON-368222462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:07:47 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-b8179419-c832-4e0c-8318-0a673ac011be tempest-VolumesTestJSON-368222462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:07:47 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-b8179419-c832-4e0c-8318-0a673ac011be tempest-VolumesTestJSON-368222462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:07:47 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-b8179419-c832-4e0c-8318-0a673ac011be tempest-VolumesTestJSON-368222462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:07:47 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-b8179419-c832-4e0c-8318-0a673ac011be tempest-VolumesTestJSON-368222462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:07:47 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b8179419-c832-4e0c-8318-0a673ac011be tempest-VolumesTestJSON-368222462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:47 devstack sudo[85690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:07:47 devstack sudo[85690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:48 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-022644af-bd1c-427a-854b-0f8549869759 tempest-GroupSnapshotsTest-234173950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:07:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-022644af-bd1c-427a-854b-0f8549869759 tempest-GroupSnapshotsTest-234173950 None] Flow 'volume_create_manager' (6e8975cc-243c-4f35-9ac7-95c9e17f1a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:07:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-022644af-bd1c-427a-854b-0f8549869759 tempest-GroupSnapshotsTest-234173950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97ad701e-5f6e-40ea-8581-cc56fa386b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-022644af-bd1c-427a-854b-0f8549869759 tempest-GroupSnapshotsTest-234173950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97ad701e-5f6e-40ea-8581-cc56fa386b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-481636782',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3c4b9f08-b5a3-416b-8687-58d74d7793b9,host='devstack@QuobyteHD#QuobyteHD',id=e0172e8a-c625-4092-bbbf-c0de807bfb86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98edbdfcd7444227b1af4887df1acf45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:07:48Z,use_quota=True,user_id='9250ca46a4b44ce3a19386920797e916',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1448c404-5a8c-4453-a4c6-447e7cb6694b),volume_type_id=1448c404-5a8c-4453-a4c6-447e7cb6694b)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-022644af-bd1c-427a-854b-0f8549869759 tempest-GroupSnapshotsTest-234173950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aff871f-5cea-4954-a8f8-24f3b793a526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-022644af-bd1c-427a-854b-0f8549869759 tempest-GroupSnapshotsTest-234173950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aff871f-5cea-4954-a8f8-24f3b793a526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-022644af-bd1c-427a-854b-0f8549869759 tempest-GroupSnapshotsTest-234173950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff7944a0-6023-48e4-bc74-488d0b7e0465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-022644af-bd1c-427a-854b-0f8549869759 tempest-GroupSnapshotsTest-234173950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff7944a0-6023-48e4-bc74-488d0b7e0465) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0172e8a-c625-4092-bbbf-c0de807bfb86', 'volume_name': 'volume-e0172e8a-c625-4092-bbbf-c0de807bfb86', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-022644af-bd1c-427a-854b-0f8549869759 tempest-GroupSnapshotsTest-234173950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4081e4b6-f1a7-4b73-90f9-19f7ceec3eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-022644af-bd1c-427a-854b-0f8549869759 tempest-GroupSnapshotsTest-234173950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4081e4b6-f1a7-4b73-90f9-19f7ceec3eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-022644af-bd1c-427a-854b-0f8549869759 tempest-GroupSnapshotsTest-234173950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df07da19-57da-46e9-91dc-6a10b349f2a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:48 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-022644af-bd1c-427a-854b-0f8549869759 tempest-GroupSnapshotsTest-234173950 None] Volume e0172e8a-c625-4092-bbbf-c0de807bfb86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0172e8a-c625-4092-bbbf-c0de807bfb86', 'volume_size': 1}
Apr 15 20:07:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-022644af-bd1c-427a-854b-0f8549869759 tempest-GroupSnapshotsTest-234173950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:07:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-022644af-bd1c-427a-854b-0f8549869759 tempest-GroupSnapshotsTest-234173950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:07:48 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-022644af-bd1c-427a-854b-0f8549869759 tempest-GroupSnapshotsTest-234173950 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=3c4b9f08-b5a3-416b-8687-58d74d7793b9,created_at=2026-04-15T18:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-481636782',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3c4b9f08-b5a3-416b-8687-58d74d7793b9,host='devstack@QuobyteHD#QuobyteHD',id=e0172e8a-c625-4092-bbbf-c0de807bfb86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98edbdfcd7444227b1af4887df1acf45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:07:48Z,use_quota=True,user_id='9250ca46a4b44ce3a19386920797e916',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1448c404-5a8c-4453-a4c6-447e7cb6694b),volume_type_id=1448c404-5a8c-4453-a4c6-447e7cb6694b)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:07:48 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-022644af-bd1c-427a-854b-0f8549869759 tempest-GroupSnapshotsTest-234173950 None] Creating volume e0172e8a-c625-4092-bbbf-c0de807bfb86 {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:07:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-022644af-bd1c-427a-854b-0f8549869759 tempest-GroupSnapshotsTest-234173950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:07:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-022644af-bd1c-427a-854b-0f8549869759 tempest-GroupSnapshotsTest-234173950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:07:48 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-022644af-bd1c-427a-854b-0f8549869759 tempest-GroupSnapshotsTest-234173950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:07:48 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-022644af-bd1c-427a-854b-0f8549869759 tempest-GroupSnapshotsTest-234173950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:07:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-022644af-bd1c-427a-854b-0f8549869759 tempest-GroupSnapshotsTest-234173950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:07:48 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-022644af-bd1c-427a-854b-0f8549869759 tempest-GroupSnapshotsTest-234173950 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:07:48 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-022644af-bd1c-427a-854b-0f8549869759 tempest-GroupSnapshotsTest-234173950 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:07:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-022644af-bd1c-427a-854b-0f8549869759 tempest-GroupSnapshotsTest-234173950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e0172e8a-c625-4092-bbbf-c0de807bfb86 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:48 devstack sudo[85693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e0172e8a-c625-4092-bbbf-c0de807bfb86 1073741824
Apr 15 20:07:48 devstack sudo[85693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:48 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-11817b22-64c8-420d-aa59-1a1056c55ab4 tempest-VolumesActionsTest-1120257978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:07:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-11817b22-64c8-420d-aa59-1a1056c55ab4 tempest-VolumesActionsTest-1120257978 None] Flow 'volume_create_manager' (9ad554f4-fa1d-4bed-ad9a-98ffb8bc3895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:07:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-11817b22-64c8-420d-aa59-1a1056c55ab4 tempest-VolumesActionsTest-1120257978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cd12be2-667a-427f-b332-c33b5e1d42eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-11817b22-64c8-420d-aa59-1a1056c55ab4 tempest-VolumesActionsTest-1120257978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cd12be2-667a-427f-b332-c33b5e1d42eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-351071193',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=684c024b-5c7b-4580-9ec4-2a4f0786e6a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='448653855acf4fbca8fd8df02fd858a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:07:48Z,use_quota=True,user_id='9b5b640fbc5a410fabba201f4b53483c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-11817b22-64c8-420d-aa59-1a1056c55ab4 tempest-VolumesActionsTest-1120257978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd5caec0-e092-46dc-ab25-0d7ceeb0fd35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-11817b22-64c8-420d-aa59-1a1056c55ab4 tempest-VolumesActionsTest-1120257978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd5caec0-e092-46dc-ab25-0d7ceeb0fd35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-11817b22-64c8-420d-aa59-1a1056c55ab4 tempest-VolumesActionsTest-1120257978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (014cca8f-7f8f-4ba6-93ab-b11b16f1ace5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-11817b22-64c8-420d-aa59-1a1056c55ab4 tempest-VolumesActionsTest-1120257978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (014cca8f-7f8f-4ba6-93ab-b11b16f1ace5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '684c024b-5c7b-4580-9ec4-2a4f0786e6a3', 'volume_name': 'volume-684c024b-5c7b-4580-9ec4-2a4f0786e6a3', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-11817b22-64c8-420d-aa59-1a1056c55ab4 tempest-VolumesActionsTest-1120257978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (635dbbfa-3826-4623-9b93-a5c5acf2b59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-11817b22-64c8-420d-aa59-1a1056c55ab4 tempest-VolumesActionsTest-1120257978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (635dbbfa-3826-4623-9b93-a5c5acf2b59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-11817b22-64c8-420d-aa59-1a1056c55ab4 tempest-VolumesActionsTest-1120257978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7190092-a1f8-4aa4-8860-02c18e7df231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:48 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-11817b22-64c8-420d-aa59-1a1056c55ab4 tempest-VolumesActionsTest-1120257978 None] Volume 684c024b-5c7b-4580-9ec4-2a4f0786e6a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-684c024b-5c7b-4580-9ec4-2a4f0786e6a3', 'volume_size': 1}
Apr 15 20:07:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-11817b22-64c8-420d-aa59-1a1056c55ab4 tempest-VolumesActionsTest-1120257978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:07:48 devstack sudo[85690]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b8179419-c832-4e0c-8318-0a673ac011be tempest-VolumesTestJSON-368222462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.574s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:48 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-b8179419-c832-4e0c-8318-0a673ac011be tempest-VolumesTestJSON-368222462 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:07:48 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-b8179419-c832-4e0c-8318-0a673ac011be tempest-VolumesTestJSON-368222462 None] Deleted volume successfully.
Apr 15 20:07:48 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-b8179419-c832-4e0c-8318-0a673ac011be tempest-VolumesTestJSON-368222462 None] Lock "cinder-b335e2a5-89bb-4421-804b-829df666d871-delete_volume" released by "delete_volume" :: held 1.961s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:07:48 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-e9231c5a-821e-4bd8-9ba6-d6152231cfae tempest-VolumesTestJSON-368222462 None] Acquiring lock "cinder-65e83954-a522-4067-b7a5-3ba656eaab3f-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:07:48 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-e9231c5a-821e-4bd8-9ba6-d6152231cfae tempest-VolumesTestJSON-368222462 None] Lock "cinder-65e83954-a522-4067-b7a5-3ba656eaab3f-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:07:48 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-e9231c5a-821e-4bd8-9ba6-d6152231cfae tempest-VolumesTestJSON-368222462 None] Acquiring lock "cinder-quobyte-65e83954-a522-4067-b7a5-3ba656eaab3f" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:07:48 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-e9231c5a-821e-4bd8-9ba6-d6152231cfae tempest-VolumesTestJSON-368222462 None] Lock "cinder-quobyte-65e83954-a522-4067-b7a5-3ba656eaab3f" acquired by "delete_volume" :: waited 0.009s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:07:48 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[70113dc3-7a60-4e09-9a3b-1874d7acc9d8]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:07:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e9231c5a-821e-4bd8-9ba6-d6152231cfae tempest-VolumesTestJSON-368222462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-65e83954-a522-4067-b7a5-3ba656eaab3f {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:48 devstack sudo[85693]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-022644af-bd1c-427a-854b-0f8549869759 tempest-GroupSnapshotsTest-234173950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e0172e8a-c625-4092-bbbf-c0de807bfb86 1073741824" returned: 0 in 0.608s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-022644af-bd1c-427a-854b-0f8549869759 tempest-GroupSnapshotsTest-234173950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e0172e8a-c625-4092-bbbf-c0de807bfb86 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:48 devstack sudo[85700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e0172e8a-c625-4092-bbbf-c0de807bfb86
Apr 15 20:07:48 devstack sudo[85700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:48 devstack cinder-volume[82646]: DEBUG oslo_service.periodic_task [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 15 20:07:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:07:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:07:48 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:07:48 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:07:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:07:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:48 devstack sudo[85699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-65e83954-a522-4067-b7a5-3ba656eaab3f
Apr 15 20:07:48 devstack sudo[85699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:48 devstack sudo[85702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:07:48 devstack sudo[85702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:49 devstack sudo[85702]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:49 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.417s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:49 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:07:49 devstack sudo[85700]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:49 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-022644af-bd1c-427a-854b-0f8549869759 tempest-GroupSnapshotsTest-234173950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e0172e8a-c625-4092-bbbf-c0de807bfb86" returned: 0 in 0.489s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:49 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-022644af-bd1c-427a-854b-0f8549869759 tempest-GroupSnapshotsTest-234173950 None] <== create_volume: return (1130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:07:49 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-022644af-bd1c-427a-854b-0f8549869759 tempest-GroupSnapshotsTest-234173950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:07:49 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-11817b22-64c8-420d-aa59-1a1056c55ab4 tempest-VolumesActionsTest-1120257978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.990s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:07:49 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-11817b22-64c8-420d-aa59-1a1056c55ab4 tempest-VolumesActionsTest-1120257978 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-351071193',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=684c024b-5c7b-4580-9ec4-2a4f0786e6a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='448653855acf4fbca8fd8df02fd858a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:07:48Z,use_quota=True,user_id='9b5b640fbc5a410fabba201f4b53483c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:07:49 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-11817b22-64c8-420d-aa59-1a1056c55ab4 tempest-VolumesActionsTest-1120257978 None] Creating volume 684c024b-5c7b-4580-9ec4-2a4f0786e6a3 {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:07:49 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-11817b22-64c8-420d-aa59-1a1056c55ab4 tempest-VolumesActionsTest-1120257978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:07:49 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-11817b22-64c8-420d-aa59-1a1056c55ab4 tempest-VolumesActionsTest-1120257978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:07:49 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-11817b22-64c8-420d-aa59-1a1056c55ab4 tempest-VolumesActionsTest-1120257978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:07:49 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-11817b22-64c8-420d-aa59-1a1056c55ab4 tempest-VolumesActionsTest-1120257978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:07:49 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-11817b22-64c8-420d-aa59-1a1056c55ab4 tempest-VolumesActionsTest-1120257978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:07:49 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-11817b22-64c8-420d-aa59-1a1056c55ab4 tempest-VolumesActionsTest-1120257978 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:07:49 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-11817b22-64c8-420d-aa59-1a1056c55ab4 tempest-VolumesActionsTest-1120257978 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:07:49 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-11817b22-64c8-420d-aa59-1a1056c55ab4 tempest-VolumesActionsTest-1120257978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-684c024b-5c7b-4580-9ec4-2a4f0786e6a3 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:49 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-022644af-bd1c-427a-854b-0f8549869759 tempest-GroupSnapshotsTest-234173950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df07da19-57da-46e9-91dc-6a10b349f2a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0172e8a-c625-4092-bbbf-c0de807bfb86', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:49 devstack sudo[85710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-684c024b-5c7b-4580-9ec4-2a4f0786e6a3 1073741824
Apr 15 20:07:49 devstack sudo[85710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:49 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-022644af-bd1c-427a-854b-0f8549869759 tempest-GroupSnapshotsTest-234173950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d1f52b2-39f6-45d3-9001-2c1a63c2baa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:49 devstack sudo[85699]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:49 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e9231c5a-821e-4bd8-9ba6-d6152231cfae tempest-VolumesTestJSON-368222462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-65e83954-a522-4067-b7a5-3ba656eaab3f" returned: 0 in 0.573s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:49 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e9231c5a-821e-4bd8-9ba6-d6152231cfae tempest-VolumesTestJSON-368222462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-65e83954-a522-4067-b7a5-3ba656eaab3f {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:49 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-022644af-bd1c-427a-854b-0f8549869759 tempest-GroupSnapshotsTest-234173950 None] Volume volume-e0172e8a-c625-4092-bbbf-c0de807bfb86 (e0172e8a-c625-4092-bbbf-c0de807bfb86): created successfully
Apr 15 20:07:49 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-022644af-bd1c-427a-854b-0f8549869759 tempest-GroupSnapshotsTest-234173950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d1f52b2-39f6-45d3-9001-2c1a63c2baa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:49 devstack sudo[85712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-65e83954-a522-4067-b7a5-3ba656eaab3f
Apr 15 20:07:49 devstack sudo[85712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:49 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-022644af-bd1c-427a-854b-0f8549869759 tempest-GroupSnapshotsTest-234173950 None] Flow 'volume_create_manager' (6e8975cc-243c-4f35-9ac7-95c9e17f1a40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:07:49 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-022644af-bd1c-427a-854b-0f8549869759 tempest-GroupSnapshotsTest-234173950 None] Created volume successfully.
Apr 15 20:07:49 devstack sudo[85712]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:49 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e9231c5a-821e-4bd8-9ba6-d6152231cfae tempest-VolumesTestJSON-368222462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-65e83954-a522-4067-b7a5-3ba656eaab3f" returned: 0 in 0.586s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:49 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-e9231c5a-821e-4bd8-9ba6-d6152231cfae tempest-VolumesTestJSON-368222462 None] Lock "cinder-quobyte-65e83954-a522-4067-b7a5-3ba656eaab3f" released by "delete_volume" :: held 1.195s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:07:50 devstack sudo[85710]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:50 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-e9231c5a-821e-4bd8-9ba6-d6152231cfae tempest-VolumesTestJSON-368222462 None] Created reservations ['2b52fc68-5a89-44e3-9ca7-10a4b7712a3f', '0e753573-c386-4211-b562-87c38ed450ec', '116d37a5-9464-43a0-bd79-60244ea03fc1', '8975e319-c7c8-49a1-aca9-07230fc28dd2'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:07:50 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-11817b22-64c8-420d-aa59-1a1056c55ab4 tempest-VolumesActionsTest-1120257978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-684c024b-5c7b-4580-9ec4-2a4f0786e6a3 1073741824" returned: 0 in 0.684s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:50 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-e9231c5a-821e-4bd8-9ba6-d6152231cfae tempest-VolumesTestJSON-368222462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:07:50 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-e9231c5a-821e-4bd8-9ba6-d6152231cfae tempest-VolumesTestJSON-368222462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:07:50 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-e9231c5a-821e-4bd8-9ba6-d6152231cfae tempest-VolumesTestJSON-368222462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:07:50 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-e9231c5a-821e-4bd8-9ba6-d6152231cfae tempest-VolumesTestJSON-368222462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:07:50 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-e9231c5a-821e-4bd8-9ba6-d6152231cfae tempest-VolumesTestJSON-368222462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:07:50 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e9231c5a-821e-4bd8-9ba6-d6152231cfae tempest-VolumesTestJSON-368222462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:50 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-11817b22-64c8-420d-aa59-1a1056c55ab4 tempest-VolumesActionsTest-1120257978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-684c024b-5c7b-4580-9ec4-2a4f0786e6a3 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:50 devstack sudo[85744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:07:50 devstack sudo[85744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:50 devstack sudo[85745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-684c024b-5c7b-4580-9ec4-2a4f0786e6a3
Apr 15 20:07:50 devstack sudo[85745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:50 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac3fa4db-f2de-417b-8649-0983f1ab15a1 tempest-GroupSnapshotsTest-234173950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:07:50 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ac3fa4db-f2de-417b-8649-0983f1ab15a1 tempest-GroupSnapshotsTest-234173950 None] Flow 'volume_create_manager' (50d3fed3-e064-47d2-b61c-8b6d55bc8ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:07:50 devstack sudo[85744]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:50 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ac3fa4db-f2de-417b-8649-0983f1ab15a1 tempest-GroupSnapshotsTest-234173950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (074bcbd1-3d10-4965-b057-b85933440ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:50 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e9231c5a-821e-4bd8-9ba6-d6152231cfae tempest-VolumesTestJSON-368222462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.560s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:50 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-e9231c5a-821e-4bd8-9ba6-d6152231cfae tempest-VolumesTestJSON-368222462 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:07:50 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ac3fa4db-f2de-417b-8649-0983f1ab15a1 tempest-GroupSnapshotsTest-234173950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (074bcbd1-3d10-4965-b057-b85933440ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1517860061',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3c4b9f08-b5a3-416b-8687-58d74d7793b9,host='devstack@QuobyteHD#QuobyteHD',id=e9a78a90-ff5f-423c-9c0d-ec56a1d14629,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98edbdfcd7444227b1af4887df1acf45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:07:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:07:51Z,use_quota=True,user_id='9250ca46a4b44ce3a19386920797e916',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1448c404-5a8c-4453-a4c6-447e7cb6694b),volume_type_id=1448c404-5a8c-4453-a4c6-447e7cb6694b)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:50 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ac3fa4db-f2de-417b-8649-0983f1ab15a1 tempest-GroupSnapshotsTest-234173950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a395cc18-2900-4712-8284-b25c4c339d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:50 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ac3fa4db-f2de-417b-8649-0983f1ab15a1 tempest-GroupSnapshotsTest-234173950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a395cc18-2900-4712-8284-b25c4c339d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:50 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ac3fa4db-f2de-417b-8649-0983f1ab15a1 tempest-GroupSnapshotsTest-234173950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e94cfee-b758-41c1-8c15-e87bd24077e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:50 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ac3fa4db-f2de-417b-8649-0983f1ab15a1 tempest-GroupSnapshotsTest-234173950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e94cfee-b758-41c1-8c15-e87bd24077e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9a78a90-ff5f-423c-9c0d-ec56a1d14629', 'volume_name': 'volume-e9a78a90-ff5f-423c-9c0d-ec56a1d14629', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:50 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ac3fa4db-f2de-417b-8649-0983f1ab15a1 tempest-GroupSnapshotsTest-234173950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1fe9d27-afe1-4607-bb8a-593c113f0d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:50 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ac3fa4db-f2de-417b-8649-0983f1ab15a1 tempest-GroupSnapshotsTest-234173950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1fe9d27-afe1-4607-bb8a-593c113f0d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:50 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ac3fa4db-f2de-417b-8649-0983f1ab15a1 tempest-GroupSnapshotsTest-234173950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8d05ca7-8c74-4d04-af84-6aac324cf3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:50 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-ac3fa4db-f2de-417b-8649-0983f1ab15a1 tempest-GroupSnapshotsTest-234173950 None] Volume e9a78a90-ff5f-423c-9c0d-ec56a1d14629: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9a78a90-ff5f-423c-9c0d-ec56a1d14629', 'volume_size': 1}
Apr 15 20:07:50 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-ac3fa4db-f2de-417b-8649-0983f1ab15a1 tempest-GroupSnapshotsTest-234173950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:07:50 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-e9231c5a-821e-4bd8-9ba6-d6152231cfae tempest-VolumesTestJSON-368222462 None] Deleted volume successfully.
Apr 15 20:07:50 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-e9231c5a-821e-4bd8-9ba6-d6152231cfae tempest-VolumesTestJSON-368222462 None] Lock "cinder-65e83954-a522-4067-b7a5-3ba656eaab3f-delete_volume" released by "delete_volume" :: held 1.966s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:07:50 devstack sudo[85745]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:50 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-11817b22-64c8-420d-aa59-1a1056c55ab4 tempest-VolumesActionsTest-1120257978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-684c024b-5c7b-4580-9ec4-2a4f0786e6a3" returned: 0 in 0.663s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:50 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-11817b22-64c8-420d-aa59-1a1056c55ab4 tempest-VolumesActionsTest-1120257978 None] <== create_volume: return (1404ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:07:50 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-11817b22-64c8-420d-aa59-1a1056c55ab4 tempest-VolumesActionsTest-1120257978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.407s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:07:50 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-ac3fa4db-f2de-417b-8649-0983f1ab15a1 tempest-GroupSnapshotsTest-234173950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.074s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:07:50 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-ac3fa4db-f2de-417b-8649-0983f1ab15a1 tempest-GroupSnapshotsTest-234173950 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=3c4b9f08-b5a3-416b-8687-58d74d7793b9,created_at=2026-04-15T18:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1517860061',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3c4b9f08-b5a3-416b-8687-58d74d7793b9,host='devstack@QuobyteHD#QuobyteHD',id=e9a78a90-ff5f-423c-9c0d-ec56a1d14629,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98edbdfcd7444227b1af4887df1acf45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:07:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:07:51Z,use_quota=True,user_id='9250ca46a4b44ce3a19386920797e916',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1448c404-5a8c-4453-a4c6-447e7cb6694b),volume_type_id=1448c404-5a8c-4453-a4c6-447e7cb6694b)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:07:50 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-ac3fa4db-f2de-417b-8649-0983f1ab15a1 tempest-GroupSnapshotsTest-234173950 None] Creating volume e9a78a90-ff5f-423c-9c0d-ec56a1d14629 {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:07:50 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-ac3fa4db-f2de-417b-8649-0983f1ab15a1 tempest-GroupSnapshotsTest-234173950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:07:50 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-ac3fa4db-f2de-417b-8649-0983f1ab15a1 tempest-GroupSnapshotsTest-234173950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:07:50 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-ac3fa4db-f2de-417b-8649-0983f1ab15a1 tempest-GroupSnapshotsTest-234173950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:07:50 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-ac3fa4db-f2de-417b-8649-0983f1ab15a1 tempest-GroupSnapshotsTest-234173950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:07:50 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-ac3fa4db-f2de-417b-8649-0983f1ab15a1 tempest-GroupSnapshotsTest-234173950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:07:50 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-ac3fa4db-f2de-417b-8649-0983f1ab15a1 tempest-GroupSnapshotsTest-234173950 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:07:50 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-ac3fa4db-f2de-417b-8649-0983f1ab15a1 tempest-GroupSnapshotsTest-234173950 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:07:50 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-ac3fa4db-f2de-417b-8649-0983f1ab15a1 tempest-GroupSnapshotsTest-234173950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e9a78a90-ff5f-423c-9c0d-ec56a1d14629 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:50 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-11817b22-64c8-420d-aa59-1a1056c55ab4 tempest-VolumesActionsTest-1120257978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7190092-a1f8-4aa4-8860-02c18e7df231) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-684c024b-5c7b-4580-9ec4-2a4f0786e6a3', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:50 devstack sudo[85750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e9a78a90-ff5f-423c-9c0d-ec56a1d14629 1073741824
Apr 15 20:07:50 devstack sudo[85750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:50 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-11817b22-64c8-420d-aa59-1a1056c55ab4 tempest-VolumesActionsTest-1120257978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31b0626c-6d3b-4ea0-bbb2-e110e5fa64e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:50 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-11817b22-64c8-420d-aa59-1a1056c55ab4 tempest-VolumesActionsTest-1120257978 None] Volume volume-684c024b-5c7b-4580-9ec4-2a4f0786e6a3 (684c024b-5c7b-4580-9ec4-2a4f0786e6a3): created successfully
Apr 15 20:07:50 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-11817b22-64c8-420d-aa59-1a1056c55ab4 tempest-VolumesActionsTest-1120257978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31b0626c-6d3b-4ea0-bbb2-e110e5fa64e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:50 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-11817b22-64c8-420d-aa59-1a1056c55ab4 tempest-VolumesActionsTest-1120257978 None] Flow 'volume_create_manager' (9ad554f4-fa1d-4bed-ad9a-98ffb8bc3895) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:07:50 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-11817b22-64c8-420d-aa59-1a1056c55ab4 tempest-VolumesActionsTest-1120257978 None] Created volume successfully.
Apr 15 20:07:50 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-6a50134f-f281-4bfe-aab3-f4605453c763 tempest-VolumesTestJSON-368222462 None] Acquiring lock "cinder-8944c24b-0f7f-4bfc-86a9-3ec873675e0c-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:07:50 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-6a50134f-f281-4bfe-aab3-f4605453c763 tempest-VolumesTestJSON-368222462 None] Lock "cinder-8944c24b-0f7f-4bfc-86a9-3ec873675e0c-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:07:50 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-6a50134f-f281-4bfe-aab3-f4605453c763 tempest-VolumesTestJSON-368222462 None] Acquiring lock "cinder-quobyte-8944c24b-0f7f-4bfc-86a9-3ec873675e0c" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:07:50 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-6a50134f-f281-4bfe-aab3-f4605453c763 tempest-VolumesTestJSON-368222462 None] Lock "cinder-quobyte-8944c24b-0f7f-4bfc-86a9-3ec873675e0c" acquired by "delete_volume" :: waited 0.009s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:07:50 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[65fb0ee3-a4ef-4a5f-acb7-c8ac2423d245]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:07:50 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6a50134f-f281-4bfe-aab3-f4605453c763 tempest-VolumesTestJSON-368222462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8944c24b-0f7f-4bfc-86a9-3ec873675e0c {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:51 devstack sudo[85752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8944c24b-0f7f-4bfc-86a9-3ec873675e0c
Apr 15 20:07:51 devstack sudo[85752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:51 devstack sudo[85750]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:51 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-ac3fa4db-f2de-417b-8649-0983f1ab15a1 tempest-GroupSnapshotsTest-234173950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e9a78a90-ff5f-423c-9c0d-ec56a1d14629 1073741824" returned: 0 in 0.645s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:51 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-ac3fa4db-f2de-417b-8649-0983f1ab15a1 tempest-GroupSnapshotsTest-234173950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e9a78a90-ff5f-423c-9c0d-ec56a1d14629 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:51 devstack sudo[85758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e9a78a90-ff5f-423c-9c0d-ec56a1d14629
Apr 15 20:07:51 devstack sudo[85758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:51 devstack sudo[85752]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:51 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6a50134f-f281-4bfe-aab3-f4605453c763 tempest-VolumesTestJSON-368222462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8944c24b-0f7f-4bfc-86a9-3ec873675e0c" returned: 0 in 0.706s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:51 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6a50134f-f281-4bfe-aab3-f4605453c763 tempest-VolumesTestJSON-368222462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8944c24b-0f7f-4bfc-86a9-3ec873675e0c {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:51 devstack sudo[85763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8944c24b-0f7f-4bfc-86a9-3ec873675e0c
Apr 15 20:07:51 devstack sudo[85763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:52 devstack sudo[85758]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:52 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-ac3fa4db-f2de-417b-8649-0983f1ab15a1 tempest-GroupSnapshotsTest-234173950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e9a78a90-ff5f-423c-9c0d-ec56a1d14629" returned: 0 in 0.672s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:52 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-ac3fa4db-f2de-417b-8649-0983f1ab15a1 tempest-GroupSnapshotsTest-234173950 None] <== create_volume: return (1353ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:07:52 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-ac3fa4db-f2de-417b-8649-0983f1ab15a1 tempest-GroupSnapshotsTest-234173950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.356s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:07:52 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ac3fa4db-f2de-417b-8649-0983f1ab15a1 tempest-GroupSnapshotsTest-234173950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8d05ca7-8c74-4d04-af84-6aac324cf3c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9a78a90-ff5f-423c-9c0d-ec56a1d14629', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:52 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ac3fa4db-f2de-417b-8649-0983f1ab15a1 tempest-GroupSnapshotsTest-234173950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0914cf0d-d626-4b24-bfb2-f46ba814e18c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:52 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-ac3fa4db-f2de-417b-8649-0983f1ab15a1 tempest-GroupSnapshotsTest-234173950 None] Volume volume-e9a78a90-ff5f-423c-9c0d-ec56a1d14629 (e9a78a90-ff5f-423c-9c0d-ec56a1d14629): created successfully
Apr 15 20:07:52 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ac3fa4db-f2de-417b-8649-0983f1ab15a1 tempest-GroupSnapshotsTest-234173950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0914cf0d-d626-4b24-bfb2-f46ba814e18c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:52 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ac3fa4db-f2de-417b-8649-0983f1ab15a1 tempest-GroupSnapshotsTest-234173950 None] Flow 'volume_create_manager' (50d3fed3-e064-47d2-b61c-8b6d55bc8ad7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:07:52 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-ac3fa4db-f2de-417b-8649-0983f1ab15a1 tempest-GroupSnapshotsTest-234173950 None] Created volume successfully.
Apr 15 20:07:52 devstack sudo[85763]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:52 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6a50134f-f281-4bfe-aab3-f4605453c763 tempest-VolumesTestJSON-368222462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8944c24b-0f7f-4bfc-86a9-3ec873675e0c" returned: 0 in 0.596s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:52 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-6a50134f-f281-4bfe-aab3-f4605453c763 tempest-VolumesTestJSON-368222462 None] Lock "cinder-quobyte-8944c24b-0f7f-4bfc-86a9-3ec873675e0c" released by "delete_volume" :: held 1.336s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:07:52 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-6a50134f-f281-4bfe-aab3-f4605453c763 tempest-VolumesTestJSON-368222462 None] Created reservations ['acd0f5d4-d2ce-4e6d-862a-28f893359e1d', 'cc2fdd5b-7af3-4ce9-835a-0b300608cbf0', '891d2c6e-5a4d-4450-9a4d-58014b98e2c0', '8f9d21da-3d63-49d6-b3e7-f70c3301668f'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:07:52 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-6a50134f-f281-4bfe-aab3-f4605453c763 tempest-VolumesTestJSON-368222462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:07:52 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-6a50134f-f281-4bfe-aab3-f4605453c763 tempest-VolumesTestJSON-368222462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:07:52 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-6a50134f-f281-4bfe-aab3-f4605453c763 tempest-VolumesTestJSON-368222462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:07:52 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-6a50134f-f281-4bfe-aab3-f4605453c763 tempest-VolumesTestJSON-368222462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:07:52 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-6a50134f-f281-4bfe-aab3-f4605453c763 tempest-VolumesTestJSON-368222462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:07:52 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6a50134f-f281-4bfe-aab3-f4605453c763 tempest-VolumesTestJSON-368222462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:52 devstack sudo[85770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:07:52 devstack sudo[85770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:52 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-d9779638-2f47-4d28-bd4b-05986e8cae39 tempest-GroupSnapshotsTest-234173950 None] Update group completed successfully.
Apr 15 20:07:52 devstack sudo[85770]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:52 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6a50134f-f281-4bfe-aab3-f4605453c763 tempest-VolumesTestJSON-368222462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.522s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:52 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-6a50134f-f281-4bfe-aab3-f4605453c763 tempest-VolumesTestJSON-368222462 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:07:52 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-6a50134f-f281-4bfe-aab3-f4605453c763 tempest-VolumesTestJSON-368222462 None] Deleted volume successfully.
Apr 15 20:07:52 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-6a50134f-f281-4bfe-aab3-f4605453c763 tempest-VolumesTestJSON-368222462 None] Lock "cinder-8944c24b-0f7f-4bfc-86a9-3ec873675e0c-delete_volume" released by "delete_volume" :: held 2.042s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:07:54 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-2451cb11-b186-48bf-ab80-c43bb06d80e7 tempest-GroupSnapshotsTest-234173950 None] Update group completed successfully.
Apr 15 20:07:55 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-4d2c7569-1ec5-496d-b0e0-ce9770ac5c7f tempest-GroupSnapshotsTest-234173950 None] Update group completed successfully.
Apr 15 20:07:56 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-984ba0c7-783a-499d-b6ae-39d605c4a963 tempest-SnapshotsActionsTest-1942023327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:07:56 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-984ba0c7-783a-499d-b6ae-39d605c4a963 tempest-SnapshotsActionsTest-1942023327 None] Flow 'volume_create_manager' (50b612e2-6e75-439c-8ab8-d7d9c3711bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:07:56 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-984ba0c7-783a-499d-b6ae-39d605c4a963 tempest-SnapshotsActionsTest-1942023327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e167ebe-a911-4e50-879b-b530a0a0a353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:56 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-984ba0c7-783a-499d-b6ae-39d605c4a963 tempest-SnapshotsActionsTest-1942023327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e167ebe-a911-4e50-879b-b530a0a0a353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:07:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1866764940',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=652eb0f7-c5d0-4af1-a426-b00a9f1393fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47883ec26b6f44d2b9af08f4bcc1c7d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:07:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:07:56Z,use_quota=True,user_id='c14373f7b0964b939aecc5ed4611354b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:56 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-984ba0c7-783a-499d-b6ae-39d605c4a963 tempest-SnapshotsActionsTest-1942023327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f24183a-5ffc-49de-8d18-8247fb64d0a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:56 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-984ba0c7-783a-499d-b6ae-39d605c4a963 tempest-SnapshotsActionsTest-1942023327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f24183a-5ffc-49de-8d18-8247fb64d0a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:56 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-984ba0c7-783a-499d-b6ae-39d605c4a963 tempest-SnapshotsActionsTest-1942023327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d2eee41-1437-4aa8-a00e-593c2700d7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:56 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-984ba0c7-783a-499d-b6ae-39d605c4a963 tempest-SnapshotsActionsTest-1942023327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d2eee41-1437-4aa8-a00e-593c2700d7fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '652eb0f7-c5d0-4af1-a426-b00a9f1393fe', 'volume_name': 'volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:56 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-984ba0c7-783a-499d-b6ae-39d605c4a963 tempest-SnapshotsActionsTest-1942023327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7d56198-4c16-4eb1-839d-9129ed332018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:56 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-984ba0c7-783a-499d-b6ae-39d605c4a963 tempest-SnapshotsActionsTest-1942023327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7d56198-4c16-4eb1-839d-9129ed332018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:56 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-984ba0c7-783a-499d-b6ae-39d605c4a963 tempest-SnapshotsActionsTest-1942023327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff6e3164-fbe6-4c2e-9291-c73724969aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:56 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-984ba0c7-783a-499d-b6ae-39d605c4a963 tempest-SnapshotsActionsTest-1942023327 None] Volume 652eb0f7-c5d0-4af1-a426-b00a9f1393fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe', 'volume_size': 1}
Apr 15 20:07:56 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-984ba0c7-783a-499d-b6ae-39d605c4a963 tempest-SnapshotsActionsTest-1942023327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:07:56 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-984ba0c7-783a-499d-b6ae-39d605c4a963 tempest-SnapshotsActionsTest-1942023327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:07:56 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-984ba0c7-783a-499d-b6ae-39d605c4a963 tempest-SnapshotsActionsTest-1942023327 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:07:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1866764940',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=652eb0f7-c5d0-4af1-a426-b00a9f1393fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47883ec26b6f44d2b9af08f4bcc1c7d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:07:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:07:56Z,use_quota=True,user_id='c14373f7b0964b939aecc5ed4611354b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:07:56 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-984ba0c7-783a-499d-b6ae-39d605c4a963 tempest-SnapshotsActionsTest-1942023327 None] Creating volume 652eb0f7-c5d0-4af1-a426-b00a9f1393fe {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:07:56 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-984ba0c7-783a-499d-b6ae-39d605c4a963 tempest-SnapshotsActionsTest-1942023327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:07:56 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-984ba0c7-783a-499d-b6ae-39d605c4a963 tempest-SnapshotsActionsTest-1942023327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:07:56 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-984ba0c7-783a-499d-b6ae-39d605c4a963 tempest-SnapshotsActionsTest-1942023327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:07:56 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-984ba0c7-783a-499d-b6ae-39d605c4a963 tempest-SnapshotsActionsTest-1942023327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:07:56 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-984ba0c7-783a-499d-b6ae-39d605c4a963 tempest-SnapshotsActionsTest-1942023327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:07:56 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-984ba0c7-783a-499d-b6ae-39d605c4a963 tempest-SnapshotsActionsTest-1942023327 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:07:56 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-984ba0c7-783a-499d-b6ae-39d605c4a963 tempest-SnapshotsActionsTest-1942023327 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:07:56 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-984ba0c7-783a-499d-b6ae-39d605c4a963 tempest-SnapshotsActionsTest-1942023327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:56 devstack sudo[85823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe 1073741824
Apr 15 20:07:56 devstack sudo[85823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:56 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-a2d74130-8997-4e5d-903e-d29f00d5c7b3 tempest-GroupSnapshotsTest-234173950 None] Update group completed successfully.
Apr 15 20:07:57 devstack sudo[85823]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:57 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-984ba0c7-783a-499d-b6ae-39d605c4a963 tempest-SnapshotsActionsTest-1942023327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe 1073741824" returned: 0 in 0.684s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:57 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-984ba0c7-783a-499d-b6ae-39d605c4a963 tempest-SnapshotsActionsTest-1942023327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:57 devstack sudo[85852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe
Apr 15 20:07:57 devstack sudo[85852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:57 devstack sudo[85852]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:57 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-984ba0c7-783a-499d-b6ae-39d605c4a963 tempest-SnapshotsActionsTest-1942023327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe" returned: 0 in 0.582s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:57 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-984ba0c7-783a-499d-b6ae-39d605c4a963 tempest-SnapshotsActionsTest-1942023327 None] <== create_volume: return (1293ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:07:57 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-984ba0c7-783a-499d-b6ae-39d605c4a963 tempest-SnapshotsActionsTest-1942023327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.295s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:07:57 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-984ba0c7-783a-499d-b6ae-39d605c4a963 tempest-SnapshotsActionsTest-1942023327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff6e3164-fbe6-4c2e-9291-c73724969aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:57 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-984ba0c7-783a-499d-b6ae-39d605c4a963 tempest-SnapshotsActionsTest-1942023327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (892df6c7-dbd2-4455-818d-d2e913203b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:07:57 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-984ba0c7-783a-499d-b6ae-39d605c4a963 tempest-SnapshotsActionsTest-1942023327 None] Volume volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe (652eb0f7-c5d0-4af1-a426-b00a9f1393fe): created successfully
Apr 15 20:07:57 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-984ba0c7-783a-499d-b6ae-39d605c4a963 tempest-SnapshotsActionsTest-1942023327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (892df6c7-dbd2-4455-818d-d2e913203b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:07:57 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-984ba0c7-783a-499d-b6ae-39d605c4a963 tempest-SnapshotsActionsTest-1942023327 None] Flow 'volume_create_manager' (50b612e2-6e75-439c-8ab8-d7d9c3711bb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:07:57 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-984ba0c7-783a-499d-b6ae-39d605c4a963 tempest-SnapshotsActionsTest-1942023327 None] Created volume successfully.
Apr 15 20:07:57 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-e9755c72-9446-4f05-8ec7-f4beebaa2591 tempest-GroupSnapshotsTest-234173950 None] GroupSnapshot caa1f56f-3d00-41d7-9a92-600353047ccf: creating.
Apr 15 20:07:57 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e9755c72-9446-4f05-8ec7-f4beebaa2591 tempest-GroupSnapshotsTest-234173950 None] Group snapshot caa1f56f-3d00-41d7-9a92-600353047ccf: creating. {{(pid=82646) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 15 20:07:58 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-e9755c72-9446-4f05-8ec7-f4beebaa2591 tempest-GroupSnapshotsTest-234173950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:07:58 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-e9755c72-9446-4f05-8ec7-f4beebaa2591 tempest-GroupSnapshotsTest-234173950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:07:58 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-e9755c72-9446-4f05-8ec7-f4beebaa2591 tempest-GroupSnapshotsTest-234173950 None] Creating offline snapshot 57b54e1f-6e86-409c-9a9e-187f8ce8db05 of volume e9a78a90-ff5f-423c-9c0d-ec56a1d14629 {{(pid=82646) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 20:07:58 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de670ff-85f0-4883-8530-942758fab9c3]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:07:58 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e9755c72-9446-4f05-8ec7-f4beebaa2591 tempest-GroupSnapshotsTest-234173950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e9a78a90-ff5f-423c-9c0d-ec56a1d14629 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:58 devstack sudo[85859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e9a78a90-ff5f-423c-9c0d-ec56a1d14629
Apr 15 20:07:58 devstack sudo[85859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:58 devstack sudo[85859]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:58 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e9755c72-9446-4f05-8ec7-f4beebaa2591 tempest-GroupSnapshotsTest-234173950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e9a78a90-ff5f-423c-9c0d-ec56a1d14629" returned: 0 in 0.656s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:58 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e9755c72-9446-4f05-8ec7-f4beebaa2591 tempest-GroupSnapshotsTest-234173950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e9a78a90-ff5f-423c-9c0d-ec56a1d14629,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e9a78a90-ff5f-423c-9c0d-ec56a1d14629.57b54e1f-6e86-409c-9a9e-187f8ce8db05 1G {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:58 devstack sudo[85867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e9a78a90-ff5f-423c-9c0d-ec56a1d14629,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e9a78a90-ff5f-423c-9c0d-ec56a1d14629.57b54e1f-6e86-409c-9a9e-187f8ce8db05 1G
Apr 15 20:07:58 devstack sudo[85867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:58 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-25370e8c-c5e8-474b-826f-98948526f55c tempest-SnapshotsActionsTest-1942023327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:07:59 devstack sudo[85867]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:59 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e9755c72-9446-4f05-8ec7-f4beebaa2591 tempest-GroupSnapshotsTest-234173950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e9a78a90-ff5f-423c-9c0d-ec56a1d14629,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e9a78a90-ff5f-423c-9c0d-ec56a1d14629.57b54e1f-6e86-409c-9a9e-187f8ce8db05 1G" returned: 0 in 0.651s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:59 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e9755c72-9446-4f05-8ec7-f4beebaa2591 tempest-GroupSnapshotsTest-234173950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9a78a90-ff5f-423c-9c0d-ec56a1d14629 -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e9a78a90-ff5f-423c-9c0d-ec56a1d14629.57b54e1f-6e86-409c-9a9e-187f8ce8db05 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:59 devstack sudo[85890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9a78a90-ff5f-423c-9c0d-ec56a1d14629 -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e9a78a90-ff5f-423c-9c0d-ec56a1d14629.57b54e1f-6e86-409c-9a9e-187f8ce8db05
Apr 15 20:07:59 devstack sudo[85890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:07:59 devstack cinder-volume[82646]: INFO cinder.volume.manager [req-b032988f-846a-47f4-8277-2bce4a9951eb req-47469671-5a56-4321-81c0-324e32028f93 tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Terminate volume connection completed successfully.
Apr 15 20:07:59 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [req-b032988f-846a-47f4-8277-2bce4a9951eb req-47469671-5a56-4321-81c0-324e32028f93 tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Deleting attachment e516e01e-7738-49f1-ae41-3e71adc90b0a. {{(pid=82646) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 15 20:07:59 devstack sudo[85890]: pam_unix(sudo:session): session closed for user root
Apr 15 20:07:59 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e9755c72-9446-4f05-8ec7-f4beebaa2591 tempest-GroupSnapshotsTest-234173950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9a78a90-ff5f-423c-9c0d-ec56a1d14629 -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e9a78a90-ff5f-423c-9c0d-ec56a1d14629.57b54e1f-6e86-409c-9a9e-187f8ce8db05" returned: 0 in 0.471s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:07:59 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-e9755c72-9446-4f05-8ec7-f4beebaa2591 tempest-GroupSnapshotsTest-234173950 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e9a78a90-ff5f-423c-9c0d-ec56a1d14629.57b54e1f-6e86-409c-9a9e-187f8ce8db05 is being set with open permissions: ugo+rw: NotImplementedError
Apr 15 20:07:59 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e9755c72-9446-4f05-8ec7-f4beebaa2591 tempest-GroupSnapshotsTest-234173950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e9a78a90-ff5f-423c-9c0d-ec56a1d14629.57b54e1f-6e86-409c-9a9e-187f8ce8db05 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:07:59 devstack sudo[85895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e9a78a90-ff5f-423c-9c0d-ec56a1d14629.57b54e1f-6e86-409c-9a9e-187f8ce8db05
Apr 15 20:07:59 devstack sudo[85895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:00 devstack sudo[85895]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:00 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e9755c72-9446-4f05-8ec7-f4beebaa2591 tempest-GroupSnapshotsTest-234173950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e9a78a90-ff5f-423c-9c0d-ec56a1d14629.57b54e1f-6e86-409c-9a9e-187f8ce8db05" returned: 0 in 0.460s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:00 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e9755c72-9446-4f05-8ec7-f4beebaa2591 tempest-GroupSnapshotsTest-234173950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e9a78a90-ff5f-423c-9c0d-ec56a1d14629.info {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:00 devstack cinder-volume[82646]: DEBUG cinder.coordination [req-b032988f-846a-47f4-8277-2bce4a9951eb req-9a95d358-c982-44b4-8a6f-9aef7b4c923d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Acquiring lock "cinder-8341f71a-cabe-4251-8fe6-fa688c7e6371-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:08:00 devstack sudo[85899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e9a78a90-ff5f-423c-9c0d-ec56a1d14629.info
Apr 15 20:08:00 devstack sudo[85899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:00 devstack cinder-volume[82646]: DEBUG cinder.coordination [req-b032988f-846a-47f4-8277-2bce4a9951eb req-9a95d358-c982-44b4-8a6f-9aef7b4c923d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Lock "cinder-8341f71a-cabe-4251-8fe6-fa688c7e6371-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:08:00 devstack cinder-volume[82646]: DEBUG cinder.coordination [req-b032988f-846a-47f4-8277-2bce4a9951eb req-9a95d358-c982-44b4-8a6f-9aef7b4c923d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Acquiring lock "cinder-quobyte-8341f71a-cabe-4251-8fe6-fa688c7e6371" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:08:00 devstack cinder-volume[82646]: DEBUG cinder.coordination [req-b032988f-846a-47f4-8277-2bce4a9951eb req-9a95d358-c982-44b4-8a6f-9aef7b4c923d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Lock "cinder-quobyte-8341f71a-cabe-4251-8fe6-fa688c7e6371" acquired by "delete_volume" :: waited 0.014s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:08:00 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[d076f121-7299-4d75-8043-8c7bcf6e1cad]: (4, 'raw') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:08:00 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-b032988f-846a-47f4-8277-2bce4a9951eb req-9a95d358-c982-44b4-8a6f-9aef7b4c923d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8341f71a-cabe-4251-8fe6-fa688c7e6371 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:00 devstack sudo[85901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8341f71a-cabe-4251-8fe6-fa688c7e6371
Apr 15 20:08:00 devstack sudo[85901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:00 devstack sudo[85899]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:00 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e9755c72-9446-4f05-8ec7-f4beebaa2591 tempest-GroupSnapshotsTest-234173950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e9a78a90-ff5f-423c-9c0d-ec56a1d14629.info" returned: 0 in 0.605s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:00 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-e9755c72-9446-4f05-8ec7-f4beebaa2591 tempest-GroupSnapshotsTest-234173950 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e9a78a90-ff5f-423c-9c0d-ec56a1d14629.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 15 20:08:00 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e9755c72-9446-4f05-8ec7-f4beebaa2591 tempest-GroupSnapshotsTest-234173950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e9a78a90-ff5f-423c-9c0d-ec56a1d14629.info {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:00 devstack sudo[85906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e9a78a90-ff5f-423c-9c0d-ec56a1d14629.info
Apr 15 20:08:00 devstack sudo[85906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:01 devstack sudo[85901]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:01 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-b032988f-846a-47f4-8277-2bce4a9951eb req-9a95d358-c982-44b4-8a6f-9aef7b4c923d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8341f71a-cabe-4251-8fe6-fa688c7e6371" returned: 0 in 0.601s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:01 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-b032988f-846a-47f4-8277-2bce4a9951eb req-9a95d358-c982-44b4-8a6f-9aef7b4c923d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8341f71a-cabe-4251-8fe6-fa688c7e6371 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:01 devstack sudo[85908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8341f71a-cabe-4251-8fe6-fa688c7e6371
Apr 15 20:08:01 devstack sudo[85908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:01 devstack sudo[85906]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:01 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e9755c72-9446-4f05-8ec7-f4beebaa2591 tempest-GroupSnapshotsTest-234173950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e9a78a90-ff5f-423c-9c0d-ec56a1d14629.info" returned: 0 in 0.538s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:01 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-e9755c72-9446-4f05-8ec7-f4beebaa2591 tempest-GroupSnapshotsTest-234173950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.446s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:08:01 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-e9755c72-9446-4f05-8ec7-f4beebaa2591 tempest-GroupSnapshotsTest-234173950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:08:01 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-e9755c72-9446-4f05-8ec7-f4beebaa2591 tempest-GroupSnapshotsTest-234173950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:08:01 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-e9755c72-9446-4f05-8ec7-f4beebaa2591 tempest-GroupSnapshotsTest-234173950 None] Creating offline snapshot f3163727-c495-4547-a0f3-acd75ef01c8c of volume e0172e8a-c625-4092-bbbf-c0de807bfb86 {{(pid=82646) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 20:08:01 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb80293-3dc2-4337-a4f1-77aa1b778646]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:08:01 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e9755c72-9446-4f05-8ec7-f4beebaa2591 tempest-GroupSnapshotsTest-234173950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e0172e8a-c625-4092-bbbf-c0de807bfb86 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:01 devstack sudo[85908]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:01 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-b032988f-846a-47f4-8277-2bce4a9951eb req-9a95d358-c982-44b4-8a6f-9aef7b4c923d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8341f71a-cabe-4251-8fe6-fa688c7e6371" returned: 1 in 0.544s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:01 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-b032988f-846a-47f4-8277-2bce4a9951eb req-9a95d358-c982-44b4-8a6f-9aef7b4c923d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8341f71a-cabe-4251-8fe6-fa688c7e6371' failed. Not Retrying. {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 20:08:01 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-b032988f-846a-47f4-8277-2bce4a9951eb req-9a95d358-c982-44b4-8a6f-9aef7b4c923d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8341f71a-cabe-4251-8fe6-fa688c7e6371 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:01 devstack sudo[85914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e0172e8a-c625-4092-bbbf-c0de807bfb86
Apr 15 20:08:01 devstack sudo[85914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:01 devstack sudo[85915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8341f71a-cabe-4251-8fe6-fa688c7e6371
Apr 15 20:08:01 devstack sudo[85915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:02 devstack sudo[85915]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:02 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-b032988f-846a-47f4-8277-2bce4a9951eb req-9a95d358-c982-44b4-8a6f-9aef7b4c923d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8341f71a-cabe-4251-8fe6-fa688c7e6371" returned: 0 in 0.528s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:02 devstack cinder-volume[82646]: DEBUG cinder.coordination [req-b032988f-846a-47f4-8277-2bce4a9951eb req-9a95d358-c982-44b4-8a6f-9aef7b4c923d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Lock "cinder-quobyte-8341f71a-cabe-4251-8fe6-fa688c7e6371" released by "delete_volume" :: held 1.731s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:08:02 devstack sudo[85914]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:02 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e9755c72-9446-4f05-8ec7-f4beebaa2591 tempest-GroupSnapshotsTest-234173950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e0172e8a-c625-4092-bbbf-c0de807bfb86" returned: 0 in 0.665s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:02 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e9755c72-9446-4f05-8ec7-f4beebaa2591 tempest-GroupSnapshotsTest-234173950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e0172e8a-c625-4092-bbbf-c0de807bfb86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e0172e8a-c625-4092-bbbf-c0de807bfb86.f3163727-c495-4547-a0f3-acd75ef01c8c 1G {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:02 devstack sudo[85925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e0172e8a-c625-4092-bbbf-c0de807bfb86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e0172e8a-c625-4092-bbbf-c0de807bfb86.f3163727-c495-4547-a0f3-acd75ef01c8c 1G
Apr 15 20:08:02 devstack sudo[85925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:02 devstack cinder-volume[82646]: DEBUG cinder.quota [req-b032988f-846a-47f4-8277-2bce4a9951eb req-9a95d358-c982-44b4-8a6f-9aef7b4c923d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Created reservations ['fa29dc82-1162-42fc-8a3d-e76c945df1e6', '265eb967-fb7b-4f92-8dcb-c81bec773789', 'c1082b7c-e017-4e96-ae48-958e10fed724', 'fb38c292-1b95-46d6-851a-30d0c20be2d2'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:08:02 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [req-b032988f-846a-47f4-8277-2bce4a9951eb req-9a95d358-c982-44b4-8a6f-9aef7b4c923d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:08:02 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [req-b032988f-846a-47f4-8277-2bce4a9951eb req-9a95d358-c982-44b4-8a6f-9aef7b4c923d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:08:02 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [req-b032988f-846a-47f4-8277-2bce4a9951eb req-9a95d358-c982-44b4-8a6f-9aef7b4c923d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:08:02 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [req-b032988f-846a-47f4-8277-2bce4a9951eb req-9a95d358-c982-44b4-8a6f-9aef7b4c923d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:08:02 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [req-b032988f-846a-47f4-8277-2bce4a9951eb req-9a95d358-c982-44b4-8a6f-9aef7b4c923d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:08:02 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-b032988f-846a-47f4-8277-2bce4a9951eb req-9a95d358-c982-44b4-8a6f-9aef7b4c923d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:02 devstack sudo[85927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:08:02 devstack sudo[85927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:02 devstack sudo[85927]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:02 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-b032988f-846a-47f4-8277-2bce4a9951eb req-9a95d358-c982-44b4-8a6f-9aef7b4c923d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.472s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:02 devstack cinder-volume[82646]: DEBUG cinder.manager [req-b032988f-846a-47f4-8277-2bce4a9951eb req-9a95d358-c982-44b4-8a6f-9aef7b4c923d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:08:02 devstack cinder-volume[82646]: INFO cinder.volume.manager [req-b032988f-846a-47f4-8277-2bce4a9951eb req-9a95d358-c982-44b4-8a6f-9aef7b4c923d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Deleted volume successfully.
Apr 15 20:08:02 devstack sudo[85925]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:02 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e9755c72-9446-4f05-8ec7-f4beebaa2591 tempest-GroupSnapshotsTest-234173950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e0172e8a-c625-4092-bbbf-c0de807bfb86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e0172e8a-c625-4092-bbbf-c0de807bfb86.f3163727-c495-4547-a0f3-acd75ef01c8c 1G" returned: 0 in 0.560s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:02 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e9755c72-9446-4f05-8ec7-f4beebaa2591 tempest-GroupSnapshotsTest-234173950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0172e8a-c625-4092-bbbf-c0de807bfb86 -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e0172e8a-c625-4092-bbbf-c0de807bfb86.f3163727-c495-4547-a0f3-acd75ef01c8c {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:02 devstack cinder-volume[82646]: DEBUG cinder.coordination [req-b032988f-846a-47f4-8277-2bce4a9951eb req-9a95d358-c982-44b4-8a6f-9aef7b4c923d tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Lock "cinder-8341f71a-cabe-4251-8fe6-fa688c7e6371-delete_volume" released by "delete_volume" :: held 2.388s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:08:02 devstack sudo[85933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0172e8a-c625-4092-bbbf-c0de807bfb86 -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e0172e8a-c625-4092-bbbf-c0de807bfb86.f3163727-c495-4547-a0f3-acd75ef01c8c
Apr 15 20:08:02 devstack sudo[85933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:03 devstack sudo[85933]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:03 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e9755c72-9446-4f05-8ec7-f4beebaa2591 tempest-GroupSnapshotsTest-234173950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0172e8a-c625-4092-bbbf-c0de807bfb86 -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e0172e8a-c625-4092-bbbf-c0de807bfb86.f3163727-c495-4547-a0f3-acd75ef01c8c" returned: 0 in 0.539s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:03 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-e9755c72-9446-4f05-8ec7-f4beebaa2591 tempest-GroupSnapshotsTest-234173950 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e0172e8a-c625-4092-bbbf-c0de807bfb86.f3163727-c495-4547-a0f3-acd75ef01c8c is being set with open permissions: ugo+rw: NotImplementedError
Apr 15 20:08:03 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e9755c72-9446-4f05-8ec7-f4beebaa2591 tempest-GroupSnapshotsTest-234173950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e0172e8a-c625-4092-bbbf-c0de807bfb86.f3163727-c495-4547-a0f3-acd75ef01c8c {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:03 devstack sudo[85958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e0172e8a-c625-4092-bbbf-c0de807bfb86.f3163727-c495-4547-a0f3-acd75ef01c8c
Apr 15 20:08:03 devstack sudo[85958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:03 devstack sudo[85958]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:03 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e9755c72-9446-4f05-8ec7-f4beebaa2591 tempest-GroupSnapshotsTest-234173950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e0172e8a-c625-4092-bbbf-c0de807bfb86.f3163727-c495-4547-a0f3-acd75ef01c8c" returned: 0 in 0.527s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:03 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e9755c72-9446-4f05-8ec7-f4beebaa2591 tempest-GroupSnapshotsTest-234173950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e0172e8a-c625-4092-bbbf-c0de807bfb86.info {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:03 devstack sudo[85969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e0172e8a-c625-4092-bbbf-c0de807bfb86.info
Apr 15 20:08:03 devstack sudo[85969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:04 devstack sudo[85969]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:04 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e9755c72-9446-4f05-8ec7-f4beebaa2591 tempest-GroupSnapshotsTest-234173950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e0172e8a-c625-4092-bbbf-c0de807bfb86.info" returned: 0 in 0.481s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:04 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-e9755c72-9446-4f05-8ec7-f4beebaa2591 tempest-GroupSnapshotsTest-234173950 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e0172e8a-c625-4092-bbbf-c0de807bfb86.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 15 20:08:04 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e9755c72-9446-4f05-8ec7-f4beebaa2591 tempest-GroupSnapshotsTest-234173950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e0172e8a-c625-4092-bbbf-c0de807bfb86.info {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:04 devstack sudo[85974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e0172e8a-c625-4092-bbbf-c0de807bfb86.info
Apr 15 20:08:04 devstack sudo[85974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:04 devstack sudo[85974]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:04 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e9755c72-9446-4f05-8ec7-f4beebaa2591 tempest-GroupSnapshotsTest-234173950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e0172e8a-c625-4092-bbbf-c0de807bfb86.info" returned: 0 in 0.444s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:04 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-e9755c72-9446-4f05-8ec7-f4beebaa2591 tempest-GroupSnapshotsTest-234173950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.315s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:08:04 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-25370e8c-c5e8-474b-826f-98948526f55c tempest-SnapshotsActionsTest-1942023327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:08:04 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-25370e8c-c5e8-474b-826f-98948526f55c tempest-SnapshotsActionsTest-1942023327 None] Creating offline snapshot c4230ee4-7827-436a-9552-81aadcb1de1e of volume 652eb0f7-c5d0-4af1-a426-b00a9f1393fe {{(pid=82646) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 20:08:04 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb03cdd-284b-487b-a775-344f1713370e]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:08:04 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-25370e8c-c5e8-474b-826f-98948526f55c tempest-SnapshotsActionsTest-1942023327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:04 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-e9755c72-9446-4f05-8ec7-f4beebaa2591 tempest-GroupSnapshotsTest-234173950 None] group_snapshot caa1f56f-3d00-41d7-9a92-600353047ccf: created successfully
Apr 15 20:08:04 devstack sudo[85981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe
Apr 15 20:08:04 devstack sudo[85981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:05 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-6fc7f06f-c1af-465b-b7ee-4a91b13417c2 tempest-GroupSnapshotsTest-234173950 None] group_snapshot caa1f56f-3d00-41d7-9a92-600353047ccf: deleting
Apr 15 20:08:05 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-6fc7f06f-c1af-465b-b7ee-4a91b13417c2 tempest-GroupSnapshotsTest-234173950 None] group_snapshot caa1f56f-3d00-41d7-9a92-600353047ccf: deleting {{(pid=82646) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 15 20:08:05 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-6fc7f06f-c1af-465b-b7ee-4a91b13417c2 tempest-GroupSnapshotsTest-234173950 None] Acquiring lock "cinder-quobyte-e9a78a90-ff5f-423c-9c0d-ec56a1d14629" by "delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:08:05 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-ad3fdfb7-dda9-4765-bcce-541471756887 tempest-VolumesActionsTest-1120257978 None] Acquiring lock "cinder-684c024b-5c7b-4580-9ec4-2a4f0786e6a3" by "attach_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:08:05 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-6fc7f06f-c1af-465b-b7ee-4a91b13417c2 tempest-GroupSnapshotsTest-234173950 None] Lock "cinder-quobyte-e9a78a90-ff5f-423c-9c0d-ec56a1d14629" acquired by "delete_snapshot" :: waited 0.021s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:08:05 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-6fc7f06f-c1af-465b-b7ee-4a91b13417c2 tempest-GroupSnapshotsTest-234173950 None] Acquiring lock "cinder-quobyte-57b54e1f-6e86-409c-9a9e-187f8ce8db05" by "_delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:08:05 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-ad3fdfb7-dda9-4765-bcce-541471756887 tempest-VolumesActionsTest-1120257978 None] Lock "cinder-684c024b-5c7b-4580-9ec4-2a4f0786e6a3" acquired by "attach_volume" :: waited 0.019s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:08:05 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-6fc7f06f-c1af-465b-b7ee-4a91b13417c2 tempest-GroupSnapshotsTest-234173950 None] Lock "cinder-quobyte-57b54e1f-6e86-409c-9a9e-187f8ce8db05" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:08:05 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-6fc7f06f-c1af-465b-b7ee-4a91b13417c2 tempest-GroupSnapshotsTest-234173950 None] Deleting offline snapshot 57b54e1f-6e86-409c-9a9e-187f8ce8db05 of volume e9a78a90-ff5f-423c-9c0d-ec56a1d14629 {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 20:08:05 devstack sudo[85981]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:05 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-6fc7f06f-c1af-465b-b7ee-4a91b13417c2 tempest-GroupSnapshotsTest-234173950 None] snapshot_file for this snap is: volume-e9a78a90-ff5f-423c-9c0d-ec56a1d14629.57b54e1f-6e86-409c-9a9e-187f8ce8db05 {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 20:08:05 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-25370e8c-c5e8-474b-826f-98948526f55c tempest-SnapshotsActionsTest-1942023327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe" returned: 0 in 0.910s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:05 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-25370e8c-c5e8-474b-826f-98948526f55c tempest-SnapshotsActionsTest-1942023327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.c4230ee4-7827-436a-9552-81aadcb1de1e 1G {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:05 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a423f4-7958-407a-8014-219ee184791a]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:08:05 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6fc7f06f-c1af-465b-b7ee-4a91b13417c2 tempest-GroupSnapshotsTest-234173950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e9a78a90-ff5f-423c-9c0d-ec56a1d14629.57b54e1f-6e86-409c-9a9e-187f8ce8db05 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:05 devstack sudo[86007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.c4230ee4-7827-436a-9552-81aadcb1de1e 1G
Apr 15 20:08:05 devstack sudo[86007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:05 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-ad3fdfb7-dda9-4765-bcce-541471756887 tempest-VolumesActionsTest-1120257978 None] Attaching volume 684c024b-5c7b-4580-9ec4-2a4f0786e6a3 to instance c166df10-60ca-48dd-967c-246cc7e7ce7d at mountpoint /dev/vdb on host None.
Apr 15 20:08:05 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-ad3fdfb7-dda9-4765-bcce-541471756887 tempest-VolumesActionsTest-1120257978 None] Attach volume completed successfully.
Apr 15 20:08:05 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-ad3fdfb7-dda9-4765-bcce-541471756887 tempest-VolumesActionsTest-1120257978 None] Lock "cinder-684c024b-5c7b-4580-9ec4-2a4f0786e6a3" released by "attach_volume" :: held 0.180s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:08:05 devstack sudo[86008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e9a78a90-ff5f-423c-9c0d-ec56a1d14629.57b54e1f-6e86-409c-9a9e-187f8ce8db05
Apr 15 20:08:05 devstack sudo[86008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:06 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-50db9559-89cf-4482-983f-0887bc5aa7c5 tempest-VolumesActionsTest-1120257978 None] Acquiring lock "cinder-684c024b-5c7b-4580-9ec4-2a4f0786e6a3-detach_volume" by "detach_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:08:06 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-50db9559-89cf-4482-983f-0887bc5aa7c5 tempest-VolumesActionsTest-1120257978 None] Lock "cinder-684c024b-5c7b-4580-9ec4-2a4f0786e6a3-detach_volume" acquired by "detach_volume" :: waited 0.013s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:08:06 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-50db9559-89cf-4482-983f-0887bc5aa7c5 tempest-VolumesActionsTest-1120257978 None] Detaching volume 684c024b-5c7b-4580-9ec4-2a4f0786e6a3 from instance c166df10-60ca-48dd-967c-246cc7e7ce7d.
Apr 15 20:08:06 devstack sudo[86007]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:06 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-50db9559-89cf-4482-983f-0887bc5aa7c5 tempest-VolumesActionsTest-1120257978 None] Detach volume completed successfully.
Apr 15 20:08:06 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-25370e8c-c5e8-474b-826f-98948526f55c tempest-SnapshotsActionsTest-1942023327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.c4230ee4-7827-436a-9552-81aadcb1de1e 1G" returned: 0 in 0.585s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:06 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-25370e8c-c5e8-474b-826f-98948526f55c tempest-SnapshotsActionsTest-1942023327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.c4230ee4-7827-436a-9552-81aadcb1de1e {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:06 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-50db9559-89cf-4482-983f-0887bc5aa7c5 tempest-VolumesActionsTest-1120257978 None] Lock "cinder-684c024b-5c7b-4580-9ec4-2a4f0786e6a3-detach_volume" released by "detach_volume" :: held 0.095s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:08:06 devstack sudo[86019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.c4230ee4-7827-436a-9552-81aadcb1de1e
Apr 15 20:08:06 devstack sudo[86019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:06 devstack sudo[86008]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:06 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6fc7f06f-c1af-465b-b7ee-4a91b13417c2 tempest-GroupSnapshotsTest-234173950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e9a78a90-ff5f-423c-9c0d-ec56a1d14629.57b54e1f-6e86-409c-9a9e-187f8ce8db05" returned: 0 in 0.627s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:06 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-6fc7f06f-c1af-465b-b7ee-4a91b13417c2 tempest-GroupSnapshotsTest-234173950 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9a78a90-ff5f-423c-9c0d-ec56a1d14629(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82646) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 20:08:06 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c1d9c8-db8d-4c60-ae5f-2f02813f6748]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:08:06 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6fc7f06f-c1af-465b-b7ee-4a91b13417c2 tempest-GroupSnapshotsTest-234173950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e9a78a90-ff5f-423c-9c0d-ec56a1d14629 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:06 devstack sudo[86021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e9a78a90-ff5f-423c-9c0d-ec56a1d14629
Apr 15 20:08:06 devstack sudo[86021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:06 devstack sudo[86019]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:06 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-25370e8c-c5e8-474b-826f-98948526f55c tempest-SnapshotsActionsTest-1942023327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.c4230ee4-7827-436a-9552-81aadcb1de1e" returned: 0 in 0.626s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:06 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-25370e8c-c5e8-474b-826f-98948526f55c tempest-SnapshotsActionsTest-1942023327 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.c4230ee4-7827-436a-9552-81aadcb1de1e is being set with open permissions: ugo+rw
Apr 15 20:08:06 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-25370e8c-c5e8-474b-826f-98948526f55c tempest-SnapshotsActionsTest-1942023327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.c4230ee4-7827-436a-9552-81aadcb1de1e {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:06 devstack sudo[86030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.c4230ee4-7827-436a-9552-81aadcb1de1e
Apr 15 20:08:06 devstack sudo[86030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:07 devstack sudo[86021]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:07 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6fc7f06f-c1af-465b-b7ee-4a91b13417c2 tempest-GroupSnapshotsTest-234173950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e9a78a90-ff5f-423c-9c0d-ec56a1d14629" returned: 0 in 0.728s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:07 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6fc7f06f-c1af-465b-b7ee-4a91b13417c2 tempest-GroupSnapshotsTest-234173950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e9a78a90-ff5f-423c-9c0d-ec56a1d14629.57b54e1f-6e86-409c-9a9e-187f8ce8db05 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:07 devstack sudo[86033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e9a78a90-ff5f-423c-9c0d-ec56a1d14629.57b54e1f-6e86-409c-9a9e-187f8ce8db05
Apr 15 20:08:07 devstack sudo[86033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:07 devstack sudo[86030]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:07 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-25370e8c-c5e8-474b-826f-98948526f55c tempest-SnapshotsActionsTest-1942023327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.c4230ee4-7827-436a-9552-81aadcb1de1e" returned: 0 in 0.432s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:07 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-25370e8c-c5e8-474b-826f-98948526f55c tempest-SnapshotsActionsTest-1942023327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.info {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:07 devstack sudo[86036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.info
Apr 15 20:08:07 devstack sudo[86036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:07 devstack sudo[86033]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:07 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6fc7f06f-c1af-465b-b7ee-4a91b13417c2 tempest-GroupSnapshotsTest-234173950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e9a78a90-ff5f-423c-9c0d-ec56a1d14629.57b54e1f-6e86-409c-9a9e-187f8ce8db05" returned: 0 in 0.470s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:07 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6fc7f06f-c1af-465b-b7ee-4a91b13417c2 tempest-GroupSnapshotsTest-234173950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e9a78a90-ff5f-423c-9c0d-ec56a1d14629.57b54e1f-6e86-409c-9a9e-187f8ce8db05 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:07 devstack sudo[86041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e9a78a90-ff5f-423c-9c0d-ec56a1d14629.57b54e1f-6e86-409c-9a9e-187f8ce8db05
Apr 15 20:08:07 devstack sudo[86041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:07 devstack sudo[86036]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:07 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-25370e8c-c5e8-474b-826f-98948526f55c tempest-SnapshotsActionsTest-1942023327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.info" returned: 0 in 0.518s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:07 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-25370e8c-c5e8-474b-826f-98948526f55c tempest-SnapshotsActionsTest-1942023327 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.info is being set with open permissions: ugo+rw
Apr 15 20:08:07 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-25370e8c-c5e8-474b-826f-98948526f55c tempest-SnapshotsActionsTest-1942023327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.info {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:07 devstack sudo[86049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.info
Apr 15 20:08:07 devstack sudo[86049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:08 devstack sudo[86041]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:08 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6fc7f06f-c1af-465b-b7ee-4a91b13417c2 tempest-GroupSnapshotsTest-234173950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e9a78a90-ff5f-423c-9c0d-ec56a1d14629.57b54e1f-6e86-409c-9a9e-187f8ce8db05" returned: 0 in 0.511s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:08 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-6fc7f06f-c1af-465b-b7ee-4a91b13417c2 tempest-GroupSnapshotsTest-234173950 None] Lock "cinder-quobyte-57b54e1f-6e86-409c-9a9e-187f8ce8db05" released by "_delete_snapshot" :: held 2.480s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:08:08 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-6fc7f06f-c1af-465b-b7ee-4a91b13417c2 tempest-GroupSnapshotsTest-234173950 None] Lock "cinder-quobyte-e9a78a90-ff5f-423c-9c0d-ec56a1d14629" released by "delete_snapshot" :: held 2.532s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:08:08 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-6fc7f06f-c1af-465b-b7ee-4a91b13417c2 tempest-GroupSnapshotsTest-234173950 None] Acquiring lock "cinder-quobyte-e0172e8a-c625-4092-bbbf-c0de807bfb86" by "delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:08:08 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-6fc7f06f-c1af-465b-b7ee-4a91b13417c2 tempest-GroupSnapshotsTest-234173950 None] Lock "cinder-quobyte-e0172e8a-c625-4092-bbbf-c0de807bfb86" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:08:08 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-6fc7f06f-c1af-465b-b7ee-4a91b13417c2 tempest-GroupSnapshotsTest-234173950 None] Acquiring lock "cinder-quobyte-f3163727-c495-4547-a0f3-acd75ef01c8c" by "_delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:08:08 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-6fc7f06f-c1af-465b-b7ee-4a91b13417c2 tempest-GroupSnapshotsTest-234173950 None] Lock "cinder-quobyte-f3163727-c495-4547-a0f3-acd75ef01c8c" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:08:08 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-6fc7f06f-c1af-465b-b7ee-4a91b13417c2 tempest-GroupSnapshotsTest-234173950 None] Deleting offline snapshot f3163727-c495-4547-a0f3-acd75ef01c8c of volume e0172e8a-c625-4092-bbbf-c0de807bfb86 {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 20:08:08 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-6fc7f06f-c1af-465b-b7ee-4a91b13417c2 tempest-GroupSnapshotsTest-234173950 None] snapshot_file for this snap is: volume-e0172e8a-c625-4092-bbbf-c0de807bfb86.f3163727-c495-4547-a0f3-acd75ef01c8c {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 20:08:08 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[309149cb-2f85-4153-a222-05ce0e6adcf4]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:08:08 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6fc7f06f-c1af-465b-b7ee-4a91b13417c2 tempest-GroupSnapshotsTest-234173950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e0172e8a-c625-4092-bbbf-c0de807bfb86.f3163727-c495-4547-a0f3-acd75ef01c8c {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:08 devstack sudo[86068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e0172e8a-c625-4092-bbbf-c0de807bfb86.f3163727-c495-4547-a0f3-acd75ef01c8c
Apr 15 20:08:08 devstack sudo[86068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:08 devstack sudo[86049]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:08 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-25370e8c-c5e8-474b-826f-98948526f55c tempest-SnapshotsActionsTest-1942023327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.info" returned: 0 in 0.517s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:08 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-25370e8c-c5e8-474b-826f-98948526f55c tempest-SnapshotsActionsTest-1942023327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.684s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:08:08 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-25370e8c-c5e8-474b-826f-98948526f55c tempest-SnapshotsActionsTest-1942023327 None] Create snapshot completed successfully
Apr 15 20:08:08 devstack sudo[86068]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:08 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6fc7f06f-c1af-465b-b7ee-4a91b13417c2 tempest-GroupSnapshotsTest-234173950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e0172e8a-c625-4092-bbbf-c0de807bfb86.f3163727-c495-4547-a0f3-acd75ef01c8c" returned: 0 in 0.574s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:08 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-6fc7f06f-c1af-465b-b7ee-4a91b13417c2 tempest-GroupSnapshotsTest-234173950 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0172e8a-c625-4092-bbbf-c0de807bfb86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82646) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 20:08:08 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf87079-5375-4417-8705-2f7385dc3e6a]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:08:08 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6fc7f06f-c1af-465b-b7ee-4a91b13417c2 tempest-GroupSnapshotsTest-234173950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e0172e8a-c625-4092-bbbf-c0de807bfb86 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:08 devstack sudo[86075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e0172e8a-c625-4092-bbbf-c0de807bfb86
Apr 15 20:08:08 devstack sudo[86075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:09 devstack sudo[86075]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6fc7f06f-c1af-465b-b7ee-4a91b13417c2 tempest-GroupSnapshotsTest-234173950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e0172e8a-c625-4092-bbbf-c0de807bfb86" returned: 0 in 0.566s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6fc7f06f-c1af-465b-b7ee-4a91b13417c2 tempest-GroupSnapshotsTest-234173950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e0172e8a-c625-4092-bbbf-c0de807bfb86.f3163727-c495-4547-a0f3-acd75ef01c8c {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:09 devstack sudo[86081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e0172e8a-c625-4092-bbbf-c0de807bfb86.f3163727-c495-4547-a0f3-acd75ef01c8c
Apr 15 20:08:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-cca0dd0b-17be-4cf9-be0b-9ef91b9de0b1 tempest-SnapshotsActionsTest-1942023327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:08:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-cca0dd0b-17be-4cf9-be0b-9ef91b9de0b1 tempest-SnapshotsActionsTest-1942023327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:08:09 devstack sudo[86081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:09 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-cca0dd0b-17be-4cf9-be0b-9ef91b9de0b1 tempest-SnapshotsActionsTest-1942023327 None] Creating offline snapshot d136d21e-a8f6-4ad6-9385-1c87f27d0376 of volume 652eb0f7-c5d0-4af1-a426-b00a9f1393fe {{(pid=82646) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 20:08:09 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[b16a07be-7980-4494-a3ab-8b9bf71a7c94]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:08:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-cca0dd0b-17be-4cf9-be0b-9ef91b9de0b1 tempest-SnapshotsActionsTest-1942023327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.c4230ee4-7827-436a-9552-81aadcb1de1e {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:09 devstack sudo[86083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.c4230ee4-7827-436a-9552-81aadcb1de1e
Apr 15 20:08:09 devstack sudo[86083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:10 devstack sudo[86081]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:10 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6fc7f06f-c1af-465b-b7ee-4a91b13417c2 tempest-GroupSnapshotsTest-234173950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e0172e8a-c625-4092-bbbf-c0de807bfb86.f3163727-c495-4547-a0f3-acd75ef01c8c" returned: 0 in 0.644s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:10 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6fc7f06f-c1af-465b-b7ee-4a91b13417c2 tempest-GroupSnapshotsTest-234173950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e0172e8a-c625-4092-bbbf-c0de807bfb86.f3163727-c495-4547-a0f3-acd75ef01c8c {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:10 devstack sudo[86095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e0172e8a-c625-4092-bbbf-c0de807bfb86.f3163727-c495-4547-a0f3-acd75ef01c8c
Apr 15 20:08:10 devstack sudo[86095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:10 devstack sudo[86083]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:10 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-cca0dd0b-17be-4cf9-be0b-9ef91b9de0b1 tempest-SnapshotsActionsTest-1942023327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.c4230ee4-7827-436a-9552-81aadcb1de1e" returned: 0 in 0.631s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:10 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-cca0dd0b-17be-4cf9-be0b-9ef91b9de0b1 tempest-SnapshotsActionsTest-1942023327 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82646) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 20:08:10 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-cca0dd0b-17be-4cf9-be0b-9ef91b9de0b1 tempest-SnapshotsActionsTest-1942023327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.c4230ee4-7827-436a-9552-81aadcb1de1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.d136d21e-a8f6-4ad6-9385-1c87f27d0376 1G {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:10 devstack sudo[86097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.c4230ee4-7827-436a-9552-81aadcb1de1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.d136d21e-a8f6-4ad6-9385-1c87f27d0376 1G
Apr 15 20:08:10 devstack sudo[86097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:10 devstack sudo[86095]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:10 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6fc7f06f-c1af-465b-b7ee-4a91b13417c2 tempest-GroupSnapshotsTest-234173950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e0172e8a-c625-4092-bbbf-c0de807bfb86.f3163727-c495-4547-a0f3-acd75ef01c8c" returned: 0 in 0.585s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:10 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-6fc7f06f-c1af-465b-b7ee-4a91b13417c2 tempest-GroupSnapshotsTest-234173950 None] Lock "cinder-quobyte-f3163727-c495-4547-a0f3-acd75ef01c8c" released by "_delete_snapshot" :: held 2.441s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:08:10 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-6fc7f06f-c1af-465b-b7ee-4a91b13417c2 tempest-GroupSnapshotsTest-234173950 None] Lock "cinder-quobyte-e0172e8a-c625-4092-bbbf-c0de807bfb86" released by "delete_snapshot" :: held 2.456s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:08:10 devstack sudo[86097]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:10 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-cca0dd0b-17be-4cf9-be0b-9ef91b9de0b1 tempest-SnapshotsActionsTest-1942023327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.c4230ee4-7827-436a-9552-81aadcb1de1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.d136d21e-a8f6-4ad6-9385-1c87f27d0376 1G" returned: 0 in 0.569s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:10 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-cca0dd0b-17be-4cf9-be0b-9ef91b9de0b1 tempest-SnapshotsActionsTest-1942023327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.c4230ee4-7827-436a-9552-81aadcb1de1e -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.d136d21e-a8f6-4ad6-9385-1c87f27d0376 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:10 devstack sudo[86103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.c4230ee4-7827-436a-9552-81aadcb1de1e -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.d136d21e-a8f6-4ad6-9385-1c87f27d0376
Apr 15 20:08:10 devstack sudo[86103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:10 devstack cinder-volume[82646]: WARNING cinder.quota [None req-6fc7f06f-c1af-465b-b7ee-4a91b13417c2 tempest-GroupSnapshotsTest-234173950 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-403429563 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-403429563, it is now deprecated. Please use the default quota class for default quota.
Apr 15 20:08:10 devstack cinder-volume[82646]: WARNING cinder.quota [None req-6fc7f06f-c1af-465b-b7ee-4a91b13417c2 tempest-GroupSnapshotsTest-234173950 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-403429563 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-403429563, it is now deprecated. Please use the default quota class for default quota.
Apr 15 20:08:10 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-6fc7f06f-c1af-465b-b7ee-4a91b13417c2 tempest-GroupSnapshotsTest-234173950 None] Created reservations ['3c216ad2-b6de-4eba-9ee3-58ba53651855', '8f79595e-de96-4024-9d60-8cfcedd2c2b1', '969422bc-8908-4518-8225-625efc49168c', '8e32b8eb-ca35-44f7-8aee-6a61ea788729'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:08:10 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-6fc7f06f-c1af-465b-b7ee-4a91b13417c2 tempest-GroupSnapshotsTest-234173950 None] Created reservations ['a9468b8c-4703-480c-a062-80e378f67a3e', '11631608-3f3b-4912-8ef7-7703e6db4625', '9abe0c24-db1d-4eb2-8f58-77d993c6d58a', '19c2c623-dae5-4b7e-b758-2094773e24ee'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:08:10 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-6fc7f06f-c1af-465b-b7ee-4a91b13417c2 tempest-GroupSnapshotsTest-234173950 None] group_snapshot caa1f56f-3d00-41d7-9a92-600353047ccf: deleted successfully
Apr 15 20:08:11 devstack sudo[86103]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:11 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-cca0dd0b-17be-4cf9-be0b-9ef91b9de0b1 tempest-SnapshotsActionsTest-1942023327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.c4230ee4-7827-436a-9552-81aadcb1de1e -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.d136d21e-a8f6-4ad6-9385-1c87f27d0376" returned: 0 in 0.558s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:11 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-cca0dd0b-17be-4cf9-be0b-9ef91b9de0b1 tempest-SnapshotsActionsTest-1942023327 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.d136d21e-a8f6-4ad6-9385-1c87f27d0376 is being set with open permissions: ugo+rw
Apr 15 20:08:11 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-cca0dd0b-17be-4cf9-be0b-9ef91b9de0b1 tempest-SnapshotsActionsTest-1942023327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.d136d21e-a8f6-4ad6-9385-1c87f27d0376 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:11 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-82e5b37a-98be-4a86-99c8-a626713b74c9 tempest-GroupSnapshotsTest-234173950 None] Acquiring lock "cinder-quobyte-e0172e8a-c625-4092-bbbf-c0de807bfb86" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:08:11 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-82e5b37a-98be-4a86-99c8-a626713b74c9 tempest-GroupSnapshotsTest-234173950 None] Lock "cinder-quobyte-e0172e8a-c625-4092-bbbf-c0de807bfb86" acquired by "delete_volume" :: waited 0.018s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:08:11 devstack sudo[86112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.d136d21e-a8f6-4ad6-9385-1c87f27d0376
Apr 15 20:08:11 devstack sudo[86112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:11 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd9535a-7234-4c62-bc25-3db4fa2362f8]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:08:11 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-82e5b37a-98be-4a86-99c8-a626713b74c9 tempest-GroupSnapshotsTest-234173950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e0172e8a-c625-4092-bbbf-c0de807bfb86 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:11 devstack sudo[86133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e0172e8a-c625-4092-bbbf-c0de807bfb86
Apr 15 20:08:11 devstack sudo[86133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:11 devstack sudo[86112]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:11 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-cca0dd0b-17be-4cf9-be0b-9ef91b9de0b1 tempest-SnapshotsActionsTest-1942023327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.d136d21e-a8f6-4ad6-9385-1c87f27d0376" returned: 0 in 0.533s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:11 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-cca0dd0b-17be-4cf9-be0b-9ef91b9de0b1 tempest-SnapshotsActionsTest-1942023327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.380s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:08:11 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-cca0dd0b-17be-4cf9-be0b-9ef91b9de0b1 tempest-SnapshotsActionsTest-1942023327 None] Create snapshot completed successfully
Apr 15 20:08:12 devstack sudo[86133]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:12 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-82e5b37a-98be-4a86-99c8-a626713b74c9 tempest-GroupSnapshotsTest-234173950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e0172e8a-c625-4092-bbbf-c0de807bfb86" returned: 0 in 0.690s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:12 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-82e5b37a-98be-4a86-99c8-a626713b74c9 tempest-GroupSnapshotsTest-234173950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e0172e8a-c625-4092-bbbf-c0de807bfb86 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:12 devstack sudo[86144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e0172e8a-c625-4092-bbbf-c0de807bfb86
Apr 15 20:08:12 devstack sudo[86144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:12 devstack sudo[86144]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:12 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-82e5b37a-98be-4a86-99c8-a626713b74c9 tempest-GroupSnapshotsTest-234173950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e0172e8a-c625-4092-bbbf-c0de807bfb86" returned: 0 in 0.469s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:12 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-82e5b37a-98be-4a86-99c8-a626713b74c9 tempest-GroupSnapshotsTest-234173950 None] Lock "cinder-quobyte-e0172e8a-c625-4092-bbbf-c0de807bfb86" released by "delete_volume" :: held 1.249s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:08:12 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-82e5b37a-98be-4a86-99c8-a626713b74c9 tempest-GroupSnapshotsTest-234173950 None] Acquiring lock "cinder-quobyte-e9a78a90-ff5f-423c-9c0d-ec56a1d14629" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:08:12 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-82e5b37a-98be-4a86-99c8-a626713b74c9 tempest-GroupSnapshotsTest-234173950 None] Lock "cinder-quobyte-e9a78a90-ff5f-423c-9c0d-ec56a1d14629" acquired by "delete_volume" :: waited 0.012s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:08:12 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[3664e9c0-11b9-4c4b-a2f3-991b7f240bbf]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:08:12 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-82e5b37a-98be-4a86-99c8-a626713b74c9 tempest-GroupSnapshotsTest-234173950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e9a78a90-ff5f-423c-9c0d-ec56a1d14629 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:12 devstack sudo[86148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e9a78a90-ff5f-423c-9c0d-ec56a1d14629
Apr 15 20:08:12 devstack sudo[86148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:12 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-8fea09a6-d172-4760-9dac-e5642b061afc tempest-SnapshotsActionsTest-1245122770 None] Acquiring lock "cinder-d136d21e-a8f6-4ad6-9385-1c87f27d0376-delete_snapshot" by "delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:08:12 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-8fea09a6-d172-4760-9dac-e5642b061afc tempest-SnapshotsActionsTest-1245122770 None] Lock "cinder-d136d21e-a8f6-4ad6-9385-1c87f27d0376-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:08:12 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-8fea09a6-d172-4760-9dac-e5642b061afc tempest-SnapshotsActionsTest-1245122770 None] Acquiring lock "cinder-quobyte-652eb0f7-c5d0-4af1-a426-b00a9f1393fe" by "delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:08:12 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-8fea09a6-d172-4760-9dac-e5642b061afc tempest-SnapshotsActionsTest-1245122770 None] Lock "cinder-quobyte-652eb0f7-c5d0-4af1-a426-b00a9f1393fe" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:08:12 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-8fea09a6-d172-4760-9dac-e5642b061afc tempest-SnapshotsActionsTest-1245122770 None] Acquiring lock "cinder-quobyte-d136d21e-a8f6-4ad6-9385-1c87f27d0376" by "_delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:08:12 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-8fea09a6-d172-4760-9dac-e5642b061afc tempest-SnapshotsActionsTest-1245122770 None] Lock "cinder-quobyte-d136d21e-a8f6-4ad6-9385-1c87f27d0376" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:08:12 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-8fea09a6-d172-4760-9dac-e5642b061afc tempest-SnapshotsActionsTest-1245122770 None] Deleting offline snapshot d136d21e-a8f6-4ad6-9385-1c87f27d0376 of volume 652eb0f7-c5d0-4af1-a426-b00a9f1393fe {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 20:08:12 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-8fea09a6-d172-4760-9dac-e5642b061afc tempest-SnapshotsActionsTest-1245122770 None] snapshot_file for this snap is: volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.d136d21e-a8f6-4ad6-9385-1c87f27d0376 {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 20:08:12 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe32821-7548-49c4-9d28-89a7e2fcb258]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:08:12 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-8fea09a6-d172-4760-9dac-e5642b061afc tempest-SnapshotsActionsTest-1245122770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.d136d21e-a8f6-4ad6-9385-1c87f27d0376 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:12 devstack sudo[86150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.d136d21e-a8f6-4ad6-9385-1c87f27d0376
Apr 15 20:08:12 devstack sudo[86150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:13 devstack sudo[86148]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:13 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-82e5b37a-98be-4a86-99c8-a626713b74c9 tempest-GroupSnapshotsTest-234173950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e9a78a90-ff5f-423c-9c0d-ec56a1d14629" returned: 0 in 0.668s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:13 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-82e5b37a-98be-4a86-99c8-a626713b74c9 tempest-GroupSnapshotsTest-234173950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e9a78a90-ff5f-423c-9c0d-ec56a1d14629 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:13 devstack sudo[86157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e9a78a90-ff5f-423c-9c0d-ec56a1d14629
Apr 15 20:08:13 devstack sudo[86157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:13 devstack sudo[86150]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:13 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-8fea09a6-d172-4760-9dac-e5642b061afc tempest-SnapshotsActionsTest-1245122770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.d136d21e-a8f6-4ad6-9385-1c87f27d0376" returned: 0 in 0.650s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:13 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-8fea09a6-d172-4760-9dac-e5642b061afc tempest-SnapshotsActionsTest-1245122770 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82646) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 20:08:13 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcfffa25-8560-43b7-8bb8-28d7916c2ed9]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:08:13 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-8fea09a6-d172-4760-9dac-e5642b061afc tempest-SnapshotsActionsTest-1245122770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.c4230ee4-7827-436a-9552-81aadcb1de1e {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:13 devstack sudo[86162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.c4230ee4-7827-436a-9552-81aadcb1de1e
Apr 15 20:08:13 devstack sudo[86162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:13 devstack sudo[86157]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:13 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-82e5b37a-98be-4a86-99c8-a626713b74c9 tempest-GroupSnapshotsTest-234173950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e9a78a90-ff5f-423c-9c0d-ec56a1d14629" returned: 0 in 0.518s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:13 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-82e5b37a-98be-4a86-99c8-a626713b74c9 tempest-GroupSnapshotsTest-234173950 None] Lock "cinder-quobyte-e9a78a90-ff5f-423c-9c0d-ec56a1d14629" released by "delete_volume" :: held 1.237s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:08:13 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-82e5b37a-98be-4a86-99c8-a626713b74c9 tempest-GroupSnapshotsTest-234173950 None] Created reservations ['311f4e4e-30ef-48d3-9b83-fb4e14a55d21'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:08:13 devstack cinder-volume[82646]: WARNING cinder.quota [None req-82e5b37a-98be-4a86-99c8-a626713b74c9 tempest-GroupSnapshotsTest-234173950 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-403429563 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-403429563, it is now deprecated. Please use the default quota class for default quota.
Apr 15 20:08:13 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-82e5b37a-98be-4a86-99c8-a626713b74c9 tempest-GroupSnapshotsTest-234173950 None] Created reservations ['0b68e7c5-ada5-43e5-9ee1-13638938c264', '9412415a-9792-47a7-a195-cffd4a56cd35', '1e36bbc7-9e31-448c-ae71-5b05825aa427', '20b43226-9b4c-4024-99fd-efb2c4af6f37'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:08:13 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-82e5b37a-98be-4a86-99c8-a626713b74c9 tempest-GroupSnapshotsTest-234173950 None] Created reservations ['884be307-be9b-4457-99cb-c244e6d04c1d', '19957f14-ff22-4f57-a3b3-2d343a48f480', 'b3295963-19d8-4b0e-9bb2-dbba2c6213b3', '8ffe52d0-248a-4493-97d5-c4c073e8bd71'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:08:13 devstack sudo[86162]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:14 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-8fea09a6-d172-4760-9dac-e5642b061afc tempest-SnapshotsActionsTest-1245122770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.c4230ee4-7827-436a-9552-81aadcb1de1e" returned: 0 in 0.621s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:14 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-8fea09a6-d172-4760-9dac-e5642b061afc tempest-SnapshotsActionsTest-1245122770 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82646) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 20:08:14 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-8fea09a6-d172-4760-9dac-e5642b061afc tempest-SnapshotsActionsTest-1245122770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.d136d21e-a8f6-4ad6-9385-1c87f27d0376 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:14 devstack sudo[86168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.d136d21e-a8f6-4ad6-9385-1c87f27d0376
Apr 15 20:08:14 devstack sudo[86168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:14 devstack cinder-volume[82646]: INFO cinder.volume.manager [req-fc0ba69f-8f8a-43f8-8741-abf7c1db8f65 req-f6439ea7-993e-4a7d-84fd-23fa18fe2302 tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Terminate volume connection completed successfully.
Apr 15 20:08:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [req-fc0ba69f-8f8a-43f8-8741-abf7c1db8f65 req-f6439ea7-993e-4a7d-84fd-23fa18fe2302 tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Deleting attachment 9b40076c-9c92-4c0b-9c71-fed46df36dea. {{(pid=82646) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 15 20:08:14 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-82e5b37a-98be-4a86-99c8-a626713b74c9 tempest-GroupSnapshotsTest-234173950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:08:14 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-82e5b37a-98be-4a86-99c8-a626713b74c9 tempest-GroupSnapshotsTest-234173950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:08:14 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-82e5b37a-98be-4a86-99c8-a626713b74c9 tempest-GroupSnapshotsTest-234173950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:08:14 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-82e5b37a-98be-4a86-99c8-a626713b74c9 tempest-GroupSnapshotsTest-234173950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:08:14 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-82e5b37a-98be-4a86-99c8-a626713b74c9 tempest-GroupSnapshotsTest-234173950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:08:14 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-82e5b37a-98be-4a86-99c8-a626713b74c9 tempest-GroupSnapshotsTest-234173950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:14 devstack sudo[86170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:08:14 devstack sudo[86170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:14 devstack sudo[86170]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:14 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-82e5b37a-98be-4a86-99c8-a626713b74c9 tempest-GroupSnapshotsTest-234173950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.500s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:14 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-82e5b37a-98be-4a86-99c8-a626713b74c9 tempest-GroupSnapshotsTest-234173950 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:08:14 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-82e5b37a-98be-4a86-99c8-a626713b74c9 tempest-GroupSnapshotsTest-234173950 None] Delete group completed successfully.
Apr 15 20:08:14 devstack sudo[86168]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:14 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-8fea09a6-d172-4760-9dac-e5642b061afc tempest-SnapshotsActionsTest-1245122770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.d136d21e-a8f6-4ad6-9385-1c87f27d0376" returned: 0 in 0.693s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:14 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-8fea09a6-d172-4760-9dac-e5642b061afc tempest-SnapshotsActionsTest-1245122770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.d136d21e-a8f6-4ad6-9385-1c87f27d0376 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:14 devstack cinder-volume[82646]: DEBUG cinder.coordination [req-fc0ba69f-8f8a-43f8-8741-abf7c1db8f65 req-c9e9a861-7653-4176-92f5-ece4e59182d9 tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Acquiring lock "cinder-ae6b4ca8-4ee6-47f1-b968-bd0fa8421f74-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:08:14 devstack sudo[86176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.d136d21e-a8f6-4ad6-9385-1c87f27d0376
Apr 15 20:08:14 devstack sudo[86176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:14 devstack cinder-volume[82646]: DEBUG cinder.coordination [req-fc0ba69f-8f8a-43f8-8741-abf7c1db8f65 req-c9e9a861-7653-4176-92f5-ece4e59182d9 tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Lock "cinder-ae6b4ca8-4ee6-47f1-b968-bd0fa8421f74-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:08:14 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-ac5b2fcf-9e1c-4396-8f15-0964de6274e3 tempest-GroupSnapshotsTest-234173950 None] Group tempest-GroupSnapshotsTest-Group-267193724: creating
Apr 15 20:08:14 devstack cinder-volume[82646]: DEBUG cinder.coordination [req-fc0ba69f-8f8a-43f8-8741-abf7c1db8f65 req-c9e9a861-7653-4176-92f5-ece4e59182d9 tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Acquiring lock "cinder-quobyte-ae6b4ca8-4ee6-47f1-b968-bd0fa8421f74" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:08:14 devstack cinder-volume[82646]: DEBUG cinder.coordination [req-fc0ba69f-8f8a-43f8-8741-abf7c1db8f65 req-c9e9a861-7653-4176-92f5-ece4e59182d9 tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Lock "cinder-quobyte-ae6b4ca8-4ee6-47f1-b968-bd0fa8421f74" acquired by "delete_volume" :: waited 0.021s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:08:14 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-ac5b2fcf-9e1c-4396-8f15-0964de6274e3 tempest-GroupSnapshotsTest-234173950 None] Group tempest-GroupSnapshotsTest-Group-267193724: created successfully
Apr 15 20:08:14 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2665731-7c15-44ad-a99f-a16a34a0873e]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:08:14 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-fc0ba69f-8f8a-43f8-8741-abf7c1db8f65 req-c9e9a861-7653-4176-92f5-ece4e59182d9 tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-ae6b4ca8-4ee6-47f1-b968-bd0fa8421f74 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:14 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-ac5b2fcf-9e1c-4396-8f15-0964de6274e3 tempest-GroupSnapshotsTest-234173950 None] Create group completed successfully.
Apr 15 20:08:14 devstack sudo[86181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-ae6b4ca8-4ee6-47f1-b968-bd0fa8421f74
Apr 15 20:08:14 devstack sudo[86181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:15 devstack sudo[86176]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:15 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-8fea09a6-d172-4760-9dac-e5642b061afc tempest-SnapshotsActionsTest-1245122770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.d136d21e-a8f6-4ad6-9385-1c87f27d0376" returned: 0 in 0.514s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:15 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-8fea09a6-d172-4760-9dac-e5642b061afc tempest-SnapshotsActionsTest-1245122770 None] Lock "cinder-quobyte-d136d21e-a8f6-4ad6-9385-1c87f27d0376" released by "_delete_snapshot" :: held 2.540s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:08:15 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-8fea09a6-d172-4760-9dac-e5642b061afc tempest-SnapshotsActionsTest-1245122770 None] Lock "cinder-quobyte-652eb0f7-c5d0-4af1-a426-b00a9f1393fe" released by "delete_snapshot" :: held 2.553s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:08:15 devstack cinder-volume[82646]: WARNING cinder.quota [None req-8fea09a6-d172-4760-9dac-e5642b061afc tempest-SnapshotsActionsTest-1245122770 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 15 20:08:15 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-8fea09a6-d172-4760-9dac-e5642b061afc tempest-SnapshotsActionsTest-1245122770 None] Created reservations ['2521270d-8708-4709-91cd-739a844901df', '13b09c28-19bf-4a60-9854-579d647c3084', '21c69098-7668-4bad-9133-8422e936df74', '360b2e11-7e5b-4344-a127-8e0696bfa2dd'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:08:15 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-8fea09a6-d172-4760-9dac-e5642b061afc tempest-SnapshotsActionsTest-1245122770 None] Delete snapshot completed successfully.
Apr 15 20:08:15 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-8fea09a6-d172-4760-9dac-e5642b061afc tempest-SnapshotsActionsTest-1245122770 None] Lock "cinder-d136d21e-a8f6-4ad6-9385-1c87f27d0376-delete_snapshot" released by "delete_snapshot" :: held 2.686s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:08:15 devstack sudo[86181]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:15 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-fc0ba69f-8f8a-43f8-8741-abf7c1db8f65 req-c9e9a861-7653-4176-92f5-ece4e59182d9 tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-ae6b4ca8-4ee6-47f1-b968-bd0fa8421f74" returned: 0 in 0.566s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:15 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-fc0ba69f-8f8a-43f8-8741-abf7c1db8f65 req-c9e9a861-7653-4176-92f5-ece4e59182d9 tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-ae6b4ca8-4ee6-47f1-b968-bd0fa8421f74 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:15 devstack sudo[86187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-ae6b4ca8-4ee6-47f1-b968-bd0fa8421f74
Apr 15 20:08:15 devstack sudo[86187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:15 devstack sudo[86187]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:15 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-fc0ba69f-8f8a-43f8-8741-abf7c1db8f65 req-c9e9a861-7653-4176-92f5-ece4e59182d9 tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-ae6b4ca8-4ee6-47f1-b968-bd0fa8421f74" returned: 0 in 0.496s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:15 devstack cinder-volume[82646]: DEBUG cinder.coordination [req-fc0ba69f-8f8a-43f8-8741-abf7c1db8f65 req-c9e9a861-7653-4176-92f5-ece4e59182d9 tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Lock "cinder-quobyte-ae6b4ca8-4ee6-47f1-b968-bd0fa8421f74" released by "delete_volume" :: held 1.108s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:08:16 devstack cinder-volume[82646]: DEBUG cinder.quota [req-fc0ba69f-8f8a-43f8-8741-abf7c1db8f65 req-c9e9a861-7653-4176-92f5-ece4e59182d9 tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Created reservations ['034fc8e8-e165-4d0e-9729-60ffb89fd2eb', '27e52d47-57f3-49e2-a1ab-66a6a5a95bd2', 'b6a83464-7d39-42b8-9da7-a2049b3530fe', '9c16262f-b99a-4b08-9e5c-c9cd48c2aae1'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:08:16 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-28b6749d-9d32-4e8d-a216-552950c9fad9 tempest-SnapshotsActionsTest-1942023327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:08:16 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-28b6749d-9d32-4e8d-a216-552950c9fad9 tempest-SnapshotsActionsTest-1942023327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:08:16 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-28b6749d-9d32-4e8d-a216-552950c9fad9 tempest-SnapshotsActionsTest-1942023327 None] Creating offline snapshot b1bd1018-6d27-4834-b935-70c57fd744c6 of volume 652eb0f7-c5d0-4af1-a426-b00a9f1393fe {{(pid=82646) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 20:08:16 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b83245-0a68-452c-81e0-365b86df1ef9]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:08:16 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-28b6749d-9d32-4e8d-a216-552950c9fad9 tempest-SnapshotsActionsTest-1942023327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.c4230ee4-7827-436a-9552-81aadcb1de1e {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:16 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [req-fc0ba69f-8f8a-43f8-8741-abf7c1db8f65 req-c9e9a861-7653-4176-92f5-ece4e59182d9 tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:08:16 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [req-fc0ba69f-8f8a-43f8-8741-abf7c1db8f65 req-c9e9a861-7653-4176-92f5-ece4e59182d9 tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:08:16 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [req-fc0ba69f-8f8a-43f8-8741-abf7c1db8f65 req-c9e9a861-7653-4176-92f5-ece4e59182d9 tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:08:16 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [req-fc0ba69f-8f8a-43f8-8741-abf7c1db8f65 req-c9e9a861-7653-4176-92f5-ece4e59182d9 tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:08:16 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [req-fc0ba69f-8f8a-43f8-8741-abf7c1db8f65 req-c9e9a861-7653-4176-92f5-ece4e59182d9 tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:08:16 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-fc0ba69f-8f8a-43f8-8741-abf7c1db8f65 req-c9e9a861-7653-4176-92f5-ece4e59182d9 tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:16 devstack sudo[86193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:08:16 devstack sudo[86193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:16 devstack sudo[86192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.c4230ee4-7827-436a-9552-81aadcb1de1e
Apr 15 20:08:16 devstack sudo[86192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:16 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0249976-ef52-4781-8e0b-4f973a7b686e tempest-GroupSnapshotsTest-234173950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:08:16 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d0249976-ef52-4781-8e0b-4f973a7b686e tempest-GroupSnapshotsTest-234173950 None] Flow 'volume_create_manager' (3adc8c29-a63a-4651-882d-d8018acb77bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:08:16 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d0249976-ef52-4781-8e0b-4f973a7b686e tempest-GroupSnapshotsTest-234173950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6839bca2-6fd6-4385-af2c-3bb10a47c536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:08:16 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d0249976-ef52-4781-8e0b-4f973a7b686e tempest-GroupSnapshotsTest-234173950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6839bca2-6fd6-4385-af2c-3bb10a47c536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:08:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-508435246',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ee059045-426e-4219-846e-17b9b4139959,host='devstack@QuobyteHD#QuobyteHD',id=de3fa98f-f551-4409-b338-6c56a65c4c3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98edbdfcd7444227b1af4887df1acf45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:08:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:08:16Z,use_quota=True,user_id='9250ca46a4b44ce3a19386920797e916',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d610ea5-bb62-4357-bfe2-65a7187ad330),volume_type_id=5d610ea5-bb62-4357-bfe2-65a7187ad330)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:08:16 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d0249976-ef52-4781-8e0b-4f973a7b686e tempest-GroupSnapshotsTest-234173950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06888e4f-6975-40b7-8ead-1c4ec3de670c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:08:16 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d0249976-ef52-4781-8e0b-4f973a7b686e tempest-GroupSnapshotsTest-234173950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06888e4f-6975-40b7-8ead-1c4ec3de670c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:08:16 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d0249976-ef52-4781-8e0b-4f973a7b686e tempest-GroupSnapshotsTest-234173950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (566395ce-5266-4f7e-9b58-77e52d4287ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:08:16 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d0249976-ef52-4781-8e0b-4f973a7b686e tempest-GroupSnapshotsTest-234173950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (566395ce-5266-4f7e-9b58-77e52d4287ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de3fa98f-f551-4409-b338-6c56a65c4c3a', 'volume_name': 'volume-de3fa98f-f551-4409-b338-6c56a65c4c3a', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:08:16 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d0249976-ef52-4781-8e0b-4f973a7b686e tempest-GroupSnapshotsTest-234173950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb357ab8-0990-490a-9b4c-eaa8b8d2c395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:08:16 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d0249976-ef52-4781-8e0b-4f973a7b686e tempest-GroupSnapshotsTest-234173950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb357ab8-0990-490a-9b4c-eaa8b8d2c395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:08:16 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d0249976-ef52-4781-8e0b-4f973a7b686e tempest-GroupSnapshotsTest-234173950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (344c0cb2-3b07-4fac-9a91-a409a1dc97a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:08:16 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-d0249976-ef52-4781-8e0b-4f973a7b686e tempest-GroupSnapshotsTest-234173950 None] Volume de3fa98f-f551-4409-b338-6c56a65c4c3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de3fa98f-f551-4409-b338-6c56a65c4c3a', 'volume_size': 1}
Apr 15 20:08:16 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-d0249976-ef52-4781-8e0b-4f973a7b686e tempest-GroupSnapshotsTest-234173950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:08:16 devstack sudo[86193]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:16 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-fc0ba69f-8f8a-43f8-8741-abf7c1db8f65 req-c9e9a861-7653-4176-92f5-ece4e59182d9 tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.564s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:16 devstack cinder-volume[82646]: DEBUG cinder.manager [req-fc0ba69f-8f8a-43f8-8741-abf7c1db8f65 req-c9e9a861-7653-4176-92f5-ece4e59182d9 tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:08:16 devstack cinder-volume[82646]: INFO cinder.volume.manager [req-fc0ba69f-8f8a-43f8-8741-abf7c1db8f65 req-c9e9a861-7653-4176-92f5-ece4e59182d9 tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Deleted volume successfully.
Apr 15 20:08:16 devstack cinder-volume[82646]: DEBUG cinder.coordination [req-fc0ba69f-8f8a-43f8-8741-abf7c1db8f65 req-c9e9a861-7653-4176-92f5-ece4e59182d9 tempest-ServerBootFromVolumeStableRescueTest-1176292147 None] Lock "cinder-ae6b4ca8-4ee6-47f1-b968-bd0fa8421f74-delete_volume" released by "delete_volume" :: held 2.010s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:08:16 devstack sudo[86192]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:16 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-28b6749d-9d32-4e8d-a216-552950c9fad9 tempest-SnapshotsActionsTest-1942023327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.c4230ee4-7827-436a-9552-81aadcb1de1e" returned: 0 in 0.680s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:16 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-28b6749d-9d32-4e8d-a216-552950c9fad9 tempest-SnapshotsActionsTest-1942023327 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82646) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 20:08:16 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-28b6749d-9d32-4e8d-a216-552950c9fad9 tempest-SnapshotsActionsTest-1942023327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.c4230ee4-7827-436a-9552-81aadcb1de1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.b1bd1018-6d27-4834-b935-70c57fd744c6 1G {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:16 devstack sudo[86200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.c4230ee4-7827-436a-9552-81aadcb1de1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.b1bd1018-6d27-4834-b935-70c57fd744c6 1G
Apr 15 20:08:16 devstack sudo[86200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:17 devstack sudo[86200]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-28b6749d-9d32-4e8d-a216-552950c9fad9 tempest-SnapshotsActionsTest-1942023327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.c4230ee4-7827-436a-9552-81aadcb1de1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.b1bd1018-6d27-4834-b935-70c57fd744c6 1G" returned: 0 in 0.601s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-28b6749d-9d32-4e8d-a216-552950c9fad9 tempest-SnapshotsActionsTest-1942023327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.c4230ee4-7827-436a-9552-81aadcb1de1e -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.b1bd1018-6d27-4834-b935-70c57fd744c6 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:17 devstack sudo[86205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.c4230ee4-7827-436a-9552-81aadcb1de1e -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.b1bd1018-6d27-4834-b935-70c57fd744c6
Apr 15 20:08:17 devstack sudo[86205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:18 devstack sudo[86205]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-28b6749d-9d32-4e8d-a216-552950c9fad9 tempest-SnapshotsActionsTest-1942023327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.c4230ee4-7827-436a-9552-81aadcb1de1e -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.b1bd1018-6d27-4834-b935-70c57fd744c6" returned: 0 in 0.609s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:18 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-28b6749d-9d32-4e8d-a216-552950c9fad9 tempest-SnapshotsActionsTest-1942023327 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.b1bd1018-6d27-4834-b935-70c57fd744c6 is being set with open permissions: ugo+rw
Apr 15 20:08:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-28b6749d-9d32-4e8d-a216-552950c9fad9 tempest-SnapshotsActionsTest-1942023327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.b1bd1018-6d27-4834-b935-70c57fd744c6 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:18 devstack sudo[86211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.b1bd1018-6d27-4834-b935-70c57fd744c6
Apr 15 20:08:18 devstack sudo[86211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:18 devstack sudo[86211]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-28b6749d-9d32-4e8d-a216-552950c9fad9 tempest-SnapshotsActionsTest-1942023327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.b1bd1018-6d27-4834-b935-70c57fd744c6" returned: 0 in 0.521s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-28b6749d-9d32-4e8d-a216-552950c9fad9 tempest-SnapshotsActionsTest-1942023327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.480s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:08:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-d0249976-ef52-4781-8e0b-4f973a7b686e tempest-GroupSnapshotsTest-234173950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.148s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:08:18 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-d0249976-ef52-4781-8e0b-4f973a7b686e tempest-GroupSnapshotsTest-234173950 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=ee059045-426e-4219-846e-17b9b4139959,created_at=2026-04-15T18:08:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-508435246',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ee059045-426e-4219-846e-17b9b4139959,host='devstack@QuobyteHD#QuobyteHD',id=de3fa98f-f551-4409-b338-6c56a65c4c3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98edbdfcd7444227b1af4887df1acf45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:08:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:08:16Z,use_quota=True,user_id='9250ca46a4b44ce3a19386920797e916',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d610ea5-bb62-4357-bfe2-65a7187ad330),volume_type_id=5d610ea5-bb62-4357-bfe2-65a7187ad330)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:08:18 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-d0249976-ef52-4781-8e0b-4f973a7b686e tempest-GroupSnapshotsTest-234173950 None] Creating volume de3fa98f-f551-4409-b338-6c56a65c4c3a {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:08:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-d0249976-ef52-4781-8e0b-4f973a7b686e tempest-GroupSnapshotsTest-234173950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:08:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-d0249976-ef52-4781-8e0b-4f973a7b686e tempest-GroupSnapshotsTest-234173950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:08:18 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-d0249976-ef52-4781-8e0b-4f973a7b686e tempest-GroupSnapshotsTest-234173950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:08:18 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-d0249976-ef52-4781-8e0b-4f973a7b686e tempest-GroupSnapshotsTest-234173950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:08:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-d0249976-ef52-4781-8e0b-4f973a7b686e tempest-GroupSnapshotsTest-234173950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:08:18 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-d0249976-ef52-4781-8e0b-4f973a7b686e tempest-GroupSnapshotsTest-234173950 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:08:18 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-d0249976-ef52-4781-8e0b-4f973a7b686e tempest-GroupSnapshotsTest-234173950 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:08:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d0249976-ef52-4781-8e0b-4f973a7b686e tempest-GroupSnapshotsTest-234173950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-de3fa98f-f551-4409-b338-6c56a65c4c3a 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:18 devstack sudo[86214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-de3fa98f-f551-4409-b338-6c56a65c4c3a 1073741824
Apr 15 20:08:18 devstack sudo[86214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:18 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-28b6749d-9d32-4e8d-a216-552950c9fad9 tempest-SnapshotsActionsTest-1942023327 None] Create snapshot completed successfully
Apr 15 20:08:19 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-a449d1dc-0a9b-41d8-aa0d-1174ab67476a tempest-SnapshotsActionsTest-1245122770 None] Acquiring lock "cinder-b1bd1018-6d27-4834-b935-70c57fd744c6-delete_snapshot" by "delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:08:19 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-a449d1dc-0a9b-41d8-aa0d-1174ab67476a tempest-SnapshotsActionsTest-1245122770 None] Lock "cinder-b1bd1018-6d27-4834-b935-70c57fd744c6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:08:19 devstack sudo[86214]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:19 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-a449d1dc-0a9b-41d8-aa0d-1174ab67476a tempest-SnapshotsActionsTest-1245122770 None] Acquiring lock "cinder-quobyte-652eb0f7-c5d0-4af1-a426-b00a9f1393fe" by "delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:08:19 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d0249976-ef52-4781-8e0b-4f973a7b686e tempest-GroupSnapshotsTest-234173950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-de3fa98f-f551-4409-b338-6c56a65c4c3a 1073741824" returned: 0 in 0.812s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:19 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-a449d1dc-0a9b-41d8-aa0d-1174ab67476a tempest-SnapshotsActionsTest-1245122770 None] Lock "cinder-quobyte-652eb0f7-c5d0-4af1-a426-b00a9f1393fe" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:08:19 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-a449d1dc-0a9b-41d8-aa0d-1174ab67476a tempest-SnapshotsActionsTest-1245122770 None] Acquiring lock "cinder-quobyte-b1bd1018-6d27-4834-b935-70c57fd744c6" by "_delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:08:19 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-a449d1dc-0a9b-41d8-aa0d-1174ab67476a tempest-SnapshotsActionsTest-1245122770 None] Lock "cinder-quobyte-b1bd1018-6d27-4834-b935-70c57fd744c6" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:08:19 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-a449d1dc-0a9b-41d8-aa0d-1174ab67476a tempest-SnapshotsActionsTest-1245122770 None] Deleting offline snapshot b1bd1018-6d27-4834-b935-70c57fd744c6 of volume 652eb0f7-c5d0-4af1-a426-b00a9f1393fe {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 20:08:19 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-a449d1dc-0a9b-41d8-aa0d-1174ab67476a tempest-SnapshotsActionsTest-1245122770 None] snapshot_file for this snap is: volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.b1bd1018-6d27-4834-b935-70c57fd744c6 {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 20:08:19 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d0249976-ef52-4781-8e0b-4f973a7b686e tempest-GroupSnapshotsTest-234173950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-de3fa98f-f551-4409-b338-6c56a65c4c3a {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:19 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d3474d0-23fe-4bb7-ab43-8d2d99436132]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:08:19 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-a449d1dc-0a9b-41d8-aa0d-1174ab67476a tempest-SnapshotsActionsTest-1245122770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.b1bd1018-6d27-4834-b935-70c57fd744c6 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:19 devstack sudo[86249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-de3fa98f-f551-4409-b338-6c56a65c4c3a
Apr 15 20:08:19 devstack sudo[86249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:19 devstack sudo[86250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.b1bd1018-6d27-4834-b935-70c57fd744c6
Apr 15 20:08:19 devstack sudo[86250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:20 devstack sudo[86249]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d0249976-ef52-4781-8e0b-4f973a7b686e tempest-GroupSnapshotsTest-234173950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-de3fa98f-f551-4409-b338-6c56a65c4c3a" returned: 0 in 0.575s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:20 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-d0249976-ef52-4781-8e0b-4f973a7b686e tempest-GroupSnapshotsTest-234173950 None] <== create_volume: return (1461ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:08:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-d0249976-ef52-4781-8e0b-4f973a7b686e tempest-GroupSnapshotsTest-234173950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.463s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:08:20 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d0249976-ef52-4781-8e0b-4f973a7b686e tempest-GroupSnapshotsTest-234173950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (344c0cb2-3b07-4fac-9a91-a409a1dc97a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de3fa98f-f551-4409-b338-6c56a65c4c3a', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:08:20 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d0249976-ef52-4781-8e0b-4f973a7b686e tempest-GroupSnapshotsTest-234173950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4384b28-8b16-4824-8616-b10abef70216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:08:20 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-d0249976-ef52-4781-8e0b-4f973a7b686e tempest-GroupSnapshotsTest-234173950 None] Volume volume-de3fa98f-f551-4409-b338-6c56a65c4c3a (de3fa98f-f551-4409-b338-6c56a65c4c3a): created successfully
Apr 15 20:08:20 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d0249976-ef52-4781-8e0b-4f973a7b686e tempest-GroupSnapshotsTest-234173950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4384b28-8b16-4824-8616-b10abef70216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:08:20 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d0249976-ef52-4781-8e0b-4f973a7b686e tempest-GroupSnapshotsTest-234173950 None] Flow 'volume_create_manager' (3adc8c29-a63a-4651-882d-d8018acb77bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:08:20 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-d0249976-ef52-4781-8e0b-4f973a7b686e tempest-GroupSnapshotsTest-234173950 None] Created volume successfully.
Apr 15 20:08:20 devstack sudo[86250]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-a449d1dc-0a9b-41d8-aa0d-1174ab67476a tempest-SnapshotsActionsTest-1245122770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.b1bd1018-6d27-4834-b935-70c57fd744c6" returned: 0 in 0.668s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:20 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-a449d1dc-0a9b-41d8-aa0d-1174ab67476a tempest-SnapshotsActionsTest-1245122770 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82646) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 20:08:20 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[53562d9d-e6e1-4b36-b33a-48355cf92724]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:08:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-a449d1dc-0a9b-41d8-aa0d-1174ab67476a tempest-SnapshotsActionsTest-1245122770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.c4230ee4-7827-436a-9552-81aadcb1de1e {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:20 devstack sudo[86258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.c4230ee4-7827-436a-9552-81aadcb1de1e
Apr 15 20:08:20 devstack sudo[86258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:20 devstack sudo[86258]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-a449d1dc-0a9b-41d8-aa0d-1174ab67476a tempest-SnapshotsActionsTest-1245122770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.c4230ee4-7827-436a-9552-81aadcb1de1e" returned: 0 in 0.722s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:20 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-a449d1dc-0a9b-41d8-aa0d-1174ab67476a tempest-SnapshotsActionsTest-1245122770 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82646) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 20:08:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-a449d1dc-0a9b-41d8-aa0d-1174ab67476a tempest-SnapshotsActionsTest-1245122770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.b1bd1018-6d27-4834-b935-70c57fd744c6 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:20 devstack sudo[86264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.b1bd1018-6d27-4834-b935-70c57fd744c6
Apr 15 20:08:20 devstack sudo[86264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:20 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-1bcea859-4890-469e-b6a4-612dc7b301ea tempest-GroupSnapshotsTest-234173950 None] GroupSnapshot 0710f9bd-3d87-4e4b-8ca1-55a5d1aab663: creating.
Apr 15 20:08:20 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-1bcea859-4890-469e-b6a4-612dc7b301ea tempest-GroupSnapshotsTest-234173950 None] Group snapshot 0710f9bd-3d87-4e4b-8ca1-55a5d1aab663: creating. {{(pid=82646) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 15 20:08:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-1bcea859-4890-469e-b6a4-612dc7b301ea tempest-GroupSnapshotsTest-234173950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:08:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-1bcea859-4890-469e-b6a4-612dc7b301ea tempest-GroupSnapshotsTest-234173950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:08:20 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-1bcea859-4890-469e-b6a4-612dc7b301ea tempest-GroupSnapshotsTest-234173950 None] Creating offline snapshot 2e02af37-fd15-4f92-a501-f0e7aa7a2590 of volume de3fa98f-f551-4409-b338-6c56a65c4c3a {{(pid=82646) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 20:08:20 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7b0abb-b4b5-453a-8dee-046d3ff135db]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:08:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-1bcea859-4890-469e-b6a4-612dc7b301ea tempest-GroupSnapshotsTest-234173950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-de3fa98f-f551-4409-b338-6c56a65c4c3a {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:21 devstack sudo[86266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-de3fa98f-f551-4409-b338-6c56a65c4c3a
Apr 15 20:08:21 devstack sudo[86266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:21 devstack sudo[86264]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-a449d1dc-0a9b-41d8-aa0d-1174ab67476a tempest-SnapshotsActionsTest-1245122770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.b1bd1018-6d27-4834-b935-70c57fd744c6" returned: 0 in 0.609s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-a449d1dc-0a9b-41d8-aa0d-1174ab67476a tempest-SnapshotsActionsTest-1245122770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.b1bd1018-6d27-4834-b935-70c57fd744c6 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:21 devstack sudo[86284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.b1bd1018-6d27-4834-b935-70c57fd744c6
Apr 15 20:08:21 devstack sudo[86284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:21 devstack sudo[86266]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-1bcea859-4890-469e-b6a4-612dc7b301ea tempest-GroupSnapshotsTest-234173950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-de3fa98f-f551-4409-b338-6c56a65c4c3a" returned: 0 in 0.573s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-1bcea859-4890-469e-b6a4-612dc7b301ea tempest-GroupSnapshotsTest-234173950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-de3fa98f-f551-4409-b338-6c56a65c4c3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-de3fa98f-f551-4409-b338-6c56a65c4c3a.2e02af37-fd15-4f92-a501-f0e7aa7a2590 1G {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:21 devstack sudo[86287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-de3fa98f-f551-4409-b338-6c56a65c4c3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-de3fa98f-f551-4409-b338-6c56a65c4c3a.2e02af37-fd15-4f92-a501-f0e7aa7a2590 1G
Apr 15 20:08:21 devstack sudo[86287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:21 devstack sudo[86284]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-a449d1dc-0a9b-41d8-aa0d-1174ab67476a tempest-SnapshotsActionsTest-1245122770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.b1bd1018-6d27-4834-b935-70c57fd744c6" returned: 0 in 0.451s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:21 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-a449d1dc-0a9b-41d8-aa0d-1174ab67476a tempest-SnapshotsActionsTest-1245122770 None] Lock "cinder-quobyte-b1bd1018-6d27-4834-b935-70c57fd744c6" released by "_delete_snapshot" :: held 2.537s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:08:21 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-a449d1dc-0a9b-41d8-aa0d-1174ab67476a tempest-SnapshotsActionsTest-1245122770 None] Lock "cinder-quobyte-652eb0f7-c5d0-4af1-a426-b00a9f1393fe" released by "delete_snapshot" :: held 2.581s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:08:22 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-a449d1dc-0a9b-41d8-aa0d-1174ab67476a tempest-SnapshotsActionsTest-1245122770 None] Created reservations ['b65e9d5b-314a-4609-bcde-764ca416a452', '88c85277-34dd-4a8e-b2bf-5cbfed095097', '3f7dc0cd-571c-4191-a46b-c4e69bf64b6a', '987f1c5e-907d-4f51-abea-930978f1b6bd'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:08:22 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-a449d1dc-0a9b-41d8-aa0d-1174ab67476a tempest-SnapshotsActionsTest-1245122770 None] Delete snapshot completed successfully.
Apr 15 20:08:22 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-a449d1dc-0a9b-41d8-aa0d-1174ab67476a tempest-SnapshotsActionsTest-1245122770 None] Lock "cinder-b1bd1018-6d27-4834-b935-70c57fd744c6-delete_snapshot" released by "delete_snapshot" :: held 2.714s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:08:22 devstack sudo[86287]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-1bcea859-4890-469e-b6a4-612dc7b301ea tempest-GroupSnapshotsTest-234173950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-de3fa98f-f551-4409-b338-6c56a65c4c3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-de3fa98f-f551-4409-b338-6c56a65c4c3a.2e02af37-fd15-4f92-a501-f0e7aa7a2590 1G" returned: 0 in 0.574s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-1bcea859-4890-469e-b6a4-612dc7b301ea tempest-GroupSnapshotsTest-234173950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de3fa98f-f551-4409-b338-6c56a65c4c3a -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-de3fa98f-f551-4409-b338-6c56a65c4c3a.2e02af37-fd15-4f92-a501-f0e7aa7a2590 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:22 devstack sudo[86298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de3fa98f-f551-4409-b338-6c56a65c4c3a -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-de3fa98f-f551-4409-b338-6c56a65c4c3a.2e02af37-fd15-4f92-a501-f0e7aa7a2590
Apr 15 20:08:22 devstack sudo[86298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:22 devstack sudo[86298]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-1bcea859-4890-469e-b6a4-612dc7b301ea tempest-GroupSnapshotsTest-234173950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de3fa98f-f551-4409-b338-6c56a65c4c3a -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-de3fa98f-f551-4409-b338-6c56a65c4c3a.2e02af37-fd15-4f92-a501-f0e7aa7a2590" returned: 0 in 0.540s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:22 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-1bcea859-4890-469e-b6a4-612dc7b301ea tempest-GroupSnapshotsTest-234173950 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-de3fa98f-f551-4409-b338-6c56a65c4c3a.2e02af37-fd15-4f92-a501-f0e7aa7a2590 is being set with open permissions: ugo+rw: NotImplementedError
Apr 15 20:08:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-1bcea859-4890-469e-b6a4-612dc7b301ea tempest-GroupSnapshotsTest-234173950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-de3fa98f-f551-4409-b338-6c56a65c4c3a.2e02af37-fd15-4f92-a501-f0e7aa7a2590 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:22 devstack sudo[86303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-de3fa98f-f551-4409-b338-6c56a65c4c3a.2e02af37-fd15-4f92-a501-f0e7aa7a2590
Apr 15 20:08:22 devstack sudo[86303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-bd67b613-afb6-4601-b600-9cc0364d0b20 tempest-SnapshotsActionsTest-1942023327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:08:23 devstack sudo[86303]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:23 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-1bcea859-4890-469e-b6a4-612dc7b301ea tempest-GroupSnapshotsTest-234173950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-de3fa98f-f551-4409-b338-6c56a65c4c3a.2e02af37-fd15-4f92-a501-f0e7aa7a2590" returned: 0 in 0.472s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:23 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-1bcea859-4890-469e-b6a4-612dc7b301ea tempest-GroupSnapshotsTest-234173950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-de3fa98f-f551-4409-b338-6c56a65c4c3a.info {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:23 devstack sudo[86306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-de3fa98f-f551-4409-b338-6c56a65c4c3a.info
Apr 15 20:08:23 devstack sudo[86306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:23 devstack sudo[86306]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:23 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-1bcea859-4890-469e-b6a4-612dc7b301ea tempest-GroupSnapshotsTest-234173950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-de3fa98f-f551-4409-b338-6c56a65c4c3a.info" returned: 0 in 0.463s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:23 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-1bcea859-4890-469e-b6a4-612dc7b301ea tempest-GroupSnapshotsTest-234173950 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-de3fa98f-f551-4409-b338-6c56a65c4c3a.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 15 20:08:23 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-1bcea859-4890-469e-b6a4-612dc7b301ea tempest-GroupSnapshotsTest-234173950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-de3fa98f-f551-4409-b338-6c56a65c4c3a.info {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:23 devstack sudo[86312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-de3fa98f-f551-4409-b338-6c56a65c4c3a.info
Apr 15 20:08:23 devstack sudo[86312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:24 devstack sudo[86312]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-1bcea859-4890-469e-b6a4-612dc7b301ea tempest-GroupSnapshotsTest-234173950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-de3fa98f-f551-4409-b338-6c56a65c4c3a.info" returned: 0 in 0.489s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-1bcea859-4890-469e-b6a4-612dc7b301ea tempest-GroupSnapshotsTest-234173950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.174s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:08:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-bd67b613-afb6-4601-b600-9cc0364d0b20 tempest-SnapshotsActionsTest-1942023327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.395s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:08:24 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-bd67b613-afb6-4601-b600-9cc0364d0b20 tempest-SnapshotsActionsTest-1942023327 None] Creating offline snapshot 9dfccf06-a9c0-41cb-8ea1-1cf656a076af of volume 652eb0f7-c5d0-4af1-a426-b00a9f1393fe {{(pid=82646) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 20:08:24 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a492bc-426d-4e46-83c0-6866bfbe2c33]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:08:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bd67b613-afb6-4601-b600-9cc0364d0b20 tempest-SnapshotsActionsTest-1942023327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.c4230ee4-7827-436a-9552-81aadcb1de1e {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:24 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-1bcea859-4890-469e-b6a4-612dc7b301ea tempest-GroupSnapshotsTest-234173950 None] group_snapshot 0710f9bd-3d87-4e4b-8ca1-55a5d1aab663: created successfully
Apr 15 20:08:24 devstack sudo[86315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.c4230ee4-7827-436a-9552-81aadcb1de1e
Apr 15 20:08:24 devstack sudo[86315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:24 devstack sudo[86315]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bd67b613-afb6-4601-b600-9cc0364d0b20 tempest-SnapshotsActionsTest-1942023327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.c4230ee4-7827-436a-9552-81aadcb1de1e" returned: 0 in 0.559s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:24 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-bd67b613-afb6-4601-b600-9cc0364d0b20 tempest-SnapshotsActionsTest-1942023327 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82646) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 20:08:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bd67b613-afb6-4601-b600-9cc0364d0b20 tempest-SnapshotsActionsTest-1942023327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.c4230ee4-7827-436a-9552-81aadcb1de1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.9dfccf06-a9c0-41cb-8ea1-1cf656a076af 1G {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:24 devstack sudo[86320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.c4230ee4-7827-436a-9552-81aadcb1de1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.9dfccf06-a9c0-41cb-8ea1-1cf656a076af 1G
Apr 15 20:08:24 devstack sudo[86320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:25 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-068c8c63-693d-4595-839a-d606b9ee3f69 tempest-GroupSnapshotsTest-234173950 None] group_snapshot 0710f9bd-3d87-4e4b-8ca1-55a5d1aab663: deleting
Apr 15 20:08:25 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-068c8c63-693d-4595-839a-d606b9ee3f69 tempest-GroupSnapshotsTest-234173950 None] group_snapshot 0710f9bd-3d87-4e4b-8ca1-55a5d1aab663: deleting {{(pid=82646) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 15 20:08:25 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-068c8c63-693d-4595-839a-d606b9ee3f69 tempest-GroupSnapshotsTest-234173950 None] Acquiring lock "cinder-quobyte-de3fa98f-f551-4409-b338-6c56a65c4c3a" by "delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:08:25 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-068c8c63-693d-4595-839a-d606b9ee3f69 tempest-GroupSnapshotsTest-234173950 None] Lock "cinder-quobyte-de3fa98f-f551-4409-b338-6c56a65c4c3a" acquired by "delete_snapshot" :: waited 0.034s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:08:25 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-068c8c63-693d-4595-839a-d606b9ee3f69 tempest-GroupSnapshotsTest-234173950 None] Acquiring lock "cinder-quobyte-2e02af37-fd15-4f92-a501-f0e7aa7a2590" by "_delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:08:25 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-068c8c63-693d-4595-839a-d606b9ee3f69 tempest-GroupSnapshotsTest-234173950 None] Lock "cinder-quobyte-2e02af37-fd15-4f92-a501-f0e7aa7a2590" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:08:25 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-068c8c63-693d-4595-839a-d606b9ee3f69 tempest-GroupSnapshotsTest-234173950 None] Deleting offline snapshot 2e02af37-fd15-4f92-a501-f0e7aa7a2590 of volume de3fa98f-f551-4409-b338-6c56a65c4c3a {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 20:08:25 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-068c8c63-693d-4595-839a-d606b9ee3f69 tempest-GroupSnapshotsTest-234173950 None] snapshot_file for this snap is: volume-de3fa98f-f551-4409-b338-6c56a65c4c3a.2e02af37-fd15-4f92-a501-f0e7aa7a2590 {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 20:08:25 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[135b4067-15be-4419-96ec-35a23de2d19a]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:08:25 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-068c8c63-693d-4595-839a-d606b9ee3f69 tempest-GroupSnapshotsTest-234173950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-de3fa98f-f551-4409-b338-6c56a65c4c3a.2e02af37-fd15-4f92-a501-f0e7aa7a2590 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:25 devstack sudo[86320]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:25 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bd67b613-afb6-4601-b600-9cc0364d0b20 tempest-SnapshotsActionsTest-1942023327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.c4230ee4-7827-436a-9552-81aadcb1de1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.9dfccf06-a9c0-41cb-8ea1-1cf656a076af 1G" returned: 0 in 0.849s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:25 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bd67b613-afb6-4601-b600-9cc0364d0b20 tempest-SnapshotsActionsTest-1942023327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.c4230ee4-7827-436a-9552-81aadcb1de1e -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.9dfccf06-a9c0-41cb-8ea1-1cf656a076af {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:25 devstack sudo[86353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.c4230ee4-7827-436a-9552-81aadcb1de1e -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.9dfccf06-a9c0-41cb-8ea1-1cf656a076af
Apr 15 20:08:25 devstack sudo[86353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:25 devstack sudo[86351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-de3fa98f-f551-4409-b338-6c56a65c4c3a.2e02af37-fd15-4f92-a501-f0e7aa7a2590
Apr 15 20:08:25 devstack sudo[86351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:26 devstack sudo[86353]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:26 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bd67b613-afb6-4601-b600-9cc0364d0b20 tempest-SnapshotsActionsTest-1942023327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.c4230ee4-7827-436a-9552-81aadcb1de1e -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.9dfccf06-a9c0-41cb-8ea1-1cf656a076af" returned: 0 in 0.779s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:26 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-bd67b613-afb6-4601-b600-9cc0364d0b20 tempest-SnapshotsActionsTest-1942023327 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.9dfccf06-a9c0-41cb-8ea1-1cf656a076af is being set with open permissions: ugo+rw
Apr 15 20:08:26 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bd67b613-afb6-4601-b600-9cc0364d0b20 tempest-SnapshotsActionsTest-1942023327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.9dfccf06-a9c0-41cb-8ea1-1cf656a076af {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:26 devstack sudo[86365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.9dfccf06-a9c0-41cb-8ea1-1cf656a076af
Apr 15 20:08:26 devstack sudo[86365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:26 devstack sudo[86351]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:26 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-068c8c63-693d-4595-839a-d606b9ee3f69 tempest-GroupSnapshotsTest-234173950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-de3fa98f-f551-4409-b338-6c56a65c4c3a.2e02af37-fd15-4f92-a501-f0e7aa7a2590" returned: 0 in 0.879s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:26 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-068c8c63-693d-4595-839a-d606b9ee3f69 tempest-GroupSnapshotsTest-234173950 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de3fa98f-f551-4409-b338-6c56a65c4c3a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82646) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 20:08:26 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a55b17d-1beb-436c-8522-069d4255dae6]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:08:26 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-068c8c63-693d-4595-839a-d606b9ee3f69 tempest-GroupSnapshotsTest-234173950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-de3fa98f-f551-4409-b338-6c56a65c4c3a {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:26 devstack sudo[86367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-de3fa98f-f551-4409-b338-6c56a65c4c3a
Apr 15 20:08:26 devstack sudo[86367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:26 devstack sudo[86365]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:26 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bd67b613-afb6-4601-b600-9cc0364d0b20 tempest-SnapshotsActionsTest-1942023327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.9dfccf06-a9c0-41cb-8ea1-1cf656a076af" returned: 0 in 0.511s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:26 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-bd67b613-afb6-4601-b600-9cc0364d0b20 tempest-SnapshotsActionsTest-1942023327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.781s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:08:26 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-bd67b613-afb6-4601-b600-9cc0364d0b20 tempest-SnapshotsActionsTest-1942023327 None] Create snapshot completed successfully
Apr 15 20:08:27 devstack sudo[86367]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:27 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-068c8c63-693d-4595-839a-d606b9ee3f69 tempest-GroupSnapshotsTest-234173950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-de3fa98f-f551-4409-b338-6c56a65c4c3a" returned: 0 in 0.621s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:27 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-068c8c63-693d-4595-839a-d606b9ee3f69 tempest-GroupSnapshotsTest-234173950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-de3fa98f-f551-4409-b338-6c56a65c4c3a.2e02af37-fd15-4f92-a501-f0e7aa7a2590 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:27 devstack sudo[86373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-de3fa98f-f551-4409-b338-6c56a65c4c3a.2e02af37-fd15-4f92-a501-f0e7aa7a2590
Apr 15 20:08:27 devstack sudo[86373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:27 devstack sudo[86373]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:27 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-068c8c63-693d-4595-839a-d606b9ee3f69 tempest-GroupSnapshotsTest-234173950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-de3fa98f-f551-4409-b338-6c56a65c4c3a.2e02af37-fd15-4f92-a501-f0e7aa7a2590" returned: 0 in 0.665s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:27 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-068c8c63-693d-4595-839a-d606b9ee3f69 tempest-GroupSnapshotsTest-234173950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-de3fa98f-f551-4409-b338-6c56a65c4c3a.2e02af37-fd15-4f92-a501-f0e7aa7a2590 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:27 devstack sudo[86378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-de3fa98f-f551-4409-b338-6c56a65c4c3a.2e02af37-fd15-4f92-a501-f0e7aa7a2590
Apr 15 20:08:27 devstack sudo[86378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:28 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-673da7dc-0098-4b36-8ce9-e95242c85632 tempest-SnapshotsActionsTest-1245122770 None] Acquiring lock "cinder-9dfccf06-a9c0-41cb-8ea1-1cf656a076af-delete_snapshot" by "delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:08:28 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-673da7dc-0098-4b36-8ce9-e95242c85632 tempest-SnapshotsActionsTest-1245122770 None] Lock "cinder-9dfccf06-a9c0-41cb-8ea1-1cf656a076af-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:08:28 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-673da7dc-0098-4b36-8ce9-e95242c85632 tempest-SnapshotsActionsTest-1245122770 None] Acquiring lock "cinder-quobyte-652eb0f7-c5d0-4af1-a426-b00a9f1393fe" by "delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:08:28 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-673da7dc-0098-4b36-8ce9-e95242c85632 tempest-SnapshotsActionsTest-1245122770 None] Lock "cinder-quobyte-652eb0f7-c5d0-4af1-a426-b00a9f1393fe" acquired by "delete_snapshot" :: waited 0.021s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:08:28 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-673da7dc-0098-4b36-8ce9-e95242c85632 tempest-SnapshotsActionsTest-1245122770 None] Acquiring lock "cinder-quobyte-9dfccf06-a9c0-41cb-8ea1-1cf656a076af" by "_delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:08:28 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-673da7dc-0098-4b36-8ce9-e95242c85632 tempest-SnapshotsActionsTest-1245122770 None] Lock "cinder-quobyte-9dfccf06-a9c0-41cb-8ea1-1cf656a076af" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:08:28 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-673da7dc-0098-4b36-8ce9-e95242c85632 tempest-SnapshotsActionsTest-1245122770 None] Deleting offline snapshot 9dfccf06-a9c0-41cb-8ea1-1cf656a076af of volume 652eb0f7-c5d0-4af1-a426-b00a9f1393fe {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 20:08:28 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-673da7dc-0098-4b36-8ce9-e95242c85632 tempest-SnapshotsActionsTest-1245122770 None] snapshot_file for this snap is: volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.9dfccf06-a9c0-41cb-8ea1-1cf656a076af {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 20:08:28 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[c726163f-c1bf-46ed-8b67-75d159ebfeb7]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:08:28 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-673da7dc-0098-4b36-8ce9-e95242c85632 tempest-SnapshotsActionsTest-1245122770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.9dfccf06-a9c0-41cb-8ea1-1cf656a076af {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:28 devstack sudo[86378]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:28 devstack sudo[86382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.9dfccf06-a9c0-41cb-8ea1-1cf656a076af
Apr 15 20:08:28 devstack sudo[86382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:28 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-068c8c63-693d-4595-839a-d606b9ee3f69 tempest-GroupSnapshotsTest-234173950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-de3fa98f-f551-4409-b338-6c56a65c4c3a.2e02af37-fd15-4f92-a501-f0e7aa7a2590" returned: 0 in 0.521s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:28 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-068c8c63-693d-4595-839a-d606b9ee3f69 tempest-GroupSnapshotsTest-234173950 None] Lock "cinder-quobyte-2e02af37-fd15-4f92-a501-f0e7aa7a2590" released by "_delete_snapshot" :: held 2.784s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:08:28 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-068c8c63-693d-4595-839a-d606b9ee3f69 tempest-GroupSnapshotsTest-234173950 None] Lock "cinder-quobyte-de3fa98f-f551-4409-b338-6c56a65c4c3a" released by "delete_snapshot" :: held 2.804s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:08:28 devstack cinder-volume[82646]: WARNING cinder.quota [None req-068c8c63-693d-4595-839a-d606b9ee3f69 tempest-GroupSnapshotsTest-234173950 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-487664078 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-487664078, it is now deprecated. Please use the default quota class for default quota.
Apr 15 20:08:28 devstack cinder-volume[82646]: WARNING cinder.quota [None req-068c8c63-693d-4595-839a-d606b9ee3f69 tempest-GroupSnapshotsTest-234173950 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-487664078 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-487664078, it is now deprecated. Please use the default quota class for default quota.
Apr 15 20:08:28 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-068c8c63-693d-4595-839a-d606b9ee3f69 tempest-GroupSnapshotsTest-234173950 None] Created reservations ['ba264505-7b12-48c4-a5b4-71cb5a206e26', '22f1a85c-566f-4e3a-8dfc-799662e4395c', '84e5164b-d4e4-4c55-8040-f343fb0086b0', 'e2bb6451-0329-428b-875e-f19451105295'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:08:28 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-068c8c63-693d-4595-839a-d606b9ee3f69 tempest-GroupSnapshotsTest-234173950 None] group_snapshot 0710f9bd-3d87-4e4b-8ca1-55a5d1aab663: deleted successfully
Apr 15 20:08:28 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-5e202eb8-a7c5-41fe-98c6-9fa8bf42cb24 tempest-VolumesActionsTest-1120257978 None] Acquiring lock "cinder-684c024b-5c7b-4580-9ec4-2a4f0786e6a3" by "attach_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:08:28 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-5e202eb8-a7c5-41fe-98c6-9fa8bf42cb24 tempest-VolumesActionsTest-1120257978 None] Lock "cinder-684c024b-5c7b-4580-9ec4-2a4f0786e6a3" acquired by "attach_volume" :: waited 0.009s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:08:28 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-5e202eb8-a7c5-41fe-98c6-9fa8bf42cb24 tempest-VolumesActionsTest-1120257978 None] Attaching volume 684c024b-5c7b-4580-9ec4-2a4f0786e6a3 to instance 145d3a86-b48b-463a-9c13-3bad5aaa1f4b at mountpoint /dev/vdb on host None.
Apr 15 20:08:28 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-5e202eb8-a7c5-41fe-98c6-9fa8bf42cb24 tempest-VolumesActionsTest-1120257978 None] Attach volume completed successfully.
Apr 15 20:08:28 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-5e202eb8-a7c5-41fe-98c6-9fa8bf42cb24 tempest-VolumesActionsTest-1120257978 None] Lock "cinder-684c024b-5c7b-4580-9ec4-2a4f0786e6a3" released by "attach_volume" :: held 0.118s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:08:28 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-022064c8-2696-48e4-a87d-6c78619d919e tempest-GroupSnapshotsTest-234173950 None] Acquiring lock "cinder-quobyte-de3fa98f-f551-4409-b338-6c56a65c4c3a" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:08:28 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-022064c8-2696-48e4-a87d-6c78619d919e tempest-GroupSnapshotsTest-234173950 None] Lock "cinder-quobyte-de3fa98f-f551-4409-b338-6c56a65c4c3a" acquired by "delete_volume" :: waited 0.009s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:08:28 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef06c3a-89d9-4f45-81d0-cce1b09bf0bc]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:08:28 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-022064c8-2696-48e4-a87d-6c78619d919e tempest-GroupSnapshotsTest-234173950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-de3fa98f-f551-4409-b338-6c56a65c4c3a {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:28 devstack sudo[86382]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:28 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-673da7dc-0098-4b36-8ce9-e95242c85632 tempest-SnapshotsActionsTest-1245122770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.9dfccf06-a9c0-41cb-8ea1-1cf656a076af" returned: 0 in 0.798s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:28 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-673da7dc-0098-4b36-8ce9-e95242c85632 tempest-SnapshotsActionsTest-1245122770 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82646) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 20:08:29 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3659b3a-d6fb-4572-a9c5-39f5626062e3]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:08:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-673da7dc-0098-4b36-8ce9-e95242c85632 tempest-SnapshotsActionsTest-1245122770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.c4230ee4-7827-436a-9552-81aadcb1de1e {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:29 devstack sudo[86387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-de3fa98f-f551-4409-b338-6c56a65c4c3a
Apr 15 20:08:29 devstack sudo[86387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:29 devstack sudo[86389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.c4230ee4-7827-436a-9552-81aadcb1de1e
Apr 15 20:08:29 devstack sudo[86389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:29 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-48e8a58a-8163-4531-84a3-cb8fe76e15bf tempest-VolumesActionsTest-1120257978 None] Acquiring lock "cinder-684c024b-5c7b-4580-9ec4-2a4f0786e6a3-detach_volume" by "detach_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:08:29 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-48e8a58a-8163-4531-84a3-cb8fe76e15bf tempest-VolumesActionsTest-1120257978 None] Lock "cinder-684c024b-5c7b-4580-9ec4-2a4f0786e6a3-detach_volume" acquired by "detach_volume" :: waited 0.016s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:08:29 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-48e8a58a-8163-4531-84a3-cb8fe76e15bf tempest-VolumesActionsTest-1120257978 None] Detaching volume 684c024b-5c7b-4580-9ec4-2a4f0786e6a3 from instance 145d3a86-b48b-463a-9c13-3bad5aaa1f4b.
Apr 15 20:08:29 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-48e8a58a-8163-4531-84a3-cb8fe76e15bf tempest-VolumesActionsTest-1120257978 None] Detach volume completed successfully.
Apr 15 20:08:29 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-48e8a58a-8163-4531-84a3-cb8fe76e15bf tempest-VolumesActionsTest-1120257978 None] Lock "cinder-684c024b-5c7b-4580-9ec4-2a4f0786e6a3-detach_volume" released by "detach_volume" :: held 0.070s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:08:29 devstack sudo[86387]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-022064c8-2696-48e4-a87d-6c78619d919e tempest-GroupSnapshotsTest-234173950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-de3fa98f-f551-4409-b338-6c56a65c4c3a" returned: 0 in 0.684s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-022064c8-2696-48e4-a87d-6c78619d919e tempest-GroupSnapshotsTest-234173950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-de3fa98f-f551-4409-b338-6c56a65c4c3a {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:29 devstack sudo[86403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-de3fa98f-f551-4409-b338-6c56a65c4c3a
Apr 15 20:08:29 devstack sudo[86403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:29 devstack sudo[86389]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-673da7dc-0098-4b36-8ce9-e95242c85632 tempest-SnapshotsActionsTest-1245122770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.c4230ee4-7827-436a-9552-81aadcb1de1e" returned: 0 in 0.753s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:29 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-673da7dc-0098-4b36-8ce9-e95242c85632 tempest-SnapshotsActionsTest-1245122770 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82646) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 20:08:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-673da7dc-0098-4b36-8ce9-e95242c85632 tempest-SnapshotsActionsTest-1245122770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.9dfccf06-a9c0-41cb-8ea1-1cf656a076af {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:29 devstack sudo[86406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.9dfccf06-a9c0-41cb-8ea1-1cf656a076af
Apr 15 20:08:29 devstack sudo[86406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:30 devstack sudo[86403]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-022064c8-2696-48e4-a87d-6c78619d919e tempest-GroupSnapshotsTest-234173950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-de3fa98f-f551-4409-b338-6c56a65c4c3a" returned: 0 in 0.690s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:30 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-022064c8-2696-48e4-a87d-6c78619d919e tempest-GroupSnapshotsTest-234173950 None] Lock "cinder-quobyte-de3fa98f-f551-4409-b338-6c56a65c4c3a" released by "delete_volume" :: held 1.424s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:08:30 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-022064c8-2696-48e4-a87d-6c78619d919e tempest-GroupSnapshotsTest-234173950 None] Created reservations ['ac42d971-07b2-44c3-ab8b-d1dd0f89076d'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:08:30 devstack cinder-volume[82646]: WARNING cinder.quota [None req-022064c8-2696-48e4-a87d-6c78619d919e tempest-GroupSnapshotsTest-234173950 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-487664078 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-487664078, it is now deprecated. Please use the default quota class for default quota.
Apr 15 20:08:30 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-022064c8-2696-48e4-a87d-6c78619d919e tempest-GroupSnapshotsTest-234173950 None] Created reservations ['82559b81-e566-447c-85b2-659756cdeff7', 'd7e04036-887d-48d2-b90c-46cb6be6ef5a', '16b9c462-9861-4b74-84c3-5c2604bc679a', '5ac91d63-8bc7-4733-8925-03f6f7c54a99'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:08:30 devstack sudo[86406]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-673da7dc-0098-4b36-8ce9-e95242c85632 tempest-SnapshotsActionsTest-1245122770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.9dfccf06-a9c0-41cb-8ea1-1cf656a076af" returned: 0 in 0.801s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-673da7dc-0098-4b36-8ce9-e95242c85632 tempest-SnapshotsActionsTest-1245122770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.9dfccf06-a9c0-41cb-8ea1-1cf656a076af {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:30 devstack sudo[86413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.9dfccf06-a9c0-41cb-8ea1-1cf656a076af
Apr 15 20:08:30 devstack sudo[86413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-022064c8-2696-48e4-a87d-6c78619d919e tempest-GroupSnapshotsTest-234173950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:08:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-022064c8-2696-48e4-a87d-6c78619d919e tempest-GroupSnapshotsTest-234173950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:08:30 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-022064c8-2696-48e4-a87d-6c78619d919e tempest-GroupSnapshotsTest-234173950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:08:30 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-022064c8-2696-48e4-a87d-6c78619d919e tempest-GroupSnapshotsTest-234173950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:08:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-022064c8-2696-48e4-a87d-6c78619d919e tempest-GroupSnapshotsTest-234173950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:08:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-022064c8-2696-48e4-a87d-6c78619d919e tempest-GroupSnapshotsTest-234173950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:30 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [req-29f65263-5a72-4ec0-a92f-48d67cadbe7d req-fe648071-3f0a-47e7-a32a-44b4dc76f55a tempest-VolumesSnapshotsTestJSON-2082211275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:08:30 devstack sudo[86415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:08:30 devstack sudo[86415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:30 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [req-29f65263-5a72-4ec0-a92f-48d67cadbe7d req-fe648071-3f0a-47e7-a32a-44b4dc76f55a tempest-VolumesSnapshotsTestJSON-2082211275 None] Flow 'volume_create_manager' (5deb5a1b-c702-44eb-8244-4254c283448a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:08:30 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [req-29f65263-5a72-4ec0-a92f-48d67cadbe7d req-fe648071-3f0a-47e7-a32a-44b4dc76f55a tempest-VolumesSnapshotsTestJSON-2082211275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb00eb4e-be75-4e75-b0aa-95818f6e4902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:08:30 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [req-29f65263-5a72-4ec0-a92f-48d67cadbe7d req-fe648071-3f0a-47e7-a32a-44b4dc76f55a tempest-VolumesSnapshotsTestJSON-2082211275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb00eb4e-be75-4e75-b0aa-95818f6e4902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:08:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1319259079',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=166ddf68-f385-49ef-a34c-73b8a720e1f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1d549c13ad8465aa105a37766da7f64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:08:31Z,use_quota=True,user_id='305e286305944523a59893ce4e51bd96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:08:30 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [req-29f65263-5a72-4ec0-a92f-48d67cadbe7d req-fe648071-3f0a-47e7-a32a-44b4dc76f55a tempest-VolumesSnapshotsTestJSON-2082211275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3baa9c01-f6fc-4cdd-9c2a-3786b5db3d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:08:30 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [req-29f65263-5a72-4ec0-a92f-48d67cadbe7d req-fe648071-3f0a-47e7-a32a-44b4dc76f55a tempest-VolumesSnapshotsTestJSON-2082211275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3baa9c01-f6fc-4cdd-9c2a-3786b5db3d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:08:30 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [req-29f65263-5a72-4ec0-a92f-48d67cadbe7d req-fe648071-3f0a-47e7-a32a-44b4dc76f55a tempest-VolumesSnapshotsTestJSON-2082211275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c6b2507-af44-40f2-96b2-1f8c11acc7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:08:30 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [req-29f65263-5a72-4ec0-a92f-48d67cadbe7d req-fe648071-3f0a-47e7-a32a-44b4dc76f55a tempest-VolumesSnapshotsTestJSON-2082211275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c6b2507-af44-40f2-96b2-1f8c11acc7ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '166ddf68-f385-49ef-a34c-73b8a720e1f1', 'volume_name': 'volume-166ddf68-f385-49ef-a34c-73b8a720e1f1', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:08:30 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [req-29f65263-5a72-4ec0-a92f-48d67cadbe7d req-fe648071-3f0a-47e7-a32a-44b4dc76f55a tempest-VolumesSnapshotsTestJSON-2082211275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9351bb60-bee8-4a8a-9ba7-2b8f8be0e981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:08:30 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [req-29f65263-5a72-4ec0-a92f-48d67cadbe7d req-fe648071-3f0a-47e7-a32a-44b4dc76f55a tempest-VolumesSnapshotsTestJSON-2082211275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9351bb60-bee8-4a8a-9ba7-2b8f8be0e981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:08:30 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [req-29f65263-5a72-4ec0-a92f-48d67cadbe7d req-fe648071-3f0a-47e7-a32a-44b4dc76f55a tempest-VolumesSnapshotsTestJSON-2082211275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d924c8c0-4c42-47fc-846d-1d1c3ea2e69b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:08:30 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [req-29f65263-5a72-4ec0-a92f-48d67cadbe7d req-fe648071-3f0a-47e7-a32a-44b4dc76f55a tempest-VolumesSnapshotsTestJSON-2082211275 None] Volume 166ddf68-f385-49ef-a34c-73b8a720e1f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-166ddf68-f385-49ef-a34c-73b8a720e1f1', 'volume_size': 1}
Apr 15 20:08:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [req-29f65263-5a72-4ec0-a92f-48d67cadbe7d req-fe648071-3f0a-47e7-a32a-44b4dc76f55a tempest-VolumesSnapshotsTestJSON-2082211275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:08:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [req-29f65263-5a72-4ec0-a92f-48d67cadbe7d req-fe648071-3f0a-47e7-a32a-44b4dc76f55a tempest-VolumesSnapshotsTestJSON-2082211275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:08:30 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [req-29f65263-5a72-4ec0-a92f-48d67cadbe7d req-fe648071-3f0a-47e7-a32a-44b4dc76f55a tempest-VolumesSnapshotsTestJSON-2082211275 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:08:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1319259079',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=166ddf68-f385-49ef-a34c-73b8a720e1f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1d549c13ad8465aa105a37766da7f64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:08:31Z,use_quota=True,user_id='305e286305944523a59893ce4e51bd96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:08:30 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [req-29f65263-5a72-4ec0-a92f-48d67cadbe7d req-fe648071-3f0a-47e7-a32a-44b4dc76f55a tempest-VolumesSnapshotsTestJSON-2082211275 None] Creating volume 166ddf68-f385-49ef-a34c-73b8a720e1f1 {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:08:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [req-29f65263-5a72-4ec0-a92f-48d67cadbe7d req-fe648071-3f0a-47e7-a32a-44b4dc76f55a tempest-VolumesSnapshotsTestJSON-2082211275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:08:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [req-29f65263-5a72-4ec0-a92f-48d67cadbe7d req-fe648071-3f0a-47e7-a32a-44b4dc76f55a tempest-VolumesSnapshotsTestJSON-2082211275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:08:30 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [req-29f65263-5a72-4ec0-a92f-48d67cadbe7d req-fe648071-3f0a-47e7-a32a-44b4dc76f55a tempest-VolumesSnapshotsTestJSON-2082211275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:08:30 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [req-29f65263-5a72-4ec0-a92f-48d67cadbe7d req-fe648071-3f0a-47e7-a32a-44b4dc76f55a tempest-VolumesSnapshotsTestJSON-2082211275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:08:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [req-29f65263-5a72-4ec0-a92f-48d67cadbe7d req-fe648071-3f0a-47e7-a32a-44b4dc76f55a tempest-VolumesSnapshotsTestJSON-2082211275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:08:30 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [req-29f65263-5a72-4ec0-a92f-48d67cadbe7d req-fe648071-3f0a-47e7-a32a-44b4dc76f55a tempest-VolumesSnapshotsTestJSON-2082211275 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:08:30 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [req-29f65263-5a72-4ec0-a92f-48d67cadbe7d req-fe648071-3f0a-47e7-a32a-44b4dc76f55a tempest-VolumesSnapshotsTestJSON-2082211275 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:08:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-29f65263-5a72-4ec0-a92f-48d67cadbe7d req-fe648071-3f0a-47e7-a32a-44b4dc76f55a tempest-VolumesSnapshotsTestJSON-2082211275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-166ddf68-f385-49ef-a34c-73b8a720e1f1 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:30 devstack sudo[86417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-166ddf68-f385-49ef-a34c-73b8a720e1f1 1073741824
Apr 15 20:08:30 devstack sudo[86417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:31 devstack sudo[86413]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-673da7dc-0098-4b36-8ce9-e95242c85632 tempest-SnapshotsActionsTest-1245122770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.9dfccf06-a9c0-41cb-8ea1-1cf656a076af" returned: 0 in 0.514s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:31 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-673da7dc-0098-4b36-8ce9-e95242c85632 tempest-SnapshotsActionsTest-1245122770 None] Lock "cinder-quobyte-9dfccf06-a9c0-41cb-8ea1-1cf656a076af" released by "_delete_snapshot" :: held 2.943s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:08:31 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-673da7dc-0098-4b36-8ce9-e95242c85632 tempest-SnapshotsActionsTest-1245122770 None] Lock "cinder-quobyte-652eb0f7-c5d0-4af1-a426-b00a9f1393fe" released by "delete_snapshot" :: held 2.960s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:08:31 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-673da7dc-0098-4b36-8ce9-e95242c85632 tempest-SnapshotsActionsTest-1245122770 None] Created reservations ['b215b20f-5f75-4fc5-9b54-8957402be49a', '283beb4f-78a3-4bbe-9b72-ae9215941f5c', 'cabb2f6e-c904-4c0a-91dd-30a36bb88a98', '6a29d66a-dae8-4052-820a-9a1733738ef2'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:08:31 devstack sudo[86415]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:31 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-673da7dc-0098-4b36-8ce9-e95242c85632 tempest-SnapshotsActionsTest-1245122770 None] Delete snapshot completed successfully.
Apr 15 20:08:31 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-673da7dc-0098-4b36-8ce9-e95242c85632 tempest-SnapshotsActionsTest-1245122770 None] Lock "cinder-9dfccf06-a9c0-41cb-8ea1-1cf656a076af-delete_snapshot" released by "delete_snapshot" :: held 3.220s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:08:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-022064c8-2696-48e4-a87d-6c78619d919e tempest-GroupSnapshotsTest-234173950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.618s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:31 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-022064c8-2696-48e4-a87d-6c78619d919e tempest-GroupSnapshotsTest-234173950 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:08:31 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-022064c8-2696-48e4-a87d-6c78619d919e tempest-GroupSnapshotsTest-234173950 None] Delete group completed successfully.
Apr 15 20:08:31 devstack sudo[86417]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-29f65263-5a72-4ec0-a92f-48d67cadbe7d req-fe648071-3f0a-47e7-a32a-44b4dc76f55a tempest-VolumesSnapshotsTestJSON-2082211275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-166ddf68-f385-49ef-a34c-73b8a720e1f1 1073741824" returned: 0 in 0.744s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-29f65263-5a72-4ec0-a92f-48d67cadbe7d req-fe648071-3f0a-47e7-a32a-44b4dc76f55a tempest-VolumesSnapshotsTestJSON-2082211275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-166ddf68-f385-49ef-a34c-73b8a720e1f1 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:31 devstack sudo[86452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-166ddf68-f385-49ef-a34c-73b8a720e1f1
Apr 15 20:08:31 devstack sudo[86452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-139948f3-a5b4-454a-a16f-d6ca6a57f04e tempest-SnapshotsActionsTest-1942023327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:08:32 devstack sudo[86452]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-29f65263-5a72-4ec0-a92f-48d67cadbe7d req-fe648071-3f0a-47e7-a32a-44b4dc76f55a tempest-VolumesSnapshotsTestJSON-2082211275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-166ddf68-f385-49ef-a34c-73b8a720e1f1" returned: 0 in 0.516s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:32 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [req-29f65263-5a72-4ec0-a92f-48d67cadbe7d req-fe648071-3f0a-47e7-a32a-44b4dc76f55a tempest-VolumesSnapshotsTestJSON-2082211275 None] <== create_volume: return (1307ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:08:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [req-29f65263-5a72-4ec0-a92f-48d67cadbe7d req-fe648071-3f0a-47e7-a32a-44b4dc76f55a tempest-VolumesSnapshotsTestJSON-2082211275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.309s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:08:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-139948f3-a5b4-454a-a16f-d6ca6a57f04e tempest-SnapshotsActionsTest-1942023327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.365s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:08:32 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [req-29f65263-5a72-4ec0-a92f-48d67cadbe7d req-fe648071-3f0a-47e7-a32a-44b4dc76f55a tempest-VolumesSnapshotsTestJSON-2082211275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d924c8c0-4c42-47fc-846d-1d1c3ea2e69b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-166ddf68-f385-49ef-a34c-73b8a720e1f1', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:08:32 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [req-29f65263-5a72-4ec0-a92f-48d67cadbe7d req-fe648071-3f0a-47e7-a32a-44b4dc76f55a tempest-VolumesSnapshotsTestJSON-2082211275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de022710-1a41-4beb-9981-138557c6b13c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:08:32 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-139948f3-a5b4-454a-a16f-d6ca6a57f04e tempest-SnapshotsActionsTest-1942023327 None] Creating offline snapshot 3afede64-c464-453d-93bf-c3c4073d661f of volume 652eb0f7-c5d0-4af1-a426-b00a9f1393fe {{(pid=82646) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 20:08:32 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [req-29f65263-5a72-4ec0-a92f-48d67cadbe7d req-fe648071-3f0a-47e7-a32a-44b4dc76f55a tempest-VolumesSnapshotsTestJSON-2082211275 None] Volume volume-166ddf68-f385-49ef-a34c-73b8a720e1f1 (166ddf68-f385-49ef-a34c-73b8a720e1f1): created successfully
Apr 15 20:08:32 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [req-29f65263-5a72-4ec0-a92f-48d67cadbe7d req-fe648071-3f0a-47e7-a32a-44b4dc76f55a tempest-VolumesSnapshotsTestJSON-2082211275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de022710-1a41-4beb-9981-138557c6b13c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:08:32 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [req-29f65263-5a72-4ec0-a92f-48d67cadbe7d req-fe648071-3f0a-47e7-a32a-44b4dc76f55a tempest-VolumesSnapshotsTestJSON-2082211275 None] Flow 'volume_create_manager' (5deb5a1b-c702-44eb-8244-4254c283448a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:08:32 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3312cd1-bb5b-47f6-b182-ebc927eeb4f3]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:08:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-139948f3-a5b4-454a-a16f-d6ca6a57f04e tempest-SnapshotsActionsTest-1942023327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.c4230ee4-7827-436a-9552-81aadcb1de1e {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:32 devstack cinder-volume[82646]: INFO cinder.volume.manager [req-29f65263-5a72-4ec0-a92f-48d67cadbe7d req-fe648071-3f0a-47e7-a32a-44b4dc76f55a tempest-VolumesSnapshotsTestJSON-2082211275 None] Created volume successfully.
Apr 15 20:08:32 devstack sudo[86456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.c4230ee4-7827-436a-9552-81aadcb1de1e
Apr 15 20:08:32 devstack sudo[86456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:32 devstack sudo[86456]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-139948f3-a5b4-454a-a16f-d6ca6a57f04e tempest-SnapshotsActionsTest-1942023327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.c4230ee4-7827-436a-9552-81aadcb1de1e" returned: 0 in 0.549s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:32 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-139948f3-a5b4-454a-a16f-d6ca6a57f04e tempest-SnapshotsActionsTest-1942023327 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82646) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 20:08:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-139948f3-a5b4-454a-a16f-d6ca6a57f04e tempest-SnapshotsActionsTest-1942023327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.c4230ee4-7827-436a-9552-81aadcb1de1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.3afede64-c464-453d-93bf-c3c4073d661f 1G {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:32 devstack sudo[86462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.c4230ee4-7827-436a-9552-81aadcb1de1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.3afede64-c464-453d-93bf-c3c4073d661f 1G
Apr 15 20:08:32 devstack sudo[86462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:33 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [req-59ffe393-fb65-444d-aef4-3e748ebb0c63 req-36980dff-d632-4670-abd1-0465c7c93d62 tempest-VolumesSnapshotsTestJSON-2082211275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:08:33 devstack sudo[86462]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:33 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-139948f3-a5b4-454a-a16f-d6ca6a57f04e tempest-SnapshotsActionsTest-1942023327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.c4230ee4-7827-436a-9552-81aadcb1de1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.3afede64-c464-453d-93bf-c3c4073d661f 1G" returned: 0 in 0.636s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:33 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-139948f3-a5b4-454a-a16f-d6ca6a57f04e tempest-SnapshotsActionsTest-1942023327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.c4230ee4-7827-436a-9552-81aadcb1de1e -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.3afede64-c464-453d-93bf-c3c4073d661f {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:33 devstack sudo[86474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.c4230ee4-7827-436a-9552-81aadcb1de1e -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.3afede64-c464-453d-93bf-c3c4073d661f
Apr 15 20:08:33 devstack sudo[86474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:33 devstack sudo[86474]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:33 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-139948f3-a5b4-454a-a16f-d6ca6a57f04e tempest-SnapshotsActionsTest-1942023327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.c4230ee4-7827-436a-9552-81aadcb1de1e -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.3afede64-c464-453d-93bf-c3c4073d661f" returned: 0 in 0.503s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:33 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-139948f3-a5b4-454a-a16f-d6ca6a57f04e tempest-SnapshotsActionsTest-1942023327 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.3afede64-c464-453d-93bf-c3c4073d661f is being set with open permissions: ugo+rw
Apr 15 20:08:33 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-139948f3-a5b4-454a-a16f-d6ca6a57f04e tempest-SnapshotsActionsTest-1942023327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.3afede64-c464-453d-93bf-c3c4073d661f {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:33 devstack sudo[86479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.3afede64-c464-453d-93bf-c3c4073d661f
Apr 15 20:08:33 devstack sudo[86479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:34 devstack sudo[86479]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:34 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-139948f3-a5b4-454a-a16f-d6ca6a57f04e tempest-SnapshotsActionsTest-1942023327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.3afede64-c464-453d-93bf-c3c4073d661f" returned: 0 in 0.446s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:34 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-139948f3-a5b4-454a-a16f-d6ca6a57f04e tempest-SnapshotsActionsTest-1942023327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.221s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:08:34 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [req-59ffe393-fb65-444d-aef4-3e748ebb0c63 req-36980dff-d632-4670-abd1-0465c7c93d62 tempest-VolumesSnapshotsTestJSON-2082211275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.243s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:08:34 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [req-59ffe393-fb65-444d-aef4-3e748ebb0c63 req-36980dff-d632-4670-abd1-0465c7c93d62 tempest-VolumesSnapshotsTestJSON-2082211275 None] Creating offline snapshot f192232b-0322-4f93-abcb-39ea0a808cb4 of volume 166ddf68-f385-49ef-a34c-73b8a720e1f1 {{(pid=82646) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 20:08:34 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf3281c-ad54-49ce-b8dc-60c62cc0b926]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:08:34 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-59ffe393-fb65-444d-aef4-3e748ebb0c63 req-36980dff-d632-4670-abd1-0465c7c93d62 tempest-VolumesSnapshotsTestJSON-2082211275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-166ddf68-f385-49ef-a34c-73b8a720e1f1 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:34 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-139948f3-a5b4-454a-a16f-d6ca6a57f04e tempest-SnapshotsActionsTest-1942023327 None] Create snapshot completed successfully
Apr 15 20:08:34 devstack sudo[86482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-166ddf68-f385-49ef-a34c-73b8a720e1f1
Apr 15 20:08:34 devstack sudo[86482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:34 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-2f828ccd-13c7-4129-bd9e-6c756936916e tempest-GroupSnapshotsV319Test-516094084 None] Group tempest-GroupSnapshotsV319Test-Group-1253112271: creating
Apr 15 20:08:34 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-2f828ccd-13c7-4129-bd9e-6c756936916e tempest-GroupSnapshotsV319Test-516094084 None] Group tempest-GroupSnapshotsV319Test-Group-1253112271: created successfully
Apr 15 20:08:34 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-2f828ccd-13c7-4129-bd9e-6c756936916e tempest-GroupSnapshotsV319Test-516094084 None] Create group completed successfully.
Apr 15 20:08:34 devstack sudo[86482]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:34 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-59ffe393-fb65-444d-aef4-3e748ebb0c63 req-36980dff-d632-4670-abd1-0465c7c93d62 tempest-VolumesSnapshotsTestJSON-2082211275 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-166ddf68-f385-49ef-a34c-73b8a720e1f1" returned: 0 in 0.554s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:34 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-59ffe393-fb65-444d-aef4-3e748ebb0c63 req-36980dff-d632-4670-abd1-0465c7c93d62 tempest-VolumesSnapshotsTestJSON-2082211275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-166ddf68-f385-49ef-a34c-73b8a720e1f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-166ddf68-f385-49ef-a34c-73b8a720e1f1.f192232b-0322-4f93-abcb-39ea0a808cb4 1G {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:34 devstack sudo[86487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-166ddf68-f385-49ef-a34c-73b8a720e1f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-166ddf68-f385-49ef-a34c-73b8a720e1f1.f192232b-0322-4f93-abcb-39ea0a808cb4 1G
Apr 15 20:08:34 devstack sudo[86487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:34 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-62270852-a38a-4464-ad3b-991bacce5e96 tempest-SnapshotsActionsTest-1245122770 None] Acquiring lock "cinder-3afede64-c464-453d-93bf-c3c4073d661f-delete_snapshot" by "delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:08:34 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-62270852-a38a-4464-ad3b-991bacce5e96 tempest-SnapshotsActionsTest-1245122770 None] Lock "cinder-3afede64-c464-453d-93bf-c3c4073d661f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:08:34 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-62270852-a38a-4464-ad3b-991bacce5e96 tempest-SnapshotsActionsTest-1245122770 None] Acquiring lock "cinder-quobyte-652eb0f7-c5d0-4af1-a426-b00a9f1393fe" by "delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:08:34 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-62270852-a38a-4464-ad3b-991bacce5e96 tempest-SnapshotsActionsTest-1245122770 None] Lock "cinder-quobyte-652eb0f7-c5d0-4af1-a426-b00a9f1393fe" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:08:34 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-62270852-a38a-4464-ad3b-991bacce5e96 tempest-SnapshotsActionsTest-1245122770 None] Acquiring lock "cinder-quobyte-3afede64-c464-453d-93bf-c3c4073d661f" by "_delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:08:34 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-62270852-a38a-4464-ad3b-991bacce5e96 tempest-SnapshotsActionsTest-1245122770 None] Lock "cinder-quobyte-3afede64-c464-453d-93bf-c3c4073d661f" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:08:34 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-62270852-a38a-4464-ad3b-991bacce5e96 tempest-SnapshotsActionsTest-1245122770 None] Deleting offline snapshot 3afede64-c464-453d-93bf-c3c4073d661f of volume 652eb0f7-c5d0-4af1-a426-b00a9f1393fe {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 20:08:34 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-62270852-a38a-4464-ad3b-991bacce5e96 tempest-SnapshotsActionsTest-1245122770 None] snapshot_file for this snap is: volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.3afede64-c464-453d-93bf-c3c4073d661f {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 20:08:34 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[4561f120-b995-4ca4-9c9f-734c0b40ca30]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:08:34 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-62270852-a38a-4464-ad3b-991bacce5e96 tempest-SnapshotsActionsTest-1245122770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.3afede64-c464-453d-93bf-c3c4073d661f {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:35 devstack sudo[86489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.3afede64-c464-453d-93bf-c3c4073d661f
Apr 15 20:08:35 devstack sudo[86489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:35 devstack sudo[86487]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:35 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-59ffe393-fb65-444d-aef4-3e748ebb0c63 req-36980dff-d632-4670-abd1-0465c7c93d62 tempest-VolumesSnapshotsTestJSON-2082211275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-166ddf68-f385-49ef-a34c-73b8a720e1f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-166ddf68-f385-49ef-a34c-73b8a720e1f1.f192232b-0322-4f93-abcb-39ea0a808cb4 1G" returned: 0 in 0.493s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:35 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-59ffe393-fb65-444d-aef4-3e748ebb0c63 req-36980dff-d632-4670-abd1-0465c7c93d62 tempest-VolumesSnapshotsTestJSON-2082211275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-166ddf68-f385-49ef-a34c-73b8a720e1f1 -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-166ddf68-f385-49ef-a34c-73b8a720e1f1.f192232b-0322-4f93-abcb-39ea0a808cb4 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:35 devstack sudo[86497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-166ddf68-f385-49ef-a34c-73b8a720e1f1 -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-166ddf68-f385-49ef-a34c-73b8a720e1f1.f192232b-0322-4f93-abcb-39ea0a808cb4
Apr 15 20:08:35 devstack sudo[86497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:35 devstack sudo[86489]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:35 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-62270852-a38a-4464-ad3b-991bacce5e96 tempest-SnapshotsActionsTest-1245122770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.3afede64-c464-453d-93bf-c3c4073d661f" returned: 0 in 0.508s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:35 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-62270852-a38a-4464-ad3b-991bacce5e96 tempest-SnapshotsActionsTest-1245122770 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82646) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 20:08:35 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ea1350-4f6c-46d1-b7b5-d108029ca300]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:08:35 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-62270852-a38a-4464-ad3b-991bacce5e96 tempest-SnapshotsActionsTest-1245122770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.c4230ee4-7827-436a-9552-81aadcb1de1e {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:35 devstack sudo[86499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.c4230ee4-7827-436a-9552-81aadcb1de1e
Apr 15 20:08:35 devstack sudo[86499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:35 devstack sudo[86497]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:35 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-59ffe393-fb65-444d-aef4-3e748ebb0c63 req-36980dff-d632-4670-abd1-0465c7c93d62 tempest-VolumesSnapshotsTestJSON-2082211275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-166ddf68-f385-49ef-a34c-73b8a720e1f1 -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-166ddf68-f385-49ef-a34c-73b8a720e1f1.f192232b-0322-4f93-abcb-39ea0a808cb4" returned: 0 in 0.476s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:35 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [req-59ffe393-fb65-444d-aef4-3e748ebb0c63 req-36980dff-d632-4670-abd1-0465c7c93d62 tempest-VolumesSnapshotsTestJSON-2082211275 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-166ddf68-f385-49ef-a34c-73b8a720e1f1.f192232b-0322-4f93-abcb-39ea0a808cb4 is being set with open permissions: ugo+rw
Apr 15 20:08:35 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-59ffe393-fb65-444d-aef4-3e748ebb0c63 req-36980dff-d632-4670-abd1-0465c7c93d62 tempest-VolumesSnapshotsTestJSON-2082211275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-166ddf68-f385-49ef-a34c-73b8a720e1f1.f192232b-0322-4f93-abcb-39ea0a808cb4 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:35 devstack sudo[86504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-166ddf68-f385-49ef-a34c-73b8a720e1f1.f192232b-0322-4f93-abcb-39ea0a808cb4
Apr 15 20:08:35 devstack sudo[86504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:36 devstack sudo[86499]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:36 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-62270852-a38a-4464-ad3b-991bacce5e96 tempest-SnapshotsActionsTest-1245122770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.c4230ee4-7827-436a-9552-81aadcb1de1e" returned: 0 in 0.595s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:36 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-62270852-a38a-4464-ad3b-991bacce5e96 tempest-SnapshotsActionsTest-1245122770 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82646) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 20:08:36 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-62270852-a38a-4464-ad3b-991bacce5e96 tempest-SnapshotsActionsTest-1245122770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.3afede64-c464-453d-93bf-c3c4073d661f {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:36 devstack sudo[86510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.3afede64-c464-453d-93bf-c3c4073d661f
Apr 15 20:08:36 devstack sudo[86510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:36 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-06608f13-8dc1-4b2c-9cce-a839ecc172b9 tempest-GroupSnapshotsV319Test-516094084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:08:36 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-06608f13-8dc1-4b2c-9cce-a839ecc172b9 tempest-GroupSnapshotsV319Test-516094084 None] Flow 'volume_create_manager' (3c511c87-3675-437f-8514-effd11614d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:08:36 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-06608f13-8dc1-4b2c-9cce-a839ecc172b9 tempest-GroupSnapshotsV319Test-516094084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d0f9b3b-d2c4-478e-902e-8f5063a26a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:08:36 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-06608f13-8dc1-4b2c-9cce-a839ecc172b9 tempest-GroupSnapshotsV319Test-516094084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d0f9b3b-d2c4-478e-902e-8f5063a26a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:08:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1390183122',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=150f9488-6922-4eef-92bb-abd13cdd04bc,host='devstack@QuobyteHD#QuobyteHD',id=8248c4d5-d909-4575-a9de-686ede7a2fe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0718833431b0492fb1fe5bf50d872468',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:08:36Z,use_quota=True,user_id='16237c90c5b94b589e9c850c193a1e7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6541a3b9-9f98-4a7d-a703-c1d53ca8338a),volume_type_id=6541a3b9-9f98-4a7d-a703-c1d53ca8338a)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:08:36 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-06608f13-8dc1-4b2c-9cce-a839ecc172b9 tempest-GroupSnapshotsV319Test-516094084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d00f1445-905e-4e0d-9e75-dc422911948a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:08:36 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-06608f13-8dc1-4b2c-9cce-a839ecc172b9 tempest-GroupSnapshotsV319Test-516094084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d00f1445-905e-4e0d-9e75-dc422911948a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:08:36 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-06608f13-8dc1-4b2c-9cce-a839ecc172b9 tempest-GroupSnapshotsV319Test-516094084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11e54496-b78f-472c-9acc-3dca6193032e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:08:36 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-06608f13-8dc1-4b2c-9cce-a839ecc172b9 tempest-GroupSnapshotsV319Test-516094084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11e54496-b78f-472c-9acc-3dca6193032e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8248c4d5-d909-4575-a9de-686ede7a2fe4', 'volume_name': 'volume-8248c4d5-d909-4575-a9de-686ede7a2fe4', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:08:36 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-06608f13-8dc1-4b2c-9cce-a839ecc172b9 tempest-GroupSnapshotsV319Test-516094084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a83cad9-319e-49f0-8a58-f2b0ec25c09d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:08:36 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-06608f13-8dc1-4b2c-9cce-a839ecc172b9 tempest-GroupSnapshotsV319Test-516094084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a83cad9-319e-49f0-8a58-f2b0ec25c09d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:08:36 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-06608f13-8dc1-4b2c-9cce-a839ecc172b9 tempest-GroupSnapshotsV319Test-516094084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d87e8ce-a95b-434c-b829-a9deb2636f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:08:36 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-06608f13-8dc1-4b2c-9cce-a839ecc172b9 tempest-GroupSnapshotsV319Test-516094084 None] Volume 8248c4d5-d909-4575-a9de-686ede7a2fe4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8248c4d5-d909-4575-a9de-686ede7a2fe4', 'volume_size': 1}
Apr 15 20:08:36 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-06608f13-8dc1-4b2c-9cce-a839ecc172b9 tempest-GroupSnapshotsV319Test-516094084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:08:36 devstack sudo[86504]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:36 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-59ffe393-fb65-444d-aef4-3e748ebb0c63 req-36980dff-d632-4670-abd1-0465c7c93d62 tempest-VolumesSnapshotsTestJSON-2082211275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-166ddf68-f385-49ef-a34c-73b8a720e1f1.f192232b-0322-4f93-abcb-39ea0a808cb4" returned: 0 in 0.591s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:36 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-59ffe393-fb65-444d-aef4-3e748ebb0c63 req-36980dff-d632-4670-abd1-0465c7c93d62 tempest-VolumesSnapshotsTestJSON-2082211275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-166ddf68-f385-49ef-a34c-73b8a720e1f1.info {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:36 devstack sudo[86513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-166ddf68-f385-49ef-a34c-73b8a720e1f1.info
Apr 15 20:08:36 devstack sudo[86513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:36 devstack sudo[86510]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:36 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-62270852-a38a-4464-ad3b-991bacce5e96 tempest-SnapshotsActionsTest-1245122770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.3afede64-c464-453d-93bf-c3c4073d661f" returned: 0 in 0.653s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:36 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-62270852-a38a-4464-ad3b-991bacce5e96 tempest-SnapshotsActionsTest-1245122770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.3afede64-c464-453d-93bf-c3c4073d661f {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:36 devstack sudo[86518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.3afede64-c464-453d-93bf-c3c4073d661f
Apr 15 20:08:36 devstack sudo[86518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:37 devstack sudo[86513]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:37 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-59ffe393-fb65-444d-aef4-3e748ebb0c63 req-36980dff-d632-4670-abd1-0465c7c93d62 tempest-VolumesSnapshotsTestJSON-2082211275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-166ddf68-f385-49ef-a34c-73b8a720e1f1.info" returned: 0 in 0.548s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:37 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [req-59ffe393-fb65-444d-aef4-3e748ebb0c63 req-36980dff-d632-4670-abd1-0465c7c93d62 tempest-VolumesSnapshotsTestJSON-2082211275 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-166ddf68-f385-49ef-a34c-73b8a720e1f1.info is being set with open permissions: ugo+rw
Apr 15 20:08:37 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-59ffe393-fb65-444d-aef4-3e748ebb0c63 req-36980dff-d632-4670-abd1-0465c7c93d62 tempest-VolumesSnapshotsTestJSON-2082211275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-166ddf68-f385-49ef-a34c-73b8a720e1f1.info {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:37 devstack sudo[86521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-166ddf68-f385-49ef-a34c-73b8a720e1f1.info
Apr 15 20:08:37 devstack sudo[86521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:37 devstack sudo[86518]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:37 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-62270852-a38a-4464-ad3b-991bacce5e96 tempest-SnapshotsActionsTest-1245122770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.3afede64-c464-453d-93bf-c3c4073d661f" returned: 0 in 0.516s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:37 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-62270852-a38a-4464-ad3b-991bacce5e96 tempest-SnapshotsActionsTest-1245122770 None] Lock "cinder-quobyte-3afede64-c464-453d-93bf-c3c4073d661f" released by "_delete_snapshot" :: held 2.336s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:08:37 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-62270852-a38a-4464-ad3b-991bacce5e96 tempest-SnapshotsActionsTest-1245122770 None] Lock "cinder-quobyte-652eb0f7-c5d0-4af1-a426-b00a9f1393fe" released by "delete_snapshot" :: held 2.350s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:08:37 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-daa01615-d58b-4dd6-830b-80efe62e4c6d tempest-VolumesActionsTest-1120257978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:08:37 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-62270852-a38a-4464-ad3b-991bacce5e96 tempest-SnapshotsActionsTest-1245122770 None] Created reservations ['8d803423-8973-4811-994e-d10e285cec68', '01ef8771-3a31-4f67-b9b2-386b2568cf21', 'ca464751-c7fb-4572-91e5-4276444e112a', 'fe34570b-0e67-4938-ae7f-e47fca2fcd8b'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:08:37 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-62270852-a38a-4464-ad3b-991bacce5e96 tempest-SnapshotsActionsTest-1245122770 None] Delete snapshot completed successfully.
Apr 15 20:08:37 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-62270852-a38a-4464-ad3b-991bacce5e96 tempest-SnapshotsActionsTest-1245122770 None] Lock "cinder-3afede64-c464-453d-93bf-c3c4073d661f-delete_snapshot" released by "delete_snapshot" :: held 2.470s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:08:37 devstack sudo[86521]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:37 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-59ffe393-fb65-444d-aef4-3e748ebb0c63 req-36980dff-d632-4670-abd1-0465c7c93d62 tempest-VolumesSnapshotsTestJSON-2082211275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-166ddf68-f385-49ef-a34c-73b8a720e1f1.info" returned: 0 in 0.471s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:37 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [req-59ffe393-fb65-444d-aef4-3e748ebb0c63 req-36980dff-d632-4670-abd1-0465c7c93d62 tempest-VolumesSnapshotsTestJSON-2082211275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.200s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:08:37 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-06608f13-8dc1-4b2c-9cce-a839ecc172b9 tempest-GroupSnapshotsV319Test-516094084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.246s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:08:37 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-06608f13-8dc1-4b2c-9cce-a839ecc172b9 tempest-GroupSnapshotsV319Test-516094084 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=150f9488-6922-4eef-92bb-abd13cdd04bc,created_at=2026-04-15T18:08:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1390183122',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=150f9488-6922-4eef-92bb-abd13cdd04bc,host='devstack@QuobyteHD#QuobyteHD',id=8248c4d5-d909-4575-a9de-686ede7a2fe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0718833431b0492fb1fe5bf50d872468',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:08:36Z,use_quota=True,user_id='16237c90c5b94b589e9c850c193a1e7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6541a3b9-9f98-4a7d-a703-c1d53ca8338a),volume_type_id=6541a3b9-9f98-4a7d-a703-c1d53ca8338a)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:08:37 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-06608f13-8dc1-4b2c-9cce-a839ecc172b9 tempest-GroupSnapshotsV319Test-516094084 None] Creating volume 8248c4d5-d909-4575-a9de-686ede7a2fe4 {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:08:37 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-06608f13-8dc1-4b2c-9cce-a839ecc172b9 tempest-GroupSnapshotsV319Test-516094084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:08:37 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-06608f13-8dc1-4b2c-9cce-a839ecc172b9 tempest-GroupSnapshotsV319Test-516094084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:08:37 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-06608f13-8dc1-4b2c-9cce-a839ecc172b9 tempest-GroupSnapshotsV319Test-516094084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:08:37 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-06608f13-8dc1-4b2c-9cce-a839ecc172b9 tempest-GroupSnapshotsV319Test-516094084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:08:37 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-06608f13-8dc1-4b2c-9cce-a839ecc172b9 tempest-GroupSnapshotsV319Test-516094084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:08:37 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-06608f13-8dc1-4b2c-9cce-a839ecc172b9 tempest-GroupSnapshotsV319Test-516094084 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:08:37 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-06608f13-8dc1-4b2c-9cce-a839ecc172b9 tempest-GroupSnapshotsV319Test-516094084 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:08:37 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-06608f13-8dc1-4b2c-9cce-a839ecc172b9 tempest-GroupSnapshotsV319Test-516094084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8248c4d5-d909-4575-a9de-686ede7a2fe4 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:37 devstack sudo[86525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8248c4d5-d909-4575-a9de-686ede7a2fe4 1073741824
Apr 15 20:08:37 devstack sudo[86525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:37 devstack cinder-volume[82646]: INFO cinder.volume.manager [req-59ffe393-fb65-444d-aef4-3e748ebb0c63 req-36980dff-d632-4670-abd1-0465c7c93d62 tempest-VolumesSnapshotsTestJSON-2082211275 None] Create snapshot completed successfully
Apr 15 20:08:37 devstack cinder-volume[82646]: DEBUG cinder.coordination [req-1f593df2-e86d-49b8-b579-332834af17ed req-024afd8e-0969-4dfc-a061-9b20bb9c6b0c tempest-VolumesSnapshotsTestJSON-2082211275 None] Acquiring lock "cinder-f192232b-0322-4f93-abcb-39ea0a808cb4-delete_snapshot" by "delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:08:37 devstack cinder-volume[82646]: DEBUG cinder.coordination [req-1f593df2-e86d-49b8-b579-332834af17ed req-024afd8e-0969-4dfc-a061-9b20bb9c6b0c tempest-VolumesSnapshotsTestJSON-2082211275 None] Lock "cinder-f192232b-0322-4f93-abcb-39ea0a808cb4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:08:37 devstack cinder-volume[82646]: DEBUG cinder.coordination [req-1f593df2-e86d-49b8-b579-332834af17ed req-024afd8e-0969-4dfc-a061-9b20bb9c6b0c tempest-VolumesSnapshotsTestJSON-2082211275 None] Acquiring lock "cinder-quobyte-166ddf68-f385-49ef-a34c-73b8a720e1f1" by "delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:08:37 devstack cinder-volume[82646]: DEBUG cinder.coordination [req-1f593df2-e86d-49b8-b579-332834af17ed req-024afd8e-0969-4dfc-a061-9b20bb9c6b0c tempest-VolumesSnapshotsTestJSON-2082211275 None] Lock "cinder-quobyte-166ddf68-f385-49ef-a34c-73b8a720e1f1" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:08:37 devstack cinder-volume[82646]: DEBUG cinder.coordination [req-1f593df2-e86d-49b8-b579-332834af17ed req-024afd8e-0969-4dfc-a061-9b20bb9c6b0c tempest-VolumesSnapshotsTestJSON-2082211275 None] Acquiring lock "cinder-quobyte-f192232b-0322-4f93-abcb-39ea0a808cb4" by "_delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:08:37 devstack cinder-volume[82646]: DEBUG cinder.coordination [req-1f593df2-e86d-49b8-b579-332834af17ed req-024afd8e-0969-4dfc-a061-9b20bb9c6b0c tempest-VolumesSnapshotsTestJSON-2082211275 None] Lock "cinder-quobyte-f192232b-0322-4f93-abcb-39ea0a808cb4" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:08:37 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [req-1f593df2-e86d-49b8-b579-332834af17ed req-024afd8e-0969-4dfc-a061-9b20bb9c6b0c tempest-VolumesSnapshotsTestJSON-2082211275 None] Deleting offline snapshot f192232b-0322-4f93-abcb-39ea0a808cb4 of volume 166ddf68-f385-49ef-a34c-73b8a720e1f1 {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 20:08:37 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [req-1f593df2-e86d-49b8-b579-332834af17ed req-024afd8e-0969-4dfc-a061-9b20bb9c6b0c tempest-VolumesSnapshotsTestJSON-2082211275 None] snapshot_file for this snap is: volume-166ddf68-f385-49ef-a34c-73b8a720e1f1.f192232b-0322-4f93-abcb-39ea0a808cb4 {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 20:08:37 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b8a337-0998-4a8a-9c0e-88d4f63406f0]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:08:37 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-1f593df2-e86d-49b8-b579-332834af17ed req-024afd8e-0969-4dfc-a061-9b20bb9c6b0c tempest-VolumesSnapshotsTestJSON-2082211275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-166ddf68-f385-49ef-a34c-73b8a720e1f1.f192232b-0322-4f93-abcb-39ea0a808cb4 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:37 devstack sudo[86527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-166ddf68-f385-49ef-a34c-73b8a720e1f1.f192232b-0322-4f93-abcb-39ea0a808cb4
Apr 15 20:08:37 devstack sudo[86527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:38 devstack sudo[86525]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:38 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-06608f13-8dc1-4b2c-9cce-a839ecc172b9 tempest-GroupSnapshotsV319Test-516094084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8248c4d5-d909-4575-a9de-686ede7a2fe4 1073741824" returned: 0 in 0.650s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:38 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-06608f13-8dc1-4b2c-9cce-a839ecc172b9 tempest-GroupSnapshotsV319Test-516094084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8248c4d5-d909-4575-a9de-686ede7a2fe4 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:38 devstack sudo[86535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8248c4d5-d909-4575-a9de-686ede7a2fe4
Apr 15 20:08:38 devstack sudo[86535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:38 devstack sudo[86527]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:38 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-1f593df2-e86d-49b8-b579-332834af17ed req-024afd8e-0969-4dfc-a061-9b20bb9c6b0c tempest-VolumesSnapshotsTestJSON-2082211275 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-166ddf68-f385-49ef-a34c-73b8a720e1f1.f192232b-0322-4f93-abcb-39ea0a808cb4" returned: 0 in 0.555s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:38 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [req-1f593df2-e86d-49b8-b579-332834af17ed req-024afd8e-0969-4dfc-a061-9b20bb9c6b0c tempest-VolumesSnapshotsTestJSON-2082211275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-166ddf68-f385-49ef-a34c-73b8a720e1f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82646) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 20:08:38 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f02894-0b9f-45c4-9098-8e61e9d531ff]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:08:38 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-1f593df2-e86d-49b8-b579-332834af17ed req-024afd8e-0969-4dfc-a061-9b20bb9c6b0c tempest-VolumesSnapshotsTestJSON-2082211275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-166ddf68-f385-49ef-a34c-73b8a720e1f1 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:38 devstack sudo[86537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-166ddf68-f385-49ef-a34c-73b8a720e1f1
Apr 15 20:08:38 devstack sudo[86537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:38 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-60c92e8c-5423-4794-8cb5-26424f275267 tempest-SnapshotsActionsTest-1942023327 None] Acquiring lock "cinder-c4230ee4-7827-436a-9552-81aadcb1de1e-delete_snapshot" by "delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:08:38 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-60c92e8c-5423-4794-8cb5-26424f275267 tempest-SnapshotsActionsTest-1942023327 None] Lock "cinder-c4230ee4-7827-436a-9552-81aadcb1de1e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:08:38 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-60c92e8c-5423-4794-8cb5-26424f275267 tempest-SnapshotsActionsTest-1942023327 None] Acquiring lock "cinder-quobyte-652eb0f7-c5d0-4af1-a426-b00a9f1393fe" by "delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:08:38 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-60c92e8c-5423-4794-8cb5-26424f275267 tempest-SnapshotsActionsTest-1942023327 None] Lock "cinder-quobyte-652eb0f7-c5d0-4af1-a426-b00a9f1393fe" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:08:38 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-60c92e8c-5423-4794-8cb5-26424f275267 tempest-SnapshotsActionsTest-1942023327 None] Acquiring lock "cinder-quobyte-c4230ee4-7827-436a-9552-81aadcb1de1e" by "_delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:08:38 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-60c92e8c-5423-4794-8cb5-26424f275267 tempest-SnapshotsActionsTest-1942023327 None] Lock "cinder-quobyte-c4230ee4-7827-436a-9552-81aadcb1de1e" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:08:38 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-60c92e8c-5423-4794-8cb5-26424f275267 tempest-SnapshotsActionsTest-1942023327 None] Deleting offline snapshot c4230ee4-7827-436a-9552-81aadcb1de1e of volume 652eb0f7-c5d0-4af1-a426-b00a9f1393fe {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 20:08:38 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-60c92e8c-5423-4794-8cb5-26424f275267 tempest-SnapshotsActionsTest-1942023327 None] snapshot_file for this snap is: volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.c4230ee4-7827-436a-9552-81aadcb1de1e {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 20:08:38 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[10172ed0-7163-4eb5-bc2d-e45a7e864cbf]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:08:38 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-60c92e8c-5423-4794-8cb5-26424f275267 tempest-SnapshotsActionsTest-1942023327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.c4230ee4-7827-436a-9552-81aadcb1de1e {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:38 devstack sudo[86539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.c4230ee4-7827-436a-9552-81aadcb1de1e
Apr 15 20:08:38 devstack sudo[86539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:38 devstack sudo[86535]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:38 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-06608f13-8dc1-4b2c-9cce-a839ecc172b9 tempest-GroupSnapshotsV319Test-516094084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8248c4d5-d909-4575-a9de-686ede7a2fe4" returned: 0 in 0.545s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:38 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-06608f13-8dc1-4b2c-9cce-a839ecc172b9 tempest-GroupSnapshotsV319Test-516094084 None] <== create_volume: return (1227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:08:38 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-06608f13-8dc1-4b2c-9cce-a839ecc172b9 tempest-GroupSnapshotsV319Test-516094084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.230s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:08:38 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-daa01615-d58b-4dd6-830b-80efe62e4c6d tempest-VolumesActionsTest-1120257978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.423s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:08:38 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d77db2-e1e4-41c8-a8e0-0aa5038edcdc]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:08:38 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-daa01615-d58b-4dd6-830b-80efe62e4c6d tempest-VolumesActionsTest-1120257978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-684c024b-5c7b-4580-9ec4-2a4f0786e6a3 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:38 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-06608f13-8dc1-4b2c-9cce-a839ecc172b9 tempest-GroupSnapshotsV319Test-516094084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d87e8ce-a95b-434c-b829-a9deb2636f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8248c4d5-d909-4575-a9de-686ede7a2fe4', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:08:38 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-06608f13-8dc1-4b2c-9cce-a839ecc172b9 tempest-GroupSnapshotsV319Test-516094084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (685ad05e-f756-4290-a518-17186e1d27f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:08:38 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-06608f13-8dc1-4b2c-9cce-a839ecc172b9 tempest-GroupSnapshotsV319Test-516094084 None] Volume volume-8248c4d5-d909-4575-a9de-686ede7a2fe4 (8248c4d5-d909-4575-a9de-686ede7a2fe4): created successfully
Apr 15 20:08:38 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-06608f13-8dc1-4b2c-9cce-a839ecc172b9 tempest-GroupSnapshotsV319Test-516094084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (685ad05e-f756-4290-a518-17186e1d27f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:08:38 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-06608f13-8dc1-4b2c-9cce-a839ecc172b9 tempest-GroupSnapshotsV319Test-516094084 None] Flow 'volume_create_manager' (3c511c87-3675-437f-8514-effd11614d6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:08:38 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-06608f13-8dc1-4b2c-9cce-a839ecc172b9 tempest-GroupSnapshotsV319Test-516094084 None] Created volume successfully.
Apr 15 20:08:38 devstack sudo[86545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-684c024b-5c7b-4580-9ec4-2a4f0786e6a3
Apr 15 20:08:38 devstack sudo[86545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:38 devstack sudo[86537]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:38 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-1f593df2-e86d-49b8-b579-332834af17ed req-024afd8e-0969-4dfc-a061-9b20bb9c6b0c tempest-VolumesSnapshotsTestJSON-2082211275 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-166ddf68-f385-49ef-a34c-73b8a720e1f1" returned: 0 in 0.605s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:38 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-1f593df2-e86d-49b8-b579-332834af17ed req-024afd8e-0969-4dfc-a061-9b20bb9c6b0c tempest-VolumesSnapshotsTestJSON-2082211275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-166ddf68-f385-49ef-a34c-73b8a720e1f1.f192232b-0322-4f93-abcb-39ea0a808cb4 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:38 devstack sudo[86547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-166ddf68-f385-49ef-a34c-73b8a720e1f1.f192232b-0322-4f93-abcb-39ea0a808cb4
Apr 15 20:08:38 devstack sudo[86547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:39 devstack sudo[86539]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:39 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-60c92e8c-5423-4794-8cb5-26424f275267 tempest-SnapshotsActionsTest-1942023327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.c4230ee4-7827-436a-9552-81aadcb1de1e" returned: 0 in 0.540s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:39 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-60c92e8c-5423-4794-8cb5-26424f275267 tempest-SnapshotsActionsTest-1942023327 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82646) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 20:08:39 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9fd487-5d89-465c-bcdc-1e7ec6ff7759]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:08:39 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-60c92e8c-5423-4794-8cb5-26424f275267 tempest-SnapshotsActionsTest-1942023327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:39 devstack sudo[86552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe
Apr 15 20:08:39 devstack sudo[86552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:39 devstack sudo[86545]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:39 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-daa01615-d58b-4dd6-830b-80efe62e4c6d tempest-VolumesActionsTest-1120257978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-684c024b-5c7b-4580-9ec4-2a4f0786e6a3" returned: 0 in 0.486s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:39 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[601ac276-3f08-4953-a7c2-4fa420b4f71d]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:08:39 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-daa01615-d58b-4dd6-830b-80efe62e4c6d tempest-VolumesActionsTest-1120257978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-684c024b-5c7b-4580-9ec4-2a4f0786e6a3 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:39 devstack sudo[86557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-684c024b-5c7b-4580-9ec4-2a4f0786e6a3
Apr 15 20:08:39 devstack sudo[86557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:39 devstack sudo[86547]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:39 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-1f593df2-e86d-49b8-b579-332834af17ed req-024afd8e-0969-4dfc-a061-9b20bb9c6b0c tempest-VolumesSnapshotsTestJSON-2082211275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-166ddf68-f385-49ef-a34c-73b8a720e1f1.f192232b-0322-4f93-abcb-39ea0a808cb4" returned: 0 in 0.594s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:39 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-1f593df2-e86d-49b8-b579-332834af17ed req-024afd8e-0969-4dfc-a061-9b20bb9c6b0c tempest-VolumesSnapshotsTestJSON-2082211275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-166ddf68-f385-49ef-a34c-73b8a720e1f1.f192232b-0322-4f93-abcb-39ea0a808cb4 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:39 devstack sudo[86562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-166ddf68-f385-49ef-a34c-73b8a720e1f1.f192232b-0322-4f93-abcb-39ea0a808cb4
Apr 15 20:08:39 devstack sudo[86562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:39 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-d6432be7-25c8-4dcf-8000-22402553af24 tempest-GroupSnapshotsV319Test-516094084 None] GroupSnapshot 91e02ed7-d5b8-456f-a060-34dec97e1ee0: creating.
Apr 15 20:08:39 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d6432be7-25c8-4dcf-8000-22402553af24 tempest-GroupSnapshotsV319Test-516094084 None] Group snapshot 91e02ed7-d5b8-456f-a060-34dec97e1ee0: creating. {{(pid=82646) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 15 20:08:39 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-d6432be7-25c8-4dcf-8000-22402553af24 tempest-GroupSnapshotsV319Test-516094084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:08:39 devstack sudo[86552]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:39 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-60c92e8c-5423-4794-8cb5-26424f275267 tempest-SnapshotsActionsTest-1942023327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe" returned: 0 in 0.639s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:39 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-60c92e8c-5423-4794-8cb5-26424f275267 tempest-SnapshotsActionsTest-1942023327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.c4230ee4-7827-436a-9552-81aadcb1de1e {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:39 devstack sudo[86567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.c4230ee4-7827-436a-9552-81aadcb1de1e
Apr 15 20:08:39 devstack sudo[86567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:39 devstack sudo[86557]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:39 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-daa01615-d58b-4dd6-830b-80efe62e4c6d tempest-VolumesActionsTest-1120257978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-684c024b-5c7b-4580-9ec4-2a4f0786e6a3" returned: 0 in 0.645s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:39 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-daa01615-d58b-4dd6-830b-80efe62e4c6d tempest-VolumesActionsTest-1120257978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-684c024b-5c7b-4580-9ec4-2a4f0786e6a3 /opt/stack/data/cinder/conversion/684c024b-5c7b-4580-9ec4-2a4f0786e6a3.temp_image.06770453-6203-4fe0-ae4e-2d1dc54f3b43spwdd7cl.img {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:39 devstack sudo[86572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-684c024b-5c7b-4580-9ec4-2a4f0786e6a3 /opt/stack/data/cinder/conversion/684c024b-5c7b-4580-9ec4-2a4f0786e6a3.temp_image.06770453-6203-4fe0-ae4e-2d1dc54f3b43spwdd7cl.img
Apr 15 20:08:39 devstack sudo[86572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:40 devstack sudo[86562]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:40 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-1f593df2-e86d-49b8-b579-332834af17ed req-024afd8e-0969-4dfc-a061-9b20bb9c6b0c tempest-VolumesSnapshotsTestJSON-2082211275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-166ddf68-f385-49ef-a34c-73b8a720e1f1.f192232b-0322-4f93-abcb-39ea0a808cb4" returned: 0 in 0.545s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:40 devstack cinder-volume[82646]: DEBUG cinder.coordination [req-1f593df2-e86d-49b8-b579-332834af17ed req-024afd8e-0969-4dfc-a061-9b20bb9c6b0c tempest-VolumesSnapshotsTestJSON-2082211275 None] Lock "cinder-quobyte-f192232b-0322-4f93-abcb-39ea0a808cb4" released by "_delete_snapshot" :: held 2.367s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:08:40 devstack cinder-volume[82646]: DEBUG cinder.coordination [req-1f593df2-e86d-49b8-b579-332834af17ed req-024afd8e-0969-4dfc-a061-9b20bb9c6b0c tempest-VolumesSnapshotsTestJSON-2082211275 None] Lock "cinder-quobyte-166ddf68-f385-49ef-a34c-73b8a720e1f1" released by "delete_snapshot" :: held 2.382s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:08:40 devstack cinder-volume[82646]: DEBUG cinder.quota [req-1f593df2-e86d-49b8-b579-332834af17ed req-024afd8e-0969-4dfc-a061-9b20bb9c6b0c tempest-VolumesSnapshotsTestJSON-2082211275 None] Created reservations ['44233631-73cc-4e0a-940a-3caf74ec78a6', '21775624-d995-44e5-a181-c4179a9c8097', '5d6b7b25-d4d8-416a-bb11-07e2a24d4b49', 'd6d98add-57ef-4097-9b6b-45712963a99d'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:08:40 devstack cinder-volume[82646]: INFO cinder.volume.manager [req-1f593df2-e86d-49b8-b579-332834af17ed req-024afd8e-0969-4dfc-a061-9b20bb9c6b0c tempest-VolumesSnapshotsTestJSON-2082211275 None] Delete snapshot completed successfully.
Apr 15 20:08:40 devstack cinder-volume[82646]: DEBUG cinder.coordination [req-1f593df2-e86d-49b8-b579-332834af17ed req-024afd8e-0969-4dfc-a061-9b20bb9c6b0c tempest-VolumesSnapshotsTestJSON-2082211275 None] Lock "cinder-f192232b-0322-4f93-abcb-39ea0a808cb4-delete_snapshot" released by "delete_snapshot" :: held 2.480s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:08:40 devstack sudo[86567]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:40 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-60c92e8c-5423-4794-8cb5-26424f275267 tempest-SnapshotsActionsTest-1942023327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.c4230ee4-7827-436a-9552-81aadcb1de1e" returned: 0 in 0.540s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:40 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-60c92e8c-5423-4794-8cb5-26424f275267 tempest-SnapshotsActionsTest-1942023327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.c4230ee4-7827-436a-9552-81aadcb1de1e {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:40 devstack sudo[86578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.c4230ee4-7827-436a-9552-81aadcb1de1e
Apr 15 20:08:40 devstack sudo[86578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:41 devstack cinder-volume[82646]: DEBUG cinder.coordination [req-44999424-c5b3-4c63-abfc-c56ad18b6ec5 req-870c7f95-3219-4b23-aaa4-bb7f8716b0c0 tempest-VolumesSnapshotsTestJSON-2082211275 None] Acquiring lock "cinder-166ddf68-f385-49ef-a34c-73b8a720e1f1-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:08:41 devstack cinder-volume[82646]: DEBUG cinder.coordination [req-44999424-c5b3-4c63-abfc-c56ad18b6ec5 req-870c7f95-3219-4b23-aaa4-bb7f8716b0c0 tempest-VolumesSnapshotsTestJSON-2082211275 None] Lock "cinder-166ddf68-f385-49ef-a34c-73b8a720e1f1-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:08:41 devstack cinder-volume[82646]: DEBUG cinder.coordination [req-44999424-c5b3-4c63-abfc-c56ad18b6ec5 req-870c7f95-3219-4b23-aaa4-bb7f8716b0c0 tempest-VolumesSnapshotsTestJSON-2082211275 None] Acquiring lock "cinder-quobyte-166ddf68-f385-49ef-a34c-73b8a720e1f1" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:08:41 devstack cinder-volume[82646]: DEBUG cinder.coordination [req-44999424-c5b3-4c63-abfc-c56ad18b6ec5 req-870c7f95-3219-4b23-aaa4-bb7f8716b0c0 tempest-VolumesSnapshotsTestJSON-2082211275 None] Lock "cinder-quobyte-166ddf68-f385-49ef-a34c-73b8a720e1f1" acquired by "delete_volume" :: waited 0.046s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:08:41 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e28a74-ef8c-4df9-9930-40329f93341a]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:08:41 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-44999424-c5b3-4c63-abfc-c56ad18b6ec5 req-870c7f95-3219-4b23-aaa4-bb7f8716b0c0 tempest-VolumesSnapshotsTestJSON-2082211275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-166ddf68-f385-49ef-a34c-73b8a720e1f1 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:41 devstack sudo[86578]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:41 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-60c92e8c-5423-4794-8cb5-26424f275267 tempest-SnapshotsActionsTest-1942023327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe.c4230ee4-7827-436a-9552-81aadcb1de1e" returned: 0 in 1.154s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:41 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-60c92e8c-5423-4794-8cb5-26424f275267 tempest-SnapshotsActionsTest-1942023327 None] Lock "cinder-quobyte-c4230ee4-7827-436a-9552-81aadcb1de1e" released by "_delete_snapshot" :: held 2.956s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:08:41 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-60c92e8c-5423-4794-8cb5-26424f275267 tempest-SnapshotsActionsTest-1942023327 None] Lock "cinder-quobyte-652eb0f7-c5d0-4af1-a426-b00a9f1393fe" released by "delete_snapshot" :: held 2.972s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:08:41 devstack sudo[86591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-166ddf68-f385-49ef-a34c-73b8a720e1f1
Apr 15 20:08:41 devstack sudo[86591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:41 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-60c92e8c-5423-4794-8cb5-26424f275267 tempest-SnapshotsActionsTest-1942023327 None] Created reservations ['c569608b-2882-422f-a26d-c8c64038917d', 'a6ff618f-f951-4336-ab08-8b9a01ce46cc', '64636d67-020b-400e-8a8e-d7c2a3a758d9', '7c4cc8de-31d8-432d-9efd-9d22ca35f331'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:08:41 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-60c92e8c-5423-4794-8cb5-26424f275267 tempest-SnapshotsActionsTest-1942023327 None] Delete snapshot completed successfully.
Apr 15 20:08:41 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-60c92e8c-5423-4794-8cb5-26424f275267 tempest-SnapshotsActionsTest-1942023327 None] Lock "cinder-c4230ee4-7827-436a-9552-81aadcb1de1e-delete_snapshot" released by "delete_snapshot" :: held 3.172s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:08:41 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-801cc672-f29b-4660-92af-5b301faaccb7 tempest-SnapshotsActionsTest-1942023327 None] Acquiring lock "cinder-652eb0f7-c5d0-4af1-a426-b00a9f1393fe-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:08:41 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-801cc672-f29b-4660-92af-5b301faaccb7 tempest-SnapshotsActionsTest-1942023327 None] Lock "cinder-652eb0f7-c5d0-4af1-a426-b00a9f1393fe-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:08:42 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-801cc672-f29b-4660-92af-5b301faaccb7 tempest-SnapshotsActionsTest-1942023327 None] Acquiring lock "cinder-quobyte-652eb0f7-c5d0-4af1-a426-b00a9f1393fe" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:08:42 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-801cc672-f29b-4660-92af-5b301faaccb7 tempest-SnapshotsActionsTest-1942023327 None] Lock "cinder-quobyte-652eb0f7-c5d0-4af1-a426-b00a9f1393fe" acquired by "delete_volume" :: waited 0.037s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:08:42 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4052aea-9351-4398-ae3e-69c1ba00e6e4]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:08:42 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-801cc672-f29b-4660-92af-5b301faaccb7 tempest-SnapshotsActionsTest-1942023327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:42 devstack sudo[86593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe
Apr 15 20:08:42 devstack sudo[86593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:42 devstack sudo[86572]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:42 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-daa01615-d58b-4dd6-830b-80efe62e4c6d tempest-VolumesActionsTest-1120257978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-684c024b-5c7b-4580-9ec4-2a4f0786e6a3 /opt/stack/data/cinder/conversion/684c024b-5c7b-4580-9ec4-2a4f0786e6a3.temp_image.06770453-6203-4fe0-ae4e-2d1dc54f3b43spwdd7cl.img" returned: 0 in 2.329s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:42 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[42fe0f40-2be6-4911-86d9-85e3ce400c34]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:08:42 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-daa01615-d58b-4dd6-830b-80efe62e4c6d tempest-VolumesActionsTest-1120257978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-684c024b-5c7b-4580-9ec4-2a4f0786e6a3 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:42 devstack sudo[86595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-684c024b-5c7b-4580-9ec4-2a4f0786e6a3
Apr 15 20:08:42 devstack sudo[86595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:42 devstack sudo[86591]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:42 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-44999424-c5b3-4c63-abfc-c56ad18b6ec5 req-870c7f95-3219-4b23-aaa4-bb7f8716b0c0 tempest-VolumesSnapshotsTestJSON-2082211275 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-166ddf68-f385-49ef-a34c-73b8a720e1f1" returned: 0 in 1.139s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:42 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-44999424-c5b3-4c63-abfc-c56ad18b6ec5 req-870c7f95-3219-4b23-aaa4-bb7f8716b0c0 tempest-VolumesSnapshotsTestJSON-2082211275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-166ddf68-f385-49ef-a34c-73b8a720e1f1 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:42 devstack sudo[86600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-166ddf68-f385-49ef-a34c-73b8a720e1f1
Apr 15 20:08:42 devstack sudo[86600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:42 devstack sudo[86593]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:42 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-801cc672-f29b-4660-92af-5b301faaccb7 tempest-SnapshotsActionsTest-1942023327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe" returned: 0 in 0.537s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:42 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-801cc672-f29b-4660-92af-5b301faaccb7 tempest-SnapshotsActionsTest-1942023327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:42 devstack sudo[86639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe
Apr 15 20:08:42 devstack sudo[86639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:42 devstack sudo[86600]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:42 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-44999424-c5b3-4c63-abfc-c56ad18b6ec5 req-870c7f95-3219-4b23-aaa4-bb7f8716b0c0 tempest-VolumesSnapshotsTestJSON-2082211275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-166ddf68-f385-49ef-a34c-73b8a720e1f1" returned: 0 in 0.453s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:42 devstack cinder-volume[82646]: DEBUG cinder.coordination [req-44999424-c5b3-4c63-abfc-c56ad18b6ec5 req-870c7f95-3219-4b23-aaa4-bb7f8716b0c0 tempest-VolumesSnapshotsTestJSON-2082211275 None] Lock "cinder-quobyte-166ddf68-f385-49ef-a34c-73b8a720e1f1" released by "delete_volume" :: held 1.661s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:08:42 devstack cinder-volume[82646]: DEBUG cinder.quota [req-44999424-c5b3-4c63-abfc-c56ad18b6ec5 req-870c7f95-3219-4b23-aaa4-bb7f8716b0c0 tempest-VolumesSnapshotsTestJSON-2082211275 None] Created reservations ['ddf47a7d-8bd8-415c-b4ff-8cc4cbdad510', '132f55d8-36e1-47af-ba6f-da5e1e7eee1f', 'd1e0dccd-edaf-4bd7-a6eb-2869e374d964', '63f86cc9-6b6c-42ec-8067-6b7b1dfc1edc'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:08:42 devstack sudo[86595]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:42 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-daa01615-d58b-4dd6-830b-80efe62e4c6d tempest-VolumesActionsTest-1120257978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-684c024b-5c7b-4580-9ec4-2a4f0786e6a3" returned: 0 in 0.648s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:42 devstack cinder-volume[82646]: DEBUG cinder.image.image_utils [None req-daa01615-d58b-4dd6-830b-80efe62e4c6d tempest-VolumesActionsTest-1120257978 None] Image conversion details: src /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-684c024b-5c7b-4580-9ec4-2a4f0786e6a3, size 1024.00 MB, duration 2.33 sec, destination /opt/stack/data/cinder/conversion/684c024b-5c7b-4580-9ec4-2a4f0786e6a3.temp_image.06770453-6203-4fe0-ae4e-2d1dc54f3b43spwdd7cl.img {{(pid=82646) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 20:08:42 devstack cinder-volume[82646]: INFO cinder.image.image_utils [None req-daa01615-d58b-4dd6-830b-80efe62e4c6d tempest-VolumesActionsTest-1120257978 None] Converted 1024.00 MB image at 439.31 MB/s
Apr 15 20:08:42 devstack cinder-volume[82646]: DEBUG cinder.image.image_utils [None req-daa01615-d58b-4dd6-830b-80efe62e4c6d tempest-VolumesActionsTest-1120257978 None] 06770453-6203-4fe0-ae4e-2d1dc54f3b43 was raw, no need to convert to raw {{(pid=82646) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}}
Apr 15 20:08:42 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [req-44999424-c5b3-4c63-abfc-c56ad18b6ec5 req-870c7f95-3219-4b23-aaa4-bb7f8716b0c0 tempest-VolumesSnapshotsTestJSON-2082211275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:08:42 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [req-44999424-c5b3-4c63-abfc-c56ad18b6ec5 req-870c7f95-3219-4b23-aaa4-bb7f8716b0c0 tempest-VolumesSnapshotsTestJSON-2082211275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:08:42 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [req-44999424-c5b3-4c63-abfc-c56ad18b6ec5 req-870c7f95-3219-4b23-aaa4-bb7f8716b0c0 tempest-VolumesSnapshotsTestJSON-2082211275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:08:42 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [req-44999424-c5b3-4c63-abfc-c56ad18b6ec5 req-870c7f95-3219-4b23-aaa4-bb7f8716b0c0 tempest-VolumesSnapshotsTestJSON-2082211275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:08:42 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [req-44999424-c5b3-4c63-abfc-c56ad18b6ec5 req-870c7f95-3219-4b23-aaa4-bb7f8716b0c0 tempest-VolumesSnapshotsTestJSON-2082211275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:08:42 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-44999424-c5b3-4c63-abfc-c56ad18b6ec5 req-870c7f95-3219-4b23-aaa4-bb7f8716b0c0 tempest-VolumesSnapshotsTestJSON-2082211275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:42 devstack sudo[86645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:08:42 devstack sudo[86645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:43 devstack sudo[86639]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:43 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-801cc672-f29b-4660-92af-5b301faaccb7 tempest-SnapshotsActionsTest-1942023327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-652eb0f7-c5d0-4af1-a426-b00a9f1393fe" returned: 0 in 0.521s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:43 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-801cc672-f29b-4660-92af-5b301faaccb7 tempest-SnapshotsActionsTest-1942023327 None] Lock "cinder-quobyte-652eb0f7-c5d0-4af1-a426-b00a9f1393fe" released by "delete_volume" :: held 1.134s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:08:43 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-801cc672-f29b-4660-92af-5b301faaccb7 tempest-SnapshotsActionsTest-1942023327 None] Created reservations ['f353c15b-fe07-4069-ba7b-c9582e670b01', '0115805a-8d2e-4731-984e-0180bece7650', '1d1432db-5615-4ec1-9cf3-0ea936c88030', 'b17a5142-62f7-49fd-9020-e2dad358916c'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:08:43 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-801cc672-f29b-4660-92af-5b301faaccb7 tempest-SnapshotsActionsTest-1942023327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:08:43 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-801cc672-f29b-4660-92af-5b301faaccb7 tempest-SnapshotsActionsTest-1942023327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:08:43 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-801cc672-f29b-4660-92af-5b301faaccb7 tempest-SnapshotsActionsTest-1942023327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:08:43 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-801cc672-f29b-4660-92af-5b301faaccb7 tempest-SnapshotsActionsTest-1942023327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:08:43 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-801cc672-f29b-4660-92af-5b301faaccb7 tempest-SnapshotsActionsTest-1942023327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:08:43 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-801cc672-f29b-4660-92af-5b301faaccb7 tempest-SnapshotsActionsTest-1942023327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:43 devstack sudo[86649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:08:43 devstack sudo[86649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:43 devstack sudo[86645]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:43 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [req-44999424-c5b3-4c63-abfc-c56ad18b6ec5 req-870c7f95-3219-4b23-aaa4-bb7f8716b0c0 tempest-VolumesSnapshotsTestJSON-2082211275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.533s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:43 devstack cinder-volume[82646]: DEBUG cinder.manager [req-44999424-c5b3-4c63-abfc-c56ad18b6ec5 req-870c7f95-3219-4b23-aaa4-bb7f8716b0c0 tempest-VolumesSnapshotsTestJSON-2082211275 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:08:43 devstack cinder-volume[82646]: INFO cinder.volume.manager [req-44999424-c5b3-4c63-abfc-c56ad18b6ec5 req-870c7f95-3219-4b23-aaa4-bb7f8716b0c0 tempest-VolumesSnapshotsTestJSON-2082211275 None] Deleted volume successfully.
Apr 15 20:08:43 devstack cinder-volume[82646]: DEBUG cinder.coordination [req-44999424-c5b3-4c63-abfc-c56ad18b6ec5 req-870c7f95-3219-4b23-aaa4-bb7f8716b0c0 tempest-VolumesSnapshotsTestJSON-2082211275 None] Lock "cinder-166ddf68-f385-49ef-a34c-73b8a720e1f1-delete_volume" released by "delete_volume" :: held 2.463s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:08:43 devstack sudo[86649]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:43 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-801cc672-f29b-4660-92af-5b301faaccb7 tempest-SnapshotsActionsTest-1942023327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.568s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:43 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-801cc672-f29b-4660-92af-5b301faaccb7 tempest-SnapshotsActionsTest-1942023327 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:08:43 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-801cc672-f29b-4660-92af-5b301faaccb7 tempest-SnapshotsActionsTest-1942023327 None] Deleted volume successfully.
Apr 15 20:08:43 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-801cc672-f29b-4660-92af-5b301faaccb7 tempest-SnapshotsActionsTest-1942023327 None] Lock "cinder-652eb0f7-c5d0-4af1-a426-b00a9f1393fe-delete_volume" released by "delete_volume" :: held 2.057s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:08:48 devstack cinder-volume[82646]: DEBUG dbcounter [-] [82646] Writing DB stats cinder:SELECT=186,cinder:UPDATE=186,cinder:INSERT=52,cinder:DELETE=9 {{(pid=82646) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 20:08:48 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-8ed8bcf0-9a7a-407c-9ab4-114072219fd7 tempest-GroupsV320Test-1173457978 None] Group tempest-GroupsV320Test-Group-555276478: creating
Apr 15 20:08:48 devstack cinder-volume[82646]: DEBUG dbcounter [-] [82646] Writing DB stats cinder:SELECT=179,cinder:UPDATE=181,cinder:INSERT=42,cinder:DELETE=11 {{(pid=82646) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 20:08:48 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-8ed8bcf0-9a7a-407c-9ab4-114072219fd7 tempest-GroupsV320Test-1173457978 None] Group tempest-GroupsV320Test-Group-555276478: created successfully
Apr 15 20:08:48 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-8ed8bcf0-9a7a-407c-9ab4-114072219fd7 tempest-GroupsV320Test-1173457978 None] Create group completed successfully.
Apr 15 20:08:48 devstack cinder-volume[82646]: DEBUG oslo_service.periodic_task [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 15 20:08:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:08:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:08:48 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:08:48 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:08:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:08:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:48 devstack sudo[86655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:08:48 devstack sudo[86655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:49 devstack sudo[86655]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:49 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.516s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:49 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:08:50 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-6295e092-d87a-4622-ae23-12892493575d tempest-GroupsV320Test-1173457978 None] Created reservations ['7b61c0db-238c-4c98-91e0-9ee1cd3d894a'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:08:50 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-6295e092-d87a-4622-ae23-12892493575d tempest-GroupsV320Test-1173457978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:08:50 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-6295e092-d87a-4622-ae23-12892493575d tempest-GroupsV320Test-1173457978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:08:50 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-6295e092-d87a-4622-ae23-12892493575d tempest-GroupsV320Test-1173457978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:08:50 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-6295e092-d87a-4622-ae23-12892493575d tempest-GroupsV320Test-1173457978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:08:50 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-6295e092-d87a-4622-ae23-12892493575d tempest-GroupsV320Test-1173457978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:08:50 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6295e092-d87a-4622-ae23-12892493575d tempest-GroupsV320Test-1173457978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:50 devstack sudo[86658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:08:50 devstack sudo[86658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:51 devstack sudo[86658]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:51 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6295e092-d87a-4622-ae23-12892493575d tempest-GroupsV320Test-1173457978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.564s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:51 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-6295e092-d87a-4622-ae23-12892493575d tempest-GroupsV320Test-1173457978 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:08:51 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-6295e092-d87a-4622-ae23-12892493575d tempest-GroupsV320Test-1173457978 None] Delete group completed successfully.
Apr 15 20:08:52 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-76016d4d-f738-4102-ad13-0b9d6efd9031 tempest-VolumesServicesTestJSON-482099905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:08:53 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-76016d4d-f738-4102-ad13-0b9d6efd9031 tempest-VolumesServicesTestJSON-482099905 None] Flow 'volume_create_manager' (4c85f89e-b5d0-4ab8-b2a3-8b304e510968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:08:53 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-76016d4d-f738-4102-ad13-0b9d6efd9031 tempest-VolumesServicesTestJSON-482099905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e0afb21-54b9-4a00-a2f5-6f46438e1352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:08:53 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-76016d4d-f738-4102-ad13-0b9d6efd9031 tempest-VolumesServicesTestJSON-482099905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e0afb21-54b9-4a00-a2f5-6f46438e1352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-22677094',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a81a9f40-6ba1-4c26-9645-89a329adc6bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e00941e72efb497babd880c569058a0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:08:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:08:53Z,use_quota=True,user_id='dcfcd7d8ffeb490994d5abf56addc005',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:08:53 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-76016d4d-f738-4102-ad13-0b9d6efd9031 tempest-VolumesServicesTestJSON-482099905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02aab51e-b63b-4d58-9789-97460daf10bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:08:53 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-76016d4d-f738-4102-ad13-0b9d6efd9031 tempest-VolumesServicesTestJSON-482099905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02aab51e-b63b-4d58-9789-97460daf10bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:08:53 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-76016d4d-f738-4102-ad13-0b9d6efd9031 tempest-VolumesServicesTestJSON-482099905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e620e0c-7123-45b2-9c0a-f7ca39874f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:08:53 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-76016d4d-f738-4102-ad13-0b9d6efd9031 tempest-VolumesServicesTestJSON-482099905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e620e0c-7123-45b2-9c0a-f7ca39874f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a81a9f40-6ba1-4c26-9645-89a329adc6bf', 'volume_name': 'volume-a81a9f40-6ba1-4c26-9645-89a329adc6bf', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:08:53 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-76016d4d-f738-4102-ad13-0b9d6efd9031 tempest-VolumesServicesTestJSON-482099905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9a8052e-bced-4a57-a7f7-f8c2d05b73a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:08:53 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-76016d4d-f738-4102-ad13-0b9d6efd9031 tempest-VolumesServicesTestJSON-482099905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9a8052e-bced-4a57-a7f7-f8c2d05b73a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:08:53 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-76016d4d-f738-4102-ad13-0b9d6efd9031 tempest-VolumesServicesTestJSON-482099905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ebcc6fb-0798-4d0a-abbb-94384e134372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:08:53 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-76016d4d-f738-4102-ad13-0b9d6efd9031 tempest-VolumesServicesTestJSON-482099905 None] Volume a81a9f40-6ba1-4c26-9645-89a329adc6bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a81a9f40-6ba1-4c26-9645-89a329adc6bf', 'volume_size': 1}
Apr 15 20:08:53 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-76016d4d-f738-4102-ad13-0b9d6efd9031 tempest-VolumesServicesTestJSON-482099905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:08:54 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-daa01615-d58b-4dd6-830b-80efe62e4c6d tempest-VolumesActionsTest-1120257978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 15.501s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:08:54 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-daa01615-d58b-4dd6-830b-80efe62e4c6d tempest-VolumesActionsTest-1120257978 None] Uploaded volume to glance image-id: 06770453-6203-4fe0-ae4e-2d1dc54f3b43. {{(pid=82646) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 15 20:08:54 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-d6432be7-25c8-4dcf-8000-22402553af24 tempest-GroupSnapshotsV319Test-516094084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 14.623s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:08:54 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-d6432be7-25c8-4dcf-8000-22402553af24 tempest-GroupSnapshotsV319Test-516094084 None] Creating offline snapshot 4289547b-8686-4177-9f63-85e0d49f5152 of volume 8248c4d5-d909-4575-a9de-686ede7a2fe4 {{(pid=82646) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 20:08:54 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9720566-6d00-4954-a83c-ddd0b4be1d6f]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:08:54 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d6432be7-25c8-4dcf-8000-22402553af24 tempest-GroupSnapshotsV319Test-516094084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8248c4d5-d909-4575-a9de-686ede7a2fe4 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:54 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-daa01615-d58b-4dd6-830b-80efe62e4c6d tempest-VolumesActionsTest-1120257978 None] Copy volume to image completed successfully.
Apr 15 20:08:54 devstack sudo[86661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8248c4d5-d909-4575-a9de-686ede7a2fe4
Apr 15 20:08:54 devstack sudo[86661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:54 devstack sudo[86661]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:54 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d6432be7-25c8-4dcf-8000-22402553af24 tempest-GroupSnapshotsV319Test-516094084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8248c4d5-d909-4575-a9de-686ede7a2fe4" returned: 0 in 0.529s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:54 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d6432be7-25c8-4dcf-8000-22402553af24 tempest-GroupSnapshotsV319Test-516094084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8248c4d5-d909-4575-a9de-686ede7a2fe4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8248c4d5-d909-4575-a9de-686ede7a2fe4.4289547b-8686-4177-9f63-85e0d49f5152 1G {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:54 devstack sudo[86666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8248c4d5-d909-4575-a9de-686ede7a2fe4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8248c4d5-d909-4575-a9de-686ede7a2fe4.4289547b-8686-4177-9f63-85e0d49f5152 1G
Apr 15 20:08:54 devstack sudo[86666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:55 devstack sudo[86666]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:55 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d6432be7-25c8-4dcf-8000-22402553af24 tempest-GroupSnapshotsV319Test-516094084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8248c4d5-d909-4575-a9de-686ede7a2fe4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8248c4d5-d909-4575-a9de-686ede7a2fe4.4289547b-8686-4177-9f63-85e0d49f5152 1G" returned: 0 in 0.576s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:55 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d6432be7-25c8-4dcf-8000-22402553af24 tempest-GroupSnapshotsV319Test-516094084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8248c4d5-d909-4575-a9de-686ede7a2fe4 -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8248c4d5-d909-4575-a9de-686ede7a2fe4.4289547b-8686-4177-9f63-85e0d49f5152 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:55 devstack sudo[86671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8248c4d5-d909-4575-a9de-686ede7a2fe4 -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8248c4d5-d909-4575-a9de-686ede7a2fe4.4289547b-8686-4177-9f63-85e0d49f5152
Apr 15 20:08:55 devstack sudo[86671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:55 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-fec9b767-a198-4442-ac40-e0191de11a33 tempest-VolumesActionsTest-1120257978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:08:55 devstack sudo[86671]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:55 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d6432be7-25c8-4dcf-8000-22402553af24 tempest-GroupSnapshotsV319Test-516094084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8248c4d5-d909-4575-a9de-686ede7a2fe4 -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8248c4d5-d909-4575-a9de-686ede7a2fe4.4289547b-8686-4177-9f63-85e0d49f5152" returned: 0 in 0.502s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:55 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-d6432be7-25c8-4dcf-8000-22402553af24 tempest-GroupSnapshotsV319Test-516094084 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8248c4d5-d909-4575-a9de-686ede7a2fe4.4289547b-8686-4177-9f63-85e0d49f5152 is being set with open permissions: ugo+rw: NotImplementedError
Apr 15 20:08:55 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d6432be7-25c8-4dcf-8000-22402553af24 tempest-GroupSnapshotsV319Test-516094084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8248c4d5-d909-4575-a9de-686ede7a2fe4.4289547b-8686-4177-9f63-85e0d49f5152 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:55 devstack sudo[86676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8248c4d5-d909-4575-a9de-686ede7a2fe4.4289547b-8686-4177-9f63-85e0d49f5152
Apr 15 20:08:55 devstack sudo[86676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:56 devstack sudo[86676]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:56 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d6432be7-25c8-4dcf-8000-22402553af24 tempest-GroupSnapshotsV319Test-516094084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8248c4d5-d909-4575-a9de-686ede7a2fe4.4289547b-8686-4177-9f63-85e0d49f5152" returned: 0 in 0.407s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:56 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d6432be7-25c8-4dcf-8000-22402553af24 tempest-GroupSnapshotsV319Test-516094084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8248c4d5-d909-4575-a9de-686ede7a2fe4.info {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:56 devstack sudo[86680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8248c4d5-d909-4575-a9de-686ede7a2fe4.info
Apr 15 20:08:56 devstack sudo[86680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:56 devstack sudo[86680]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:56 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d6432be7-25c8-4dcf-8000-22402553af24 tempest-GroupSnapshotsV319Test-516094084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8248c4d5-d909-4575-a9de-686ede7a2fe4.info" returned: 0 in 0.406s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:56 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-d6432be7-25c8-4dcf-8000-22402553af24 tempest-GroupSnapshotsV319Test-516094084 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8248c4d5-d909-4575-a9de-686ede7a2fe4.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 15 20:08:56 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d6432be7-25c8-4dcf-8000-22402553af24 tempest-GroupSnapshotsV319Test-516094084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8248c4d5-d909-4575-a9de-686ede7a2fe4.info {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:56 devstack sudo[86683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8248c4d5-d909-4575-a9de-686ede7a2fe4.info
Apr 15 20:08:56 devstack sudo[86683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:57 devstack sudo[86683]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:57 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d6432be7-25c8-4dcf-8000-22402553af24 tempest-GroupSnapshotsV319Test-516094084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8248c4d5-d909-4575-a9de-686ede7a2fe4.info" returned: 0 in 0.401s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:57 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-d6432be7-25c8-4dcf-8000-22402553af24 tempest-GroupSnapshotsV319Test-516094084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.878s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:08:57 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-76016d4d-f738-4102-ad13-0b9d6efd9031 tempest-VolumesServicesTestJSON-482099905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.097s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:08:57 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-76016d4d-f738-4102-ad13-0b9d6efd9031 tempest-VolumesServicesTestJSON-482099905 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-22677094',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a81a9f40-6ba1-4c26-9645-89a329adc6bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e00941e72efb497babd880c569058a0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:08:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:08:53Z,use_quota=True,user_id='dcfcd7d8ffeb490994d5abf56addc005',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:08:57 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-76016d4d-f738-4102-ad13-0b9d6efd9031 tempest-VolumesServicesTestJSON-482099905 None] Creating volume a81a9f40-6ba1-4c26-9645-89a329adc6bf {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:08:57 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-76016d4d-f738-4102-ad13-0b9d6efd9031 tempest-VolumesServicesTestJSON-482099905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:08:57 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-76016d4d-f738-4102-ad13-0b9d6efd9031 tempest-VolumesServicesTestJSON-482099905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:08:57 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-76016d4d-f738-4102-ad13-0b9d6efd9031 tempest-VolumesServicesTestJSON-482099905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:08:57 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-76016d4d-f738-4102-ad13-0b9d6efd9031 tempest-VolumesServicesTestJSON-482099905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:08:57 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-76016d4d-f738-4102-ad13-0b9d6efd9031 tempest-VolumesServicesTestJSON-482099905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:08:57 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-76016d4d-f738-4102-ad13-0b9d6efd9031 tempest-VolumesServicesTestJSON-482099905 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:08:57 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-76016d4d-f738-4102-ad13-0b9d6efd9031 tempest-VolumesServicesTestJSON-482099905 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:08:57 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-76016d4d-f738-4102-ad13-0b9d6efd9031 tempest-VolumesServicesTestJSON-482099905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a81a9f40-6ba1-4c26-9645-89a329adc6bf 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:57 devstack sudo[86686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a81a9f40-6ba1-4c26-9645-89a329adc6bf 1073741824
Apr 15 20:08:57 devstack sudo[86686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:57 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-d6432be7-25c8-4dcf-8000-22402553af24 tempest-GroupSnapshotsV319Test-516094084 None] group_snapshot 91e02ed7-d5b8-456f-a060-34dec97e1ee0: created successfully
Apr 15 20:08:57 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-c692278f-2782-4c43-9cc5-1c96e332eee8 tempest-GroupSnapshotsV319Test-516094084 None] group_snapshot 91e02ed7-d5b8-456f-a060-34dec97e1ee0: deleting
Apr 15 20:08:57 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-c692278f-2782-4c43-9cc5-1c96e332eee8 tempest-GroupSnapshotsV319Test-516094084 None] group_snapshot 91e02ed7-d5b8-456f-a060-34dec97e1ee0: deleting {{(pid=82646) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 15 20:08:57 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-c692278f-2782-4c43-9cc5-1c96e332eee8 tempest-GroupSnapshotsV319Test-516094084 None] Acquiring lock "cinder-quobyte-8248c4d5-d909-4575-a9de-686ede7a2fe4" by "delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:08:57 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-c692278f-2782-4c43-9cc5-1c96e332eee8 tempest-GroupSnapshotsV319Test-516094084 None] Lock "cinder-quobyte-8248c4d5-d909-4575-a9de-686ede7a2fe4" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:08:57 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-c692278f-2782-4c43-9cc5-1c96e332eee8 tempest-GroupSnapshotsV319Test-516094084 None] Acquiring lock "cinder-quobyte-4289547b-8686-4177-9f63-85e0d49f5152" by "_delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:08:57 devstack sudo[86686]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:57 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-76016d4d-f738-4102-ad13-0b9d6efd9031 tempest-VolumesServicesTestJSON-482099905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a81a9f40-6ba1-4c26-9645-89a329adc6bf 1073741824" returned: 0 in 0.572s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:57 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-c692278f-2782-4c43-9cc5-1c96e332eee8 tempest-GroupSnapshotsV319Test-516094084 None] Lock "cinder-quobyte-4289547b-8686-4177-9f63-85e0d49f5152" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:08:57 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-c692278f-2782-4c43-9cc5-1c96e332eee8 tempest-GroupSnapshotsV319Test-516094084 None] Deleting offline snapshot 4289547b-8686-4177-9f63-85e0d49f5152 of volume 8248c4d5-d909-4575-a9de-686ede7a2fe4 {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 20:08:57 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-c692278f-2782-4c43-9cc5-1c96e332eee8 tempest-GroupSnapshotsV319Test-516094084 None] snapshot_file for this snap is: volume-8248c4d5-d909-4575-a9de-686ede7a2fe4.4289547b-8686-4177-9f63-85e0d49f5152 {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 20:08:57 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-76016d4d-f738-4102-ad13-0b9d6efd9031 tempest-VolumesServicesTestJSON-482099905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a81a9f40-6ba1-4c26-9645-89a329adc6bf {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:57 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a1a5d8-8449-4c99-b897-c4d7edc6ea1f]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:08:57 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c692278f-2782-4c43-9cc5-1c96e332eee8 tempest-GroupSnapshotsV319Test-516094084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8248c4d5-d909-4575-a9de-686ede7a2fe4.4289547b-8686-4177-9f63-85e0d49f5152 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:57 devstack sudo[86691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a81a9f40-6ba1-4c26-9645-89a329adc6bf
Apr 15 20:08:57 devstack sudo[86691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:57 devstack sudo[86692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8248c4d5-d909-4575-a9de-686ede7a2fe4.4289547b-8686-4177-9f63-85e0d49f5152
Apr 15 20:08:57 devstack sudo[86692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:58 devstack sudo[86691]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:58 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-76016d4d-f738-4102-ad13-0b9d6efd9031 tempest-VolumesServicesTestJSON-482099905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a81a9f40-6ba1-4c26-9645-89a329adc6bf" returned: 0 in 0.446s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:58 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-76016d4d-f738-4102-ad13-0b9d6efd9031 tempest-VolumesServicesTestJSON-482099905 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:08:58 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-76016d4d-f738-4102-ad13-0b9d6efd9031 tempest-VolumesServicesTestJSON-482099905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:08:58 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-fec9b767-a198-4442-ac40-e0191de11a33 tempest-VolumesActionsTest-1120257978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.635s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:08:58 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-76016d4d-f738-4102-ad13-0b9d6efd9031 tempest-VolumesServicesTestJSON-482099905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ebcc6fb-0798-4d0a-abbb-94384e134372) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a81a9f40-6ba1-4c26-9645-89a329adc6bf', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:08:58 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-76016d4d-f738-4102-ad13-0b9d6efd9031 tempest-VolumesServicesTestJSON-482099905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5818ea3-b6c5-45e8-8f73-b48b8ab0a40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:08:58 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[562d6809-096e-488b-89ad-731bc2127b1c]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:08:58 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-fec9b767-a198-4442-ac40-e0191de11a33 tempest-VolumesActionsTest-1120257978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-684c024b-5c7b-4580-9ec4-2a4f0786e6a3 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:58 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-76016d4d-f738-4102-ad13-0b9d6efd9031 tempest-VolumesServicesTestJSON-482099905 None] Volume volume-a81a9f40-6ba1-4c26-9645-89a329adc6bf (a81a9f40-6ba1-4c26-9645-89a329adc6bf): created successfully
Apr 15 20:08:58 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-76016d4d-f738-4102-ad13-0b9d6efd9031 tempest-VolumesServicesTestJSON-482099905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5818ea3-b6c5-45e8-8f73-b48b8ab0a40c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:08:58 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-76016d4d-f738-4102-ad13-0b9d6efd9031 tempest-VolumesServicesTestJSON-482099905 None] Flow 'volume_create_manager' (4c85f89e-b5d0-4ab8-b2a3-8b304e510968) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:08:58 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-76016d4d-f738-4102-ad13-0b9d6efd9031 tempest-VolumesServicesTestJSON-482099905 None] Created volume successfully.
Apr 15 20:08:58 devstack sudo[86698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-684c024b-5c7b-4580-9ec4-2a4f0786e6a3
Apr 15 20:08:58 devstack sudo[86698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:58 devstack sudo[86692]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:58 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c692278f-2782-4c43-9cc5-1c96e332eee8 tempest-GroupSnapshotsV319Test-516094084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8248c4d5-d909-4575-a9de-686ede7a2fe4.4289547b-8686-4177-9f63-85e0d49f5152" returned: 0 in 0.603s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:58 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-c692278f-2782-4c43-9cc5-1c96e332eee8 tempest-GroupSnapshotsV319Test-516094084 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8248c4d5-d909-4575-a9de-686ede7a2fe4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82646) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 20:08:58 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[551c2b6c-105b-4d10-8bb4-1897c4d251ce]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:08:58 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c692278f-2782-4c43-9cc5-1c96e332eee8 tempest-GroupSnapshotsV319Test-516094084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8248c4d5-d909-4575-a9de-686ede7a2fe4 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:58 devstack sudo[86701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8248c4d5-d909-4575-a9de-686ede7a2fe4
Apr 15 20:08:58 devstack sudo[86701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:58 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-02a3bd8f-a5cf-4919-81a9-f4c33c73099c tempest-VolumesServicesTestJSON-482099905 None] Acquiring lock "cinder-a81a9f40-6ba1-4c26-9645-89a329adc6bf-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:08:58 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-02a3bd8f-a5cf-4919-81a9-f4c33c73099c tempest-VolumesServicesTestJSON-482099905 None] Lock "cinder-a81a9f40-6ba1-4c26-9645-89a329adc6bf-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:08:58 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-02a3bd8f-a5cf-4919-81a9-f4c33c73099c tempest-VolumesServicesTestJSON-482099905 None] Acquiring lock "cinder-quobyte-a81a9f40-6ba1-4c26-9645-89a329adc6bf" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:08:58 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-02a3bd8f-a5cf-4919-81a9-f4c33c73099c tempest-VolumesServicesTestJSON-482099905 None] Lock "cinder-quobyte-a81a9f40-6ba1-4c26-9645-89a329adc6bf" acquired by "delete_volume" :: waited 0.008s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:08:58 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c991056-1ef0-4cb3-98f8-62f9d4f73e44]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:08:58 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-02a3bd8f-a5cf-4919-81a9-f4c33c73099c tempest-VolumesServicesTestJSON-482099905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a81a9f40-6ba1-4c26-9645-89a329adc6bf {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:58 devstack sudo[86703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a81a9f40-6ba1-4c26-9645-89a329adc6bf
Apr 15 20:08:58 devstack sudo[86703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:58 devstack sudo[86698]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:58 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-fec9b767-a198-4442-ac40-e0191de11a33 tempest-VolumesActionsTest-1120257978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-684c024b-5c7b-4580-9ec4-2a4f0786e6a3" returned: 0 in 0.655s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:58 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[29efbbb0-dd17-4924-8219-d11353f83882]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:08:58 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-fec9b767-a198-4442-ac40-e0191de11a33 tempest-VolumesActionsTest-1120257978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-684c024b-5c7b-4580-9ec4-2a4f0786e6a3 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:59 devstack sudo[86708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-684c024b-5c7b-4580-9ec4-2a4f0786e6a3
Apr 15 20:08:59 devstack sudo[86708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:59 devstack sudo[86701]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:59 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c692278f-2782-4c43-9cc5-1c96e332eee8 tempest-GroupSnapshotsV319Test-516094084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8248c4d5-d909-4575-a9de-686ede7a2fe4" returned: 0 in 0.638s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:59 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c692278f-2782-4c43-9cc5-1c96e332eee8 tempest-GroupSnapshotsV319Test-516094084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8248c4d5-d909-4575-a9de-686ede7a2fe4.4289547b-8686-4177-9f63-85e0d49f5152 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:59 devstack sudo[86713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8248c4d5-d909-4575-a9de-686ede7a2fe4.4289547b-8686-4177-9f63-85e0d49f5152
Apr 15 20:08:59 devstack sudo[86713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:59 devstack sudo[86703]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:59 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-02a3bd8f-a5cf-4919-81a9-f4c33c73099c tempest-VolumesServicesTestJSON-482099905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a81a9f40-6ba1-4c26-9645-89a329adc6bf" returned: 0 in 0.498s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:59 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-02a3bd8f-a5cf-4919-81a9-f4c33c73099c tempest-VolumesServicesTestJSON-482099905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a81a9f40-6ba1-4c26-9645-89a329adc6bf {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:59 devstack sudo[86718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a81a9f40-6ba1-4c26-9645-89a329adc6bf
Apr 15 20:08:59 devstack sudo[86718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:59 devstack sudo[86708]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:59 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-fec9b767-a198-4442-ac40-e0191de11a33 tempest-VolumesActionsTest-1120257978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-684c024b-5c7b-4580-9ec4-2a4f0786e6a3" returned: 0 in 0.606s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:59 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-fec9b767-a198-4442-ac40-e0191de11a33 tempest-VolumesActionsTest-1120257978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-684c024b-5c7b-4580-9ec4-2a4f0786e6a3 /opt/stack/data/cinder/conversion/684c024b-5c7b-4580-9ec4-2a4f0786e6a3.temp_image.617d8f3b-59db-4724-a2ef-23cb181f6587yq972e8x.img {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:59 devstack sudo[86726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-684c024b-5c7b-4580-9ec4-2a4f0786e6a3 /opt/stack/data/cinder/conversion/684c024b-5c7b-4580-9ec4-2a4f0786e6a3.temp_image.617d8f3b-59db-4724-a2ef-23cb181f6587yq972e8x.img
Apr 15 20:08:59 devstack sudo[86726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:59 devstack sudo[86713]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:59 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c692278f-2782-4c43-9cc5-1c96e332eee8 tempest-GroupSnapshotsV319Test-516094084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8248c4d5-d909-4575-a9de-686ede7a2fe4.4289547b-8686-4177-9f63-85e0d49f5152" returned: 0 in 0.531s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:59 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c692278f-2782-4c43-9cc5-1c96e332eee8 tempest-GroupSnapshotsV319Test-516094084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8248c4d5-d909-4575-a9de-686ede7a2fe4.4289547b-8686-4177-9f63-85e0d49f5152 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:59 devstack sudo[86728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8248c4d5-d909-4575-a9de-686ede7a2fe4.4289547b-8686-4177-9f63-85e0d49f5152
Apr 15 20:08:59 devstack sudo[86728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:08:59 devstack sudo[86718]: pam_unix(sudo:session): session closed for user root
Apr 15 20:08:59 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-02a3bd8f-a5cf-4919-81a9-f4c33c73099c tempest-VolumesServicesTestJSON-482099905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a81a9f40-6ba1-4c26-9645-89a329adc6bf" returned: 0 in 0.494s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:08:59 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-02a3bd8f-a5cf-4919-81a9-f4c33c73099c tempest-VolumesServicesTestJSON-482099905 None] Lock "cinder-quobyte-a81a9f40-6ba1-4c26-9645-89a329adc6bf" released by "delete_volume" :: held 1.041s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:08:59 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-02a3bd8f-a5cf-4919-81a9-f4c33c73099c tempest-VolumesServicesTestJSON-482099905 None] Created reservations ['e35ac491-3662-42c6-82c1-2e85e25c3e12', 'f193b4d6-c846-4d32-bbab-d281f0e4c772', '62216b70-a831-4170-a8d7-3ce1a2819f47', '3111586c-a3b4-46dd-a6bd-f2d5f3c390a1'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:08:59 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-02a3bd8f-a5cf-4919-81a9-f4c33c73099c tempest-VolumesServicesTestJSON-482099905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:08:59 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-02a3bd8f-a5cf-4919-81a9-f4c33c73099c tempest-VolumesServicesTestJSON-482099905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:08:59 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-02a3bd8f-a5cf-4919-81a9-f4c33c73099c tempest-VolumesServicesTestJSON-482099905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:08:59 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-02a3bd8f-a5cf-4919-81a9-f4c33c73099c tempest-VolumesServicesTestJSON-482099905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:08:59 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-02a3bd8f-a5cf-4919-81a9-f4c33c73099c tempest-VolumesServicesTestJSON-482099905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:08:59 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-02a3bd8f-a5cf-4919-81a9-f4c33c73099c tempest-VolumesServicesTestJSON-482099905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:08:59 devstack sudo[86731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:08:59 devstack sudo[86731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:00 devstack sudo[86728]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:00 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c692278f-2782-4c43-9cc5-1c96e332eee8 tempest-GroupSnapshotsV319Test-516094084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8248c4d5-d909-4575-a9de-686ede7a2fe4.4289547b-8686-4177-9f63-85e0d49f5152" returned: 0 in 0.663s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:00 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-c692278f-2782-4c43-9cc5-1c96e332eee8 tempest-GroupSnapshotsV319Test-516094084 None] Lock "cinder-quobyte-4289547b-8686-4177-9f63-85e0d49f5152" released by "_delete_snapshot" :: held 2.555s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:09:00 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-c692278f-2782-4c43-9cc5-1c96e332eee8 tempest-GroupSnapshotsV319Test-516094084 None] Lock "cinder-quobyte-8248c4d5-d909-4575-a9de-686ede7a2fe4" released by "delete_snapshot" :: held 2.574s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:09:00 devstack cinder-volume[82646]: WARNING cinder.quota [None req-c692278f-2782-4c43-9cc5-1c96e332eee8 tempest-GroupSnapshotsV319Test-516094084 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-639767402 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-639767402, it is now deprecated. Please use the default quota class for default quota.
Apr 15 20:09:00 devstack cinder-volume[82646]: WARNING cinder.quota [None req-c692278f-2782-4c43-9cc5-1c96e332eee8 tempest-GroupSnapshotsV319Test-516094084 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-639767402 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-639767402, it is now deprecated. Please use the default quota class for default quota.
Apr 15 20:09:00 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-c692278f-2782-4c43-9cc5-1c96e332eee8 tempest-GroupSnapshotsV319Test-516094084 None] Created reservations ['08275991-23c3-41da-80eb-c80bdbf1a1e1', 'b1b28ed3-db19-46de-a90d-ce6fa9bdeca7', '10ea51d7-2480-4e52-885f-3a6706783739', 'e764a20f-022f-4292-b1b5-77901d1b863c'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:09:00 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-c692278f-2782-4c43-9cc5-1c96e332eee8 tempest-GroupSnapshotsV319Test-516094084 None] group_snapshot 91e02ed7-d5b8-456f-a060-34dec97e1ee0: deleted successfully
Apr 15 20:09:01 devstack sudo[86731]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:01 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-02a3bd8f-a5cf-4919-81a9-f4c33c73099c tempest-VolumesServicesTestJSON-482099905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 1.787s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:01 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-02a3bd8f-a5cf-4919-81a9-f4c33c73099c tempest-VolumesServicesTestJSON-482099905 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:09:01 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-02a3bd8f-a5cf-4919-81a9-f4c33c73099c tempest-VolumesServicesTestJSON-482099905 None] Deleted volume successfully.
Apr 15 20:09:01 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-8fb9db36-e199-4084-8728-b2171c55fe99 tempest-GroupSnapshotsV319Test-516094084 None] Acquiring lock "cinder-quobyte-8248c4d5-d909-4575-a9de-686ede7a2fe4" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:09:01 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-02a3bd8f-a5cf-4919-81a9-f4c33c73099c tempest-VolumesServicesTestJSON-482099905 None] Lock "cinder-a81a9f40-6ba1-4c26-9645-89a329adc6bf-delete_volume" released by "delete_volume" :: held 3.116s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:09:01 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-8fb9db36-e199-4084-8728-b2171c55fe99 tempest-GroupSnapshotsV319Test-516094084 None] Lock "cinder-quobyte-8248c4d5-d909-4575-a9de-686ede7a2fe4" acquired by "delete_volume" :: waited 0.033s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:09:01 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[7934b17d-c762-4505-a1a5-102fd4d352ec]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:09:01 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-8fb9db36-e199-4084-8728-b2171c55fe99 tempest-GroupSnapshotsV319Test-516094084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8248c4d5-d909-4575-a9de-686ede7a2fe4 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:02 devstack sudo[86745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8248c4d5-d909-4575-a9de-686ede7a2fe4
Apr 15 20:09:02 devstack sudo[86745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:02 devstack sudo[86726]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:02 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-fec9b767-a198-4442-ac40-e0191de11a33 tempest-VolumesActionsTest-1120257978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-684c024b-5c7b-4580-9ec4-2a4f0786e6a3 /opt/stack/data/cinder/conversion/684c024b-5c7b-4580-9ec4-2a4f0786e6a3.temp_image.617d8f3b-59db-4724-a2ef-23cb181f6587yq972e8x.img" returned: 0 in 2.610s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:02 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf4c5a0-8614-4ebd-b778-1a0cf2eb0771]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:09:02 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-fec9b767-a198-4442-ac40-e0191de11a33 tempest-VolumesActionsTest-1120257978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-684c024b-5c7b-4580-9ec4-2a4f0786e6a3 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:02 devstack sudo[86747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-684c024b-5c7b-4580-9ec4-2a4f0786e6a3
Apr 15 20:09:02 devstack sudo[86747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:02 devstack sudo[86745]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:02 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-8fb9db36-e199-4084-8728-b2171c55fe99 tempest-GroupSnapshotsV319Test-516094084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8248c4d5-d909-4575-a9de-686ede7a2fe4" returned: 0 in 0.741s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:02 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-8fb9db36-e199-4084-8728-b2171c55fe99 tempest-GroupSnapshotsV319Test-516094084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8248c4d5-d909-4575-a9de-686ede7a2fe4 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:02 devstack sudo[86754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8248c4d5-d909-4575-a9de-686ede7a2fe4
Apr 15 20:09:02 devstack sudo[86754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:02 devstack sudo[86747]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:02 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-fec9b767-a198-4442-ac40-e0191de11a33 tempest-VolumesActionsTest-1120257978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-684c024b-5c7b-4580-9ec4-2a4f0786e6a3" returned: 0 in 0.666s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:02 devstack cinder-volume[82646]: DEBUG cinder.image.image_utils [None req-fec9b767-a198-4442-ac40-e0191de11a33 tempest-VolumesActionsTest-1120257978 None] Image conversion details: src /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-684c024b-5c7b-4580-9ec4-2a4f0786e6a3, size 1024.00 MB, duration 2.61 sec, destination /opt/stack/data/cinder/conversion/684c024b-5c7b-4580-9ec4-2a4f0786e6a3.temp_image.617d8f3b-59db-4724-a2ef-23cb181f6587yq972e8x.img {{(pid=82646) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 20:09:02 devstack cinder-volume[82646]: INFO cinder.image.image_utils [None req-fec9b767-a198-4442-ac40-e0191de11a33 tempest-VolumesActionsTest-1120257978 None] Converted 1024.00 MB image at 392.20 MB/s
Apr 15 20:09:02 devstack cinder-volume[82646]: DEBUG cinder.image.image_utils [None req-fec9b767-a198-4442-ac40-e0191de11a33 tempest-VolumesActionsTest-1120257978 None] 617d8f3b-59db-4724-a2ef-23cb181f6587 was raw, converting to qcow2 {{(pid=82646) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}}
Apr 15 20:09:02 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[559209a6-7ac0-4b3d-9e35-95d90f07ff3f]: (4, 'raw') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:09:02 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-fec9b767-a198-4442-ac40-e0191de11a33 tempest-VolumesActionsTest-1120257978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/684c024b-5c7b-4580-9ec4-2a4f0786e6a3.temp_image.617d8f3b-59db-4724-a2ef-23cb181f6587yq972e8x.img {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:03 devstack sudo[86757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/684c024b-5c7b-4580-9ec4-2a4f0786e6a3.temp_image.617d8f3b-59db-4724-a2ef-23cb181f6587yq972e8x.img
Apr 15 20:09:03 devstack sudo[86757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:03 devstack sudo[86754]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:03 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-8fb9db36-e199-4084-8728-b2171c55fe99 tempest-GroupSnapshotsV319Test-516094084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8248c4d5-d909-4575-a9de-686ede7a2fe4" returned: 0 in 0.599s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:03 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-8fb9db36-e199-4084-8728-b2171c55fe99 tempest-GroupSnapshotsV319Test-516094084 None] Lock "cinder-quobyte-8248c4d5-d909-4575-a9de-686ede7a2fe4" released by "delete_volume" :: held 1.431s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:09:03 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-8fb9db36-e199-4084-8728-b2171c55fe99 tempest-GroupSnapshotsV319Test-516094084 None] Created reservations ['5f2573cd-5589-4ac0-85ff-266132f6a4f5'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:09:03 devstack cinder-volume[82646]: WARNING cinder.quota [None req-8fb9db36-e199-4084-8728-b2171c55fe99 tempest-GroupSnapshotsV319Test-516094084 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-639767402 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-639767402, it is now deprecated. Please use the default quota class for default quota.
Apr 15 20:09:03 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-8fb9db36-e199-4084-8728-b2171c55fe99 tempest-GroupSnapshotsV319Test-516094084 None] Created reservations ['2a6188b0-dce8-485f-bc03-c6128b24a692', '4998ec36-af85-4358-b8a9-e6ba8b8508e0', '169895b8-eb64-45b3-ae8f-71b361baa077', '8faa1f3a-2b96-4739-901e-abcd1e812edd'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:09:03 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-8fb9db36-e199-4084-8728-b2171c55fe99 tempest-GroupSnapshotsV319Test-516094084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:09:03 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-8fb9db36-e199-4084-8728-b2171c55fe99 tempest-GroupSnapshotsV319Test-516094084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:09:03 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-8fb9db36-e199-4084-8728-b2171c55fe99 tempest-GroupSnapshotsV319Test-516094084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:09:03 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-8fb9db36-e199-4084-8728-b2171c55fe99 tempest-GroupSnapshotsV319Test-516094084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:09:03 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-8fb9db36-e199-4084-8728-b2171c55fe99 tempest-GroupSnapshotsV319Test-516094084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:09:03 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-8fb9db36-e199-4084-8728-b2171c55fe99 tempest-GroupSnapshotsV319Test-516094084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:03 devstack sudo[86760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:09:03 devstack sudo[86760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:03 devstack sudo[86757]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:03 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-fec9b767-a198-4442-ac40-e0191de11a33 tempest-VolumesActionsTest-1120257978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/684c024b-5c7b-4580-9ec4-2a4f0786e6a3.temp_image.617d8f3b-59db-4724-a2ef-23cb181f6587yq972e8x.img" returned: 0 in 0.703s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:03 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-fec9b767-a198-4442-ac40-e0191de11a33 tempest-VolumesActionsTest-1120257978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/684c024b-5c7b-4580-9ec4-2a4f0786e6a3.temp_image.617d8f3b-59db-4724-a2ef-23cb181f6587yq972e8x.img {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:03 devstack sudo[86764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/684c024b-5c7b-4580-9ec4-2a4f0786e6a3.temp_image.617d8f3b-59db-4724-a2ef-23cb181f6587yq972e8x.img
Apr 15 20:09:03 devstack sudo[86764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:03 devstack sudo[86760]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:03 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-8fb9db36-e199-4084-8728-b2171c55fe99 tempest-GroupSnapshotsV319Test-516094084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.562s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:03 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-8fb9db36-e199-4084-8728-b2171c55fe99 tempest-GroupSnapshotsV319Test-516094084 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:09:03 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-8fb9db36-e199-4084-8728-b2171c55fe99 tempest-GroupSnapshotsV319Test-516094084 None] Delete group completed successfully.
Apr 15 20:09:04 devstack sudo[86764]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:04 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-fec9b767-a198-4442-ac40-e0191de11a33 tempest-VolumesActionsTest-1120257978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/684c024b-5c7b-4580-9ec4-2a4f0786e6a3.temp_image.617d8f3b-59db-4724-a2ef-23cb181f6587yq972e8x.img" returned: 1 in 0.559s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:04 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-fec9b767-a198-4442-ac40-e0191de11a33 tempest-VolumesActionsTest-1120257978 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/684c024b-5c7b-4580-9ec4-2a4f0786e6a3.temp_image.617d8f3b-59db-4724-a2ef-23cb181f6587yq972e8x.img' failed. Not Retrying. {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 20:09:04 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-fec9b767-a198-4442-ac40-e0191de11a33 tempest-VolumesActionsTest-1120257978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/684c024b-5c7b-4580-9ec4-2a4f0786e6a3.temp_image.617d8f3b-59db-4724-a2ef-23cb181f6587yq972e8x.img /opt/stack/data/cinder/conversion/vol_upload_jmqj1hju {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:04 devstack sudo[86770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/684c024b-5c7b-4580-9ec4-2a4f0786e6a3.temp_image.617d8f3b-59db-4724-a2ef-23cb181f6587yq972e8x.img /opt/stack/data/cinder/conversion/vol_upload_jmqj1hju
Apr 15 20:09:04 devstack sudo[86770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:04 devstack sudo[86770]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:04 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-fec9b767-a198-4442-ac40-e0191de11a33 tempest-VolumesActionsTest-1120257978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/684c024b-5c7b-4580-9ec4-2a4f0786e6a3.temp_image.617d8f3b-59db-4724-a2ef-23cb181f6587yq972e8x.img /opt/stack/data/cinder/conversion/vol_upload_jmqj1hju" returned: 0 in 0.483s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:04 devstack cinder-volume[82646]: DEBUG cinder.image.image_utils [None req-fec9b767-a198-4442-ac40-e0191de11a33 tempest-VolumesActionsTest-1120257978 None] Image conversion details: src /opt/stack/data/cinder/conversion/684c024b-5c7b-4580-9ec4-2a4f0786e6a3.temp_image.617d8f3b-59db-4724-a2ef-23cb181f6587yq972e8x.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_jmqj1hju {{(pid=82646) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 20:09:04 devstack cinder-volume[82646]: INFO cinder.image.image_utils [None req-fec9b767-a198-4442-ac40-e0191de11a33 tempest-VolumesActionsTest-1120257978 None] Converted 1024.00 MB image at 1024.00 MB/s
Apr 15 20:09:04 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[115f7fed-965c-4403-977d-9351ea811ca7]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:09:04 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-fec9b767-a198-4442-ac40-e0191de11a33 tempest-VolumesActionsTest-1120257978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_jmqj1hju {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:04 devstack sudo[86775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_jmqj1hju
Apr 15 20:09:04 devstack sudo[86775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:05 devstack sudo[86775]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:05 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-fec9b767-a198-4442-ac40-e0191de11a33 tempest-VolumesActionsTest-1120257978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_jmqj1hju" returned: 0 in 0.709s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:06 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-fec9b767-a198-4442-ac40-e0191de11a33 tempest-VolumesActionsTest-1120257978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 8.603s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:09:06 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-fec9b767-a198-4442-ac40-e0191de11a33 tempest-VolumesActionsTest-1120257978 None] Uploaded volume to glance image-id: 617d8f3b-59db-4724-a2ef-23cb181f6587. {{(pid=82646) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 15 20:09:06 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-fec9b767-a198-4442-ac40-e0191de11a33 tempest-VolumesActionsTest-1120257978 None] Copy volume to image completed successfully.
Apr 15 20:09:07 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-757fe355-618d-4a82-8ef6-ae865d2679cd tempest-VolumesActionsTest-1120257978 None] Acquiring lock "cinder-684c024b-5c7b-4580-9ec4-2a4f0786e6a3-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:09:07 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-757fe355-618d-4a82-8ef6-ae865d2679cd tempest-VolumesActionsTest-1120257978 None] Lock "cinder-684c024b-5c7b-4580-9ec4-2a4f0786e6a3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:09:07 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-757fe355-618d-4a82-8ef6-ae865d2679cd tempest-VolumesActionsTest-1120257978 None] Acquiring lock "cinder-quobyte-684c024b-5c7b-4580-9ec4-2a4f0786e6a3" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:09:07 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-757fe355-618d-4a82-8ef6-ae865d2679cd tempest-VolumesActionsTest-1120257978 None] Lock "cinder-quobyte-684c024b-5c7b-4580-9ec4-2a4f0786e6a3" acquired by "delete_volume" :: waited 0.012s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:09:07 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[4637a0e0-a11c-4b02-a0c9-8e075c01e64a]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:09:07 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-757fe355-618d-4a82-8ef6-ae865d2679cd tempest-VolumesActionsTest-1120257978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-684c024b-5c7b-4580-9ec4-2a4f0786e6a3 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:07 devstack sudo[86781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-684c024b-5c7b-4580-9ec4-2a4f0786e6a3
Apr 15 20:09:07 devstack sudo[86781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:08 devstack sudo[86781]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:08 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-757fe355-618d-4a82-8ef6-ae865d2679cd tempest-VolumesActionsTest-1120257978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-684c024b-5c7b-4580-9ec4-2a4f0786e6a3" returned: 0 in 0.658s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:08 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-757fe355-618d-4a82-8ef6-ae865d2679cd tempest-VolumesActionsTest-1120257978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-684c024b-5c7b-4580-9ec4-2a4f0786e6a3 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:08 devstack sudo[86786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-684c024b-5c7b-4580-9ec4-2a4f0786e6a3
Apr 15 20:09:08 devstack sudo[86786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:08 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-77d08065-edc4-4291-b8ab-26d4bd3869ff tempest-VolumeQuotasAdminTestJSON-142573934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:09:08 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-77d08065-edc4-4291-b8ab-26d4bd3869ff tempest-VolumeQuotasAdminTestJSON-142573934 None] Flow 'volume_create_manager' (ed665ad9-8847-4142-8193-40ca0808b8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:09:08 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-77d08065-edc4-4291-b8ab-26d4bd3869ff tempest-VolumeQuotasAdminTestJSON-142573934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b47665a-ddd4-4b54-a0ed-603d8f919b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:08 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-77d08065-edc4-4291-b8ab-26d4bd3869ff tempest-VolumeQuotasAdminTestJSON-142573934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b47665a-ddd4-4b54-a0ed-603d8f919b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1464201334',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfea0264-1d0f-44f1-8c42-9d73b81f7230,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4521e4e8268482b8737deee6e52cc0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:09:09Z,use_quota=True,user_id='43f5bb99346943e995b06844c8dde430',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:08 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-77d08065-edc4-4291-b8ab-26d4bd3869ff tempest-VolumeQuotasAdminTestJSON-142573934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f55d1e7d-578d-4b12-b5b4-33dfc5d940ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:08 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-77d08065-edc4-4291-b8ab-26d4bd3869ff tempest-VolumeQuotasAdminTestJSON-142573934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f55d1e7d-578d-4b12-b5b4-33dfc5d940ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:08 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-77d08065-edc4-4291-b8ab-26d4bd3869ff tempest-VolumeQuotasAdminTestJSON-142573934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a86b72f5-fda1-48a0-ab78-c5dfc0c69582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:08 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-77d08065-edc4-4291-b8ab-26d4bd3869ff tempest-VolumeQuotasAdminTestJSON-142573934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a86b72f5-fda1-48a0-ab78-c5dfc0c69582) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfea0264-1d0f-44f1-8c42-9d73b81f7230', 'volume_name': 'volume-cfea0264-1d0f-44f1-8c42-9d73b81f7230', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:08 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-77d08065-edc4-4291-b8ab-26d4bd3869ff tempest-VolumeQuotasAdminTestJSON-142573934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4f68edb-1dd8-47bf-88bb-7026993bb47b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:08 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-77d08065-edc4-4291-b8ab-26d4bd3869ff tempest-VolumeQuotasAdminTestJSON-142573934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4f68edb-1dd8-47bf-88bb-7026993bb47b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:08 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-77d08065-edc4-4291-b8ab-26d4bd3869ff tempest-VolumeQuotasAdminTestJSON-142573934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aace2ad8-d000-4e51-9601-c45a88b61a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:08 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-77d08065-edc4-4291-b8ab-26d4bd3869ff tempest-VolumeQuotasAdminTestJSON-142573934 None] Volume cfea0264-1d0f-44f1-8c42-9d73b81f7230: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfea0264-1d0f-44f1-8c42-9d73b81f7230', 'volume_size': 1}
Apr 15 20:09:08 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-77d08065-edc4-4291-b8ab-26d4bd3869ff tempest-VolumeQuotasAdminTestJSON-142573934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:09:08 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-77d08065-edc4-4291-b8ab-26d4bd3869ff tempest-VolumeQuotasAdminTestJSON-142573934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:09:08 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-77d08065-edc4-4291-b8ab-26d4bd3869ff tempest-VolumeQuotasAdminTestJSON-142573934 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1464201334',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfea0264-1d0f-44f1-8c42-9d73b81f7230,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4521e4e8268482b8737deee6e52cc0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:09:09Z,use_quota=True,user_id='43f5bb99346943e995b06844c8dde430',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:09:08 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-77d08065-edc4-4291-b8ab-26d4bd3869ff tempest-VolumeQuotasAdminTestJSON-142573934 None] Creating volume cfea0264-1d0f-44f1-8c42-9d73b81f7230 {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:09:08 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-77d08065-edc4-4291-b8ab-26d4bd3869ff tempest-VolumeQuotasAdminTestJSON-142573934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:09:08 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-77d08065-edc4-4291-b8ab-26d4bd3869ff tempest-VolumeQuotasAdminTestJSON-142573934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:09:08 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-77d08065-edc4-4291-b8ab-26d4bd3869ff tempest-VolumeQuotasAdminTestJSON-142573934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:09:08 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-77d08065-edc4-4291-b8ab-26d4bd3869ff tempest-VolumeQuotasAdminTestJSON-142573934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:09:08 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-77d08065-edc4-4291-b8ab-26d4bd3869ff tempest-VolumeQuotasAdminTestJSON-142573934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:09:08 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-77d08065-edc4-4291-b8ab-26d4bd3869ff tempest-VolumeQuotasAdminTestJSON-142573934 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:09:08 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-77d08065-edc4-4291-b8ab-26d4bd3869ff tempest-VolumeQuotasAdminTestJSON-142573934 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:09:08 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-77d08065-edc4-4291-b8ab-26d4bd3869ff tempest-VolumeQuotasAdminTestJSON-142573934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-cfea0264-1d0f-44f1-8c42-9d73b81f7230 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:08 devstack sudo[86786]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:08 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-757fe355-618d-4a82-8ef6-ae865d2679cd tempest-VolumesActionsTest-1120257978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-684c024b-5c7b-4580-9ec4-2a4f0786e6a3" returned: 0 in 0.556s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:08 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-757fe355-618d-4a82-8ef6-ae865d2679cd tempest-VolumesActionsTest-1120257978 None] Lock "cinder-quobyte-684c024b-5c7b-4580-9ec4-2a4f0786e6a3" released by "delete_volume" :: held 1.250s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:09:08 devstack sudo[86789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-cfea0264-1d0f-44f1-8c42-9d73b81f7230 1073741824
Apr 15 20:09:08 devstack sudo[86789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:08 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-757fe355-618d-4a82-8ef6-ae865d2679cd tempest-VolumesActionsTest-1120257978 None] Created reservations ['435c15a3-be31-497b-8b8d-6e018fb6fa8f', '01ca291b-5657-4bf7-b891-7bb1e1df5e8c', 'd9768bd2-2b3d-44a0-9a7b-6c438711443d', '497d127a-6df2-4355-a9f8-4d3c27c4b909'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:09:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-757fe355-618d-4a82-8ef6-ae865d2679cd tempest-VolumesActionsTest-1120257978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:09:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-757fe355-618d-4a82-8ef6-ae865d2679cd tempest-VolumesActionsTest-1120257978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:09:09 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-757fe355-618d-4a82-8ef6-ae865d2679cd tempest-VolumesActionsTest-1120257978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:09:09 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-757fe355-618d-4a82-8ef6-ae865d2679cd tempest-VolumesActionsTest-1120257978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:09:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-757fe355-618d-4a82-8ef6-ae865d2679cd tempest-VolumesActionsTest-1120257978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:09:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-757fe355-618d-4a82-8ef6-ae865d2679cd tempest-VolumesActionsTest-1120257978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:09 devstack sudo[86791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:09:09 devstack sudo[86791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:09 devstack sudo[86789]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-77d08065-edc4-4291-b8ab-26d4bd3869ff tempest-VolumeQuotasAdminTestJSON-142573934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-cfea0264-1d0f-44f1-8c42-9d73b81f7230 1073741824" returned: 0 in 0.594s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-77d08065-edc4-4291-b8ab-26d4bd3869ff tempest-VolumeQuotasAdminTestJSON-142573934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-cfea0264-1d0f-44f1-8c42-9d73b81f7230 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:09 devstack sudo[86797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-cfea0264-1d0f-44f1-8c42-9d73b81f7230
Apr 15 20:09:09 devstack sudo[86797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:09 devstack sudo[86791]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-757fe355-618d-4a82-8ef6-ae865d2679cd tempest-VolumesActionsTest-1120257978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.569s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:09 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-757fe355-618d-4a82-8ef6-ae865d2679cd tempest-VolumesActionsTest-1120257978 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:09:09 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-757fe355-618d-4a82-8ef6-ae865d2679cd tempest-VolumesActionsTest-1120257978 None] Deleted volume successfully.
Apr 15 20:09:09 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-757fe355-618d-4a82-8ef6-ae865d2679cd tempest-VolumesActionsTest-1120257978 None] Lock "cinder-684c024b-5c7b-4580-9ec4-2a4f0786e6a3-delete_volume" released by "delete_volume" :: held 1.962s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:09:10 devstack sudo[86797]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:10 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-77d08065-edc4-4291-b8ab-26d4bd3869ff tempest-VolumeQuotasAdminTestJSON-142573934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-cfea0264-1d0f-44f1-8c42-9d73b81f7230" returned: 0 in 0.507s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:10 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-77d08065-edc4-4291-b8ab-26d4bd3869ff tempest-VolumeQuotasAdminTestJSON-142573934 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:09:10 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-77d08065-edc4-4291-b8ab-26d4bd3869ff tempest-VolumeQuotasAdminTestJSON-142573934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:09:10 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-77d08065-edc4-4291-b8ab-26d4bd3869ff tempest-VolumeQuotasAdminTestJSON-142573934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aace2ad8-d000-4e51-9601-c45a88b61a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfea0264-1d0f-44f1-8c42-9d73b81f7230', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:10 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-77d08065-edc4-4291-b8ab-26d4bd3869ff tempest-VolumeQuotasAdminTestJSON-142573934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (795b1f78-9cae-4c3a-ab1f-22c64e95f25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:10 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-77d08065-edc4-4291-b8ab-26d4bd3869ff tempest-VolumeQuotasAdminTestJSON-142573934 None] Volume volume-cfea0264-1d0f-44f1-8c42-9d73b81f7230 (cfea0264-1d0f-44f1-8c42-9d73b81f7230): created successfully
Apr 15 20:09:10 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-77d08065-edc4-4291-b8ab-26d4bd3869ff tempest-VolumeQuotasAdminTestJSON-142573934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (795b1f78-9cae-4c3a-ab1f-22c64e95f25d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:10 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-77d08065-edc4-4291-b8ab-26d4bd3869ff tempest-VolumeQuotasAdminTestJSON-142573934 None] Flow 'volume_create_manager' (ed665ad9-8847-4142-8193-40ca0808b8f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:09:10 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-77d08065-edc4-4291-b8ab-26d4bd3869ff tempest-VolumeQuotasAdminTestJSON-142573934 None] Created volume successfully.
Apr 15 20:09:11 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-511d6769-9001-446f-9647-684b96f9e000 tempest-VolumeQuotasAdminTestJSON-142573934 None] Acquiring lock "cinder-cfea0264-1d0f-44f1-8c42-9d73b81f7230-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:09:11 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-511d6769-9001-446f-9647-684b96f9e000 tempest-VolumeQuotasAdminTestJSON-142573934 None] Lock "cinder-cfea0264-1d0f-44f1-8c42-9d73b81f7230-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:09:11 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-511d6769-9001-446f-9647-684b96f9e000 tempest-VolumeQuotasAdminTestJSON-142573934 None] Acquiring lock "cinder-quobyte-cfea0264-1d0f-44f1-8c42-9d73b81f7230" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:09:11 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-511d6769-9001-446f-9647-684b96f9e000 tempest-VolumeQuotasAdminTestJSON-142573934 None] Lock "cinder-quobyte-cfea0264-1d0f-44f1-8c42-9d73b81f7230" acquired by "delete_volume" :: waited 0.008s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:09:11 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d7c8ad-f79a-4d95-bae8-6b4db4d898bb]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:09:11 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-511d6769-9001-446f-9647-684b96f9e000 tempest-VolumeQuotasAdminTestJSON-142573934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-cfea0264-1d0f-44f1-8c42-9d73b81f7230 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:11 devstack sudo[86800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-cfea0264-1d0f-44f1-8c42-9d73b81f7230
Apr 15 20:09:11 devstack sudo[86800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:11 devstack sudo[86800]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:11 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-511d6769-9001-446f-9647-684b96f9e000 tempest-VolumeQuotasAdminTestJSON-142573934 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-cfea0264-1d0f-44f1-8c42-9d73b81f7230" returned: 0 in 0.575s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:11 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-511d6769-9001-446f-9647-684b96f9e000 tempest-VolumeQuotasAdminTestJSON-142573934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-cfea0264-1d0f-44f1-8c42-9d73b81f7230 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:11 devstack sudo[86806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-cfea0264-1d0f-44f1-8c42-9d73b81f7230
Apr 15 20:09:11 devstack sudo[86806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:12 devstack sudo[86806]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:12 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-511d6769-9001-446f-9647-684b96f9e000 tempest-VolumeQuotasAdminTestJSON-142573934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-cfea0264-1d0f-44f1-8c42-9d73b81f7230" returned: 0 in 0.551s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:12 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-511d6769-9001-446f-9647-684b96f9e000 tempest-VolumeQuotasAdminTestJSON-142573934 None] Lock "cinder-quobyte-cfea0264-1d0f-44f1-8c42-9d73b81f7230" released by "delete_volume" :: held 1.186s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:09:12 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-511d6769-9001-446f-9647-684b96f9e000 tempest-VolumeQuotasAdminTestJSON-142573934 None] Created reservations ['48424ff6-9017-46d0-b035-6be94bd35ad5', 'e7875404-099b-4991-a002-c3117a022a20', 'a1290440-59ed-4e77-8c39-aec3a929e1f4', '0303eb9b-870e-44f9-ad79-c4ec9ce43816'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:09:12 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-511d6769-9001-446f-9647-684b96f9e000 tempest-VolumeQuotasAdminTestJSON-142573934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:09:12 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-511d6769-9001-446f-9647-684b96f9e000 tempest-VolumeQuotasAdminTestJSON-142573934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:09:12 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-511d6769-9001-446f-9647-684b96f9e000 tempest-VolumeQuotasAdminTestJSON-142573934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:09:12 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-511d6769-9001-446f-9647-684b96f9e000 tempest-VolumeQuotasAdminTestJSON-142573934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:09:12 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-511d6769-9001-446f-9647-684b96f9e000 tempest-VolumeQuotasAdminTestJSON-142573934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:09:12 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-511d6769-9001-446f-9647-684b96f9e000 tempest-VolumeQuotasAdminTestJSON-142573934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:12 devstack sudo[86811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:09:12 devstack sudo[86811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:13 devstack sudo[86811]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:13 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-511d6769-9001-446f-9647-684b96f9e000 tempest-VolumeQuotasAdminTestJSON-142573934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.621s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:13 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-511d6769-9001-446f-9647-684b96f9e000 tempest-VolumeQuotasAdminTestJSON-142573934 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:09:13 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-511d6769-9001-446f-9647-684b96f9e000 tempest-VolumeQuotasAdminTestJSON-142573934 None] Deleted volume successfully.
Apr 15 20:09:13 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-511d6769-9001-446f-9647-684b96f9e000 tempest-VolumeQuotasAdminTestJSON-142573934 None] Lock "cinder-cfea0264-1d0f-44f1-8c42-9d73b81f7230-delete_volume" released by "delete_volume" :: held 2.074s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:09:13 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8b70bf6-effd-4162-af76-67adfc844246 tempest-SnapshotMetadataTestJSON-681748838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:09:13 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b8b70bf6-effd-4162-af76-67adfc844246 tempest-SnapshotMetadataTestJSON-681748838 None] Flow 'volume_create_manager' (4a2f13ca-d5b6-4a6e-8ab0-a77689c5c42c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:09:13 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b8b70bf6-effd-4162-af76-67adfc844246 tempest-SnapshotMetadataTestJSON-681748838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72404592-f0a5-479e-86bf-df2ad427bb83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:13 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b8b70bf6-effd-4162-af76-67adfc844246 tempest-SnapshotMetadataTestJSON-681748838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72404592-f0a5-479e-86bf-df2ad427bb83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2114048029',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c31e6bb-df30-47a3-aade-73d400fc83fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c36ac9c45b0540ba81cf01a79190f91b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:09:13Z,use_quota=True,user_id='2852df967ef648829335847091f525cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:13 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b8b70bf6-effd-4162-af76-67adfc844246 tempest-SnapshotMetadataTestJSON-681748838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd610769-e85d-41d4-8263-f0c61f785887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:13 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b8b70bf6-effd-4162-af76-67adfc844246 tempest-SnapshotMetadataTestJSON-681748838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd610769-e85d-41d4-8263-f0c61f785887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:13 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b8b70bf6-effd-4162-af76-67adfc844246 tempest-SnapshotMetadataTestJSON-681748838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b965f69-87b6-495b-830c-54f16ea14e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:13 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b8b70bf6-effd-4162-af76-67adfc844246 tempest-SnapshotMetadataTestJSON-681748838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b965f69-87b6-495b-830c-54f16ea14e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c31e6bb-df30-47a3-aade-73d400fc83fb', 'volume_name': 'volume-6c31e6bb-df30-47a3-aade-73d400fc83fb', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:13 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b8b70bf6-effd-4162-af76-67adfc844246 tempest-SnapshotMetadataTestJSON-681748838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1aa201e-7435-4a97-ae83-07ae98204171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:13 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b8b70bf6-effd-4162-af76-67adfc844246 tempest-SnapshotMetadataTestJSON-681748838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1aa201e-7435-4a97-ae83-07ae98204171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:13 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b8b70bf6-effd-4162-af76-67adfc844246 tempest-SnapshotMetadataTestJSON-681748838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59dcabc8-547c-49b7-95a4-0aa7db0d5ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:13 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-b8b70bf6-effd-4162-af76-67adfc844246 tempest-SnapshotMetadataTestJSON-681748838 None] Volume 6c31e6bb-df30-47a3-aade-73d400fc83fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c31e6bb-df30-47a3-aade-73d400fc83fb', 'volume_size': 1}
Apr 15 20:09:13 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-b8b70bf6-effd-4162-af76-67adfc844246 tempest-SnapshotMetadataTestJSON-681748838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:09:13 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-b8b70bf6-effd-4162-af76-67adfc844246 tempest-SnapshotMetadataTestJSON-681748838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:09:13 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-b8b70bf6-effd-4162-af76-67adfc844246 tempest-SnapshotMetadataTestJSON-681748838 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2114048029',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c31e6bb-df30-47a3-aade-73d400fc83fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c36ac9c45b0540ba81cf01a79190f91b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:09:13Z,use_quota=True,user_id='2852df967ef648829335847091f525cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:09:13 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-b8b70bf6-effd-4162-af76-67adfc844246 tempest-SnapshotMetadataTestJSON-681748838 None] Creating volume 6c31e6bb-df30-47a3-aade-73d400fc83fb {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:09:13 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-b8b70bf6-effd-4162-af76-67adfc844246 tempest-SnapshotMetadataTestJSON-681748838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:09:13 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-b8b70bf6-effd-4162-af76-67adfc844246 tempest-SnapshotMetadataTestJSON-681748838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:09:13 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-b8b70bf6-effd-4162-af76-67adfc844246 tempest-SnapshotMetadataTestJSON-681748838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:09:13 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-b8b70bf6-effd-4162-af76-67adfc844246 tempest-SnapshotMetadataTestJSON-681748838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:09:13 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-b8b70bf6-effd-4162-af76-67adfc844246 tempest-SnapshotMetadataTestJSON-681748838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:09:13 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-b8b70bf6-effd-4162-af76-67adfc844246 tempest-SnapshotMetadataTestJSON-681748838 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:09:13 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-b8b70bf6-effd-4162-af76-67adfc844246 tempest-SnapshotMetadataTestJSON-681748838 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:09:13 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b8b70bf6-effd-4162-af76-67adfc844246 tempest-SnapshotMetadataTestJSON-681748838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6c31e6bb-df30-47a3-aade-73d400fc83fb 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:13 devstack sudo[86815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6c31e6bb-df30-47a3-aade-73d400fc83fb 1073741824
Apr 15 20:09:13 devstack sudo[86815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:13 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-315a3ab1-fdf0-4e23-877b-1fcea151f3ab tempest-VolumeQuotasAdminTestJSON-142573934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:09:13 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-315a3ab1-fdf0-4e23-877b-1fcea151f3ab tempest-VolumeQuotasAdminTestJSON-142573934 None] Flow 'volume_create_manager' (b81a292d-b34f-4be4-8d1b-e4deceb53ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:09:13 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-315a3ab1-fdf0-4e23-877b-1fcea151f3ab tempest-VolumeQuotasAdminTestJSON-142573934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab9b553a-eacb-47ba-8496-c0eb2704f8d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:13 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-315a3ab1-fdf0-4e23-877b-1fcea151f3ab tempest-VolumeQuotasAdminTestJSON-142573934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab9b553a-eacb-47ba-8496-c0eb2704f8d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1835328833',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9edd3b9f-a47c-430e-9da7-5d177ba0e90c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4521e4e8268482b8737deee6e52cc0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:09:14Z,use_quota=True,user_id='43f5bb99346943e995b06844c8dde430',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:13 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-315a3ab1-fdf0-4e23-877b-1fcea151f3ab tempest-VolumeQuotasAdminTestJSON-142573934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45115785-f79d-4763-b11f-15717707e533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:13 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-315a3ab1-fdf0-4e23-877b-1fcea151f3ab tempest-VolumeQuotasAdminTestJSON-142573934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45115785-f79d-4763-b11f-15717707e533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:13 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-315a3ab1-fdf0-4e23-877b-1fcea151f3ab tempest-VolumeQuotasAdminTestJSON-142573934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af504afd-10d2-4e91-aa1d-24380fbdb091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:13 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-315a3ab1-fdf0-4e23-877b-1fcea151f3ab tempest-VolumeQuotasAdminTestJSON-142573934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af504afd-10d2-4e91-aa1d-24380fbdb091) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9edd3b9f-a47c-430e-9da7-5d177ba0e90c', 'volume_name': 'volume-9edd3b9f-a47c-430e-9da7-5d177ba0e90c', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:13 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-315a3ab1-fdf0-4e23-877b-1fcea151f3ab tempest-VolumeQuotasAdminTestJSON-142573934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c914a9df-66ac-4707-9426-80d4bca424f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:13 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-315a3ab1-fdf0-4e23-877b-1fcea151f3ab tempest-VolumeQuotasAdminTestJSON-142573934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c914a9df-66ac-4707-9426-80d4bca424f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:13 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-315a3ab1-fdf0-4e23-877b-1fcea151f3ab tempest-VolumeQuotasAdminTestJSON-142573934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5586bc8-aabd-45a5-b62a-2347fd564843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:13 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-315a3ab1-fdf0-4e23-877b-1fcea151f3ab tempest-VolumeQuotasAdminTestJSON-142573934 None] Volume 9edd3b9f-a47c-430e-9da7-5d177ba0e90c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9edd3b9f-a47c-430e-9da7-5d177ba0e90c', 'volume_size': 1}
Apr 15 20:09:13 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-315a3ab1-fdf0-4e23-877b-1fcea151f3ab tempest-VolumeQuotasAdminTestJSON-142573934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:09:13 devstack sudo[86815]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:13 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b8b70bf6-effd-4162-af76-67adfc844246 tempest-SnapshotMetadataTestJSON-681748838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6c31e6bb-df30-47a3-aade-73d400fc83fb 1073741824" returned: 0 in 0.707s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:13 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b8b70bf6-effd-4162-af76-67adfc844246 tempest-SnapshotMetadataTestJSON-681748838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6c31e6bb-df30-47a3-aade-73d400fc83fb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:13 devstack sudo[86820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6c31e6bb-df30-47a3-aade-73d400fc83fb
Apr 15 20:09:13 devstack sudo[86820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:14 devstack sudo[86820]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:14 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b8b70bf6-effd-4162-af76-67adfc844246 tempest-SnapshotMetadataTestJSON-681748838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6c31e6bb-df30-47a3-aade-73d400fc83fb" returned: 0 in 0.487s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:14 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-b8b70bf6-effd-4162-af76-67adfc844246 tempest-SnapshotMetadataTestJSON-681748838 None] <== create_volume: return (1218ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:09:14 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-b8b70bf6-effd-4162-af76-67adfc844246 tempest-SnapshotMetadataTestJSON-681748838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.221s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:09:14 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-315a3ab1-fdf0-4e23-877b-1fcea151f3ab tempest-VolumeQuotasAdminTestJSON-142573934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.790s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:09:14 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-315a3ab1-fdf0-4e23-877b-1fcea151f3ab tempest-VolumeQuotasAdminTestJSON-142573934 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1835328833',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9edd3b9f-a47c-430e-9da7-5d177ba0e90c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4521e4e8268482b8737deee6e52cc0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:09:14Z,use_quota=True,user_id='43f5bb99346943e995b06844c8dde430',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:09:14 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-315a3ab1-fdf0-4e23-877b-1fcea151f3ab tempest-VolumeQuotasAdminTestJSON-142573934 None] Creating volume 9edd3b9f-a47c-430e-9da7-5d177ba0e90c {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:09:14 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-315a3ab1-fdf0-4e23-877b-1fcea151f3ab tempest-VolumeQuotasAdminTestJSON-142573934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:09:14 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-315a3ab1-fdf0-4e23-877b-1fcea151f3ab tempest-VolumeQuotasAdminTestJSON-142573934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:09:14 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-315a3ab1-fdf0-4e23-877b-1fcea151f3ab tempest-VolumeQuotasAdminTestJSON-142573934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:09:14 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-315a3ab1-fdf0-4e23-877b-1fcea151f3ab tempest-VolumeQuotasAdminTestJSON-142573934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:09:14 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-315a3ab1-fdf0-4e23-877b-1fcea151f3ab tempest-VolumeQuotasAdminTestJSON-142573934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:09:14 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-315a3ab1-fdf0-4e23-877b-1fcea151f3ab tempest-VolumeQuotasAdminTestJSON-142573934 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:09:14 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-315a3ab1-fdf0-4e23-877b-1fcea151f3ab tempest-VolumeQuotasAdminTestJSON-142573934 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:09:14 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-315a3ab1-fdf0-4e23-877b-1fcea151f3ab tempest-VolumeQuotasAdminTestJSON-142573934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9edd3b9f-a47c-430e-9da7-5d177ba0e90c 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b8b70bf6-effd-4162-af76-67adfc844246 tempest-SnapshotMetadataTestJSON-681748838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59dcabc8-547c-49b7-95a4-0aa7db0d5ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c31e6bb-df30-47a3-aade-73d400fc83fb', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b8b70bf6-effd-4162-af76-67adfc844246 tempest-SnapshotMetadataTestJSON-681748838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6d74995-97dd-48c5-8e7a-6e9fb15082fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:14 devstack sudo[86823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9edd3b9f-a47c-430e-9da7-5d177ba0e90c 1073741824
Apr 15 20:09:14 devstack sudo[86823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:14 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-b8b70bf6-effd-4162-af76-67adfc844246 tempest-SnapshotMetadataTestJSON-681748838 None] Volume volume-6c31e6bb-df30-47a3-aade-73d400fc83fb (6c31e6bb-df30-47a3-aade-73d400fc83fb): created successfully
Apr 15 20:09:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b8b70bf6-effd-4162-af76-67adfc844246 tempest-SnapshotMetadataTestJSON-681748838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6d74995-97dd-48c5-8e7a-6e9fb15082fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b8b70bf6-effd-4162-af76-67adfc844246 tempest-SnapshotMetadataTestJSON-681748838 None] Flow 'volume_create_manager' (4a2f13ca-d5b6-4a6e-8ab0-a77689c5c42c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:09:14 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-b8b70bf6-effd-4162-af76-67adfc844246 tempest-SnapshotMetadataTestJSON-681748838 None] Created volume successfully.
Apr 15 20:09:14 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7d9c899-4cc8-4c83-abf0-38070cb94c9f tempest-VolumesCloneTest-1413489225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:09:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b7d9c899-4cc8-4c83-abf0-38070cb94c9f tempest-VolumesCloneTest-1413489225 None] Flow 'volume_create_manager' (b09ae967-2195-48c1-963f-b55288e4036f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:09:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b7d9c899-4cc8-4c83-abf0-38070cb94c9f tempest-VolumesCloneTest-1413489225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c16f14e-3d09-491f-9e8f-53afdcdfd254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b7d9c899-4cc8-4c83-abf0-38070cb94c9f tempest-VolumesCloneTest-1413489225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c16f14e-3d09-491f-9e8f-53afdcdfd254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:09:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-378610105',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=587ebe3f-f054-4285-aff1-593a63eac59a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d344178b685c41349030fc835715fed7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:09:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:09:15Z,use_quota=True,user_id='a1d692cf84374b87b9c6f096febe8fbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b7d9c899-4cc8-4c83-abf0-38070cb94c9f tempest-VolumesCloneTest-1413489225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ede4606d-cba9-4f12-a9a7-2cc316a0ac08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b7d9c899-4cc8-4c83-abf0-38070cb94c9f tempest-VolumesCloneTest-1413489225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ede4606d-cba9-4f12-a9a7-2cc316a0ac08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b7d9c899-4cc8-4c83-abf0-38070cb94c9f tempest-VolumesCloneTest-1413489225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9795bbb-e13e-4267-bc7e-cf15da257380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b7d9c899-4cc8-4c83-abf0-38070cb94c9f tempest-VolumesCloneTest-1413489225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9795bbb-e13e-4267-bc7e-cf15da257380) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '587ebe3f-f054-4285-aff1-593a63eac59a', 'volume_name': 'volume-587ebe3f-f054-4285-aff1-593a63eac59a', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b7d9c899-4cc8-4c83-abf0-38070cb94c9f tempest-VolumesCloneTest-1413489225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (602f9c88-c70c-422f-b127-bd92026577af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b7d9c899-4cc8-4c83-abf0-38070cb94c9f tempest-VolumesCloneTest-1413489225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (602f9c88-c70c-422f-b127-bd92026577af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b7d9c899-4cc8-4c83-abf0-38070cb94c9f tempest-VolumesCloneTest-1413489225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e672fa4-34d9-4f62-8a07-5860c9077ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:14 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-b7d9c899-4cc8-4c83-abf0-38070cb94c9f tempest-VolumesCloneTest-1413489225 None] Volume 587ebe3f-f054-4285-aff1-593a63eac59a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-587ebe3f-f054-4285-aff1-593a63eac59a', 'volume_size': 1}
Apr 15 20:09:14 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-b7d9c899-4cc8-4c83-abf0-38070cb94c9f tempest-VolumesCloneTest-1413489225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:09:15 devstack sudo[86823]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:15 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-315a3ab1-fdf0-4e23-877b-1fcea151f3ab tempest-VolumeQuotasAdminTestJSON-142573934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9edd3b9f-a47c-430e-9da7-5d177ba0e90c 1073741824" returned: 0 in 0.601s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:15 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-315a3ab1-fdf0-4e23-877b-1fcea151f3ab tempest-VolumeQuotasAdminTestJSON-142573934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9edd3b9f-a47c-430e-9da7-5d177ba0e90c {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:15 devstack sudo[86828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9edd3b9f-a47c-430e-9da7-5d177ba0e90c
Apr 15 20:09:15 devstack sudo[86828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:15 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-fcaa725e-ad52-45c8-b416-7bfed7d4f3fe tempest-SnapshotMetadataTestJSON-681748838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:09:15 devstack sudo[86828]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:15 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-315a3ab1-fdf0-4e23-877b-1fcea151f3ab tempest-VolumeQuotasAdminTestJSON-142573934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9edd3b9f-a47c-430e-9da7-5d177ba0e90c" returned: 0 in 0.506s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:15 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-315a3ab1-fdf0-4e23-877b-1fcea151f3ab tempest-VolumeQuotasAdminTestJSON-142573934 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:09:15 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-315a3ab1-fdf0-4e23-877b-1fcea151f3ab tempest-VolumeQuotasAdminTestJSON-142573934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:09:15 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-b7d9c899-4cc8-4c83-abf0-38070cb94c9f tempest-VolumesCloneTest-1413489225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.810s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:09:15 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-b7d9c899-4cc8-4c83-abf0-38070cb94c9f tempest-VolumesCloneTest-1413489225 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:09:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-378610105',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=587ebe3f-f054-4285-aff1-593a63eac59a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d344178b685c41349030fc835715fed7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:09:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:09:15Z,use_quota=True,user_id='a1d692cf84374b87b9c6f096febe8fbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:09:15 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-b7d9c899-4cc8-4c83-abf0-38070cb94c9f tempest-VolumesCloneTest-1413489225 None] Creating volume 587ebe3f-f054-4285-aff1-593a63eac59a {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:09:15 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-b7d9c899-4cc8-4c83-abf0-38070cb94c9f tempest-VolumesCloneTest-1413489225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:09:15 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-b7d9c899-4cc8-4c83-abf0-38070cb94c9f tempest-VolumesCloneTest-1413489225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:09:15 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-b7d9c899-4cc8-4c83-abf0-38070cb94c9f tempest-VolumesCloneTest-1413489225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:09:15 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-b7d9c899-4cc8-4c83-abf0-38070cb94c9f tempest-VolumesCloneTest-1413489225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:09:15 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-b7d9c899-4cc8-4c83-abf0-38070cb94c9f tempest-VolumesCloneTest-1413489225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:09:15 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-b7d9c899-4cc8-4c83-abf0-38070cb94c9f tempest-VolumesCloneTest-1413489225 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:09:15 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-b7d9c899-4cc8-4c83-abf0-38070cb94c9f tempest-VolumesCloneTest-1413489225 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:09:15 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b7d9c899-4cc8-4c83-abf0-38070cb94c9f tempest-VolumesCloneTest-1413489225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-587ebe3f-f054-4285-aff1-593a63eac59a 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:15 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-315a3ab1-fdf0-4e23-877b-1fcea151f3ab tempest-VolumeQuotasAdminTestJSON-142573934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5586bc8-aabd-45a5-b62a-2347fd564843) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9edd3b9f-a47c-430e-9da7-5d177ba0e90c', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:15 devstack sudo[86831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-587ebe3f-f054-4285-aff1-593a63eac59a 1073741824
Apr 15 20:09:15 devstack sudo[86831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:15 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-315a3ab1-fdf0-4e23-877b-1fcea151f3ab tempest-VolumeQuotasAdminTestJSON-142573934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (239a1fde-8827-4955-b72f-b7dbc268034e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:15 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-315a3ab1-fdf0-4e23-877b-1fcea151f3ab tempest-VolumeQuotasAdminTestJSON-142573934 None] Volume volume-9edd3b9f-a47c-430e-9da7-5d177ba0e90c (9edd3b9f-a47c-430e-9da7-5d177ba0e90c): created successfully
Apr 15 20:09:15 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-315a3ab1-fdf0-4e23-877b-1fcea151f3ab tempest-VolumeQuotasAdminTestJSON-142573934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (239a1fde-8827-4955-b72f-b7dbc268034e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:15 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-315a3ab1-fdf0-4e23-877b-1fcea151f3ab tempest-VolumeQuotasAdminTestJSON-142573934 None] Flow 'volume_create_manager' (b81a292d-b34f-4be4-8d1b-e4deceb53ef9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:09:15 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-315a3ab1-fdf0-4e23-877b-1fcea151f3ab tempest-VolumeQuotasAdminTestJSON-142573934 None] Created volume successfully.
Apr 15 20:09:16 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-cb37d730-358d-46f3-a691-3972e93ccd89 tempest-VolumeQuotasAdminTestJSON-813430839 None] Transfer volume completed successfully.
Apr 15 20:09:16 devstack sudo[86831]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:16 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b7d9c899-4cc8-4c83-abf0-38070cb94c9f tempest-VolumesCloneTest-1413489225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-587ebe3f-f054-4285-aff1-593a63eac59a 1073741824" returned: 0 in 0.627s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:16 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b7d9c899-4cc8-4c83-abf0-38070cb94c9f tempest-VolumesCloneTest-1413489225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-587ebe3f-f054-4285-aff1-593a63eac59a {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:16 devstack sudo[86837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-587ebe3f-f054-4285-aff1-593a63eac59a
Apr 15 20:09:16 devstack sudo[86837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:16 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-0494d29b-dcbc-43b9-b590-e948f7df7ec5 tempest-GroupsTest-72358094 None] Group tempest-Group1-1915032791: creating
Apr 15 20:09:16 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-0494d29b-dcbc-43b9-b590-e948f7df7ec5 tempest-GroupsTest-72358094 None] Group tempest-Group1-1915032791: created successfully
Apr 15 20:09:16 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-0494d29b-dcbc-43b9-b590-e948f7df7ec5 tempest-GroupsTest-72358094 None] Create group completed successfully.
Apr 15 20:09:16 devstack sudo[86837]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:16 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b7d9c899-4cc8-4c83-abf0-38070cb94c9f tempest-VolumesCloneTest-1413489225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-587ebe3f-f054-4285-aff1-593a63eac59a" returned: 0 in 0.435s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:16 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-b7d9c899-4cc8-4c83-abf0-38070cb94c9f tempest-VolumesCloneTest-1413489225 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:09:16 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-b7d9c899-4cc8-4c83-abf0-38070cb94c9f tempest-VolumesCloneTest-1413489225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:09:16 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-fcaa725e-ad52-45c8-b416-7bfed7d4f3fe tempest-SnapshotMetadataTestJSON-681748838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.225s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:09:16 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-fcaa725e-ad52-45c8-b416-7bfed7d4f3fe tempest-SnapshotMetadataTestJSON-681748838 None] Creating offline snapshot a16034da-aa6c-4fab-ab85-666b5d55f0f5 of volume 6c31e6bb-df30-47a3-aade-73d400fc83fb {{(pid=82646) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 20:09:16 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b7d9c899-4cc8-4c83-abf0-38070cb94c9f tempest-VolumesCloneTest-1413489225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e672fa4-34d9-4f62-8a07-5860c9077ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-587ebe3f-f054-4285-aff1-593a63eac59a', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:16 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b7d9c899-4cc8-4c83-abf0-38070cb94c9f tempest-VolumesCloneTest-1413489225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7101f0c-b4ff-4ed5-8965-ed3ee1d8b6f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:16 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5be3b7-6f0e-42d5-8259-da3244b2d606]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:09:16 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-fcaa725e-ad52-45c8-b416-7bfed7d4f3fe tempest-SnapshotMetadataTestJSON-681748838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6c31e6bb-df30-47a3-aade-73d400fc83fb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:16 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-b7d9c899-4cc8-4c83-abf0-38070cb94c9f tempest-VolumesCloneTest-1413489225 None] Volume volume-587ebe3f-f054-4285-aff1-593a63eac59a (587ebe3f-f054-4285-aff1-593a63eac59a): created successfully
Apr 15 20:09:16 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b7d9c899-4cc8-4c83-abf0-38070cb94c9f tempest-VolumesCloneTest-1413489225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7101f0c-b4ff-4ed5-8965-ed3ee1d8b6f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:16 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b7d9c899-4cc8-4c83-abf0-38070cb94c9f tempest-VolumesCloneTest-1413489225 None] Flow 'volume_create_manager' (b09ae967-2195-48c1-963f-b55288e4036f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:09:16 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-b7d9c899-4cc8-4c83-abf0-38070cb94c9f tempest-VolumesCloneTest-1413489225 None] Created volume successfully.
Apr 15 20:09:16 devstack sudo[86840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6c31e6bb-df30-47a3-aade-73d400fc83fb
Apr 15 20:09:16 devstack sudo[86840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:17 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-257fa191-f7bf-400a-81c5-3e416b847513 tempest-VolumeQuotasAdminTestJSON-704963405 None] Acquiring lock "cinder-9edd3b9f-a47c-430e-9da7-5d177ba0e90c-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:09:17 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-257fa191-f7bf-400a-81c5-3e416b847513 tempest-VolumeQuotasAdminTestJSON-704963405 None] Lock "cinder-9edd3b9f-a47c-430e-9da7-5d177ba0e90c-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:09:17 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-257fa191-f7bf-400a-81c5-3e416b847513 tempest-VolumeQuotasAdminTestJSON-704963405 None] Acquiring lock "cinder-quobyte-9edd3b9f-a47c-430e-9da7-5d177ba0e90c" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:09:17 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-257fa191-f7bf-400a-81c5-3e416b847513 tempest-VolumeQuotasAdminTestJSON-704963405 None] Lock "cinder-quobyte-9edd3b9f-a47c-430e-9da7-5d177ba0e90c" acquired by "delete_volume" :: waited 0.014s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:09:17 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:09:17 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7fb117-62ea-4ec8-a7cf-1a1e5ae5a746]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:09:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-257fa191-f7bf-400a-81c5-3e416b847513 tempest-VolumeQuotasAdminTestJSON-704963405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9edd3b9f-a47c-430e-9da7-5d177ba0e90c {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] Flow 'volume_create_manager' (ddd80de9-07c6-4021-bd35-f43cd06bc527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:09:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (265abe24-ba45-4876-a7d4-a51e449f8754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (265abe24-ba45-4876-a7d4-a51e449f8754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:09:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-11599103',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5f5b686-aaee-407a-b653-8cd90af20a36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d344178b685c41349030fc835715fed7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:09:17Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=587ebe3f-f054-4285-aff1-593a63eac59a,status='creating',terminated_at=None,updated_at=2026-04-15T18:09:17Z,use_quota=True,user_id='a1d692cf84374b87b9c6f096febe8fbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d07de7af-4e69-4933-a78a-39476c00f15c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d07de7af-4e69-4933-a78a-39476c00f15c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4838a5e0-ee13-4568-ae53-839537ed0a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:17 devstack sudo[86842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9edd3b9f-a47c-430e-9da7-5d177ba0e90c
Apr 15 20:09:17 devstack sudo[86842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4838a5e0-ee13-4568-ae53-839537ed0a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f5f5b686-aaee-407a-b653-8cd90af20a36', 'volume_name': 'volume-f5f5b686-aaee-407a-b653-8cd90af20a36', 'volume_size': 2, 'source_volid': '587ebe3f-f054-4285-aff1-593a63eac59a', 'source_volstatus': 'available'}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be85b622-0c93-452f-a728-71afd7535223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be85b622-0c93-452f-a728-71afd7535223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (440ae917-9fcf-472e-a913-933e585d094d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:17 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] Volume f5f5b686-aaee-407a-b653-8cd90af20a36: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f5f5b686-aaee-407a-b653-8cd90af20a36', 'volume_size': 2, 'source_volid': '587ebe3f-f054-4285-aff1-593a63eac59a', 'source_volstatus': 'available'}
Apr 15 20:09:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:09:17 devstack sudo[86840]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-fcaa725e-ad52-45c8-b416-7bfed7d4f3fe tempest-SnapshotMetadataTestJSON-681748838 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6c31e6bb-df30-47a3-aade-73d400fc83fb" returned: 0 in 0.528s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-fcaa725e-ad52-45c8-b416-7bfed7d4f3fe tempest-SnapshotMetadataTestJSON-681748838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6c31e6bb-df30-47a3-aade-73d400fc83fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6c31e6bb-df30-47a3-aade-73d400fc83fb.a16034da-aa6c-4fab-ab85-666b5d55f0f5 1G {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:17 devstack sudo[86847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6c31e6bb-df30-47a3-aade-73d400fc83fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6c31e6bb-df30-47a3-aade-73d400fc83fb.a16034da-aa6c-4fab-ab85-666b5d55f0f5 1G
Apr 15 20:09:17 devstack sudo[86847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:17 devstack sudo[86842]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-257fa191-f7bf-400a-81c5-3e416b847513 tempest-VolumeQuotasAdminTestJSON-704963405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9edd3b9f-a47c-430e-9da7-5d177ba0e90c" returned: 0 in 0.511s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-257fa191-f7bf-400a-81c5-3e416b847513 tempest-VolumeQuotasAdminTestJSON-704963405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9edd3b9f-a47c-430e-9da7-5d177ba0e90c {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:17 devstack sudo[86855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9edd3b9f-a47c-430e-9da7-5d177ba0e90c
Apr 15 20:09:17 devstack sudo[86855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:17 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-3fc692c2-cedb-425c-a703-cfcb5154fb5a tempest-GroupsTest-72358094 None] Group tempest-Group2-1879351770: creating
Apr 15 20:09:17 devstack sudo[86847]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-fcaa725e-ad52-45c8-b416-7bfed7d4f3fe tempest-SnapshotMetadataTestJSON-681748838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6c31e6bb-df30-47a3-aade-73d400fc83fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6c31e6bb-df30-47a3-aade-73d400fc83fb.a16034da-aa6c-4fab-ab85-666b5d55f0f5 1G" returned: 0 in 0.503s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-fcaa725e-ad52-45c8-b416-7bfed7d4f3fe tempest-SnapshotMetadataTestJSON-681748838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c31e6bb-df30-47a3-aade-73d400fc83fb -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6c31e6bb-df30-47a3-aade-73d400fc83fb.a16034da-aa6c-4fab-ab85-666b5d55f0f5 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:17 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-3fc692c2-cedb-425c-a703-cfcb5154fb5a tempest-GroupsTest-72358094 None] Group tempest-Group2-1879351770: created successfully
Apr 15 20:09:17 devstack sudo[86857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c31e6bb-df30-47a3-aade-73d400fc83fb -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6c31e6bb-df30-47a3-aade-73d400fc83fb.a16034da-aa6c-4fab-ab85-666b5d55f0f5
Apr 15 20:09:17 devstack sudo[86857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:17 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-3fc692c2-cedb-425c-a703-cfcb5154fb5a tempest-GroupsTest-72358094 None] Create group completed successfully.
Apr 15 20:09:18 devstack sudo[86855]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-257fa191-f7bf-400a-81c5-3e416b847513 tempest-VolumeQuotasAdminTestJSON-704963405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9edd3b9f-a47c-430e-9da7-5d177ba0e90c" returned: 0 in 0.411s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:18 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-257fa191-f7bf-400a-81c5-3e416b847513 tempest-VolumeQuotasAdminTestJSON-704963405 None] Lock "cinder-quobyte-9edd3b9f-a47c-430e-9da7-5d177ba0e90c" released by "delete_volume" :: held 0.947s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:09:18 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-257fa191-f7bf-400a-81c5-3e416b847513 tempest-VolumeQuotasAdminTestJSON-704963405 None] Created reservations ['2334e2f3-caf8-4adb-b4f3-961f2009b4f7', '2eeda0e7-4f78-48d5-af1d-3b41e57a28be', 'e9bdfe30-b414-40e4-b96b-2f27c66caa86', '307402b7-cff9-41d1-806b-a8717a727790'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:09:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-257fa191-f7bf-400a-81c5-3e416b847513 tempest-VolumeQuotasAdminTestJSON-704963405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:09:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-257fa191-f7bf-400a-81c5-3e416b847513 tempest-VolumeQuotasAdminTestJSON-704963405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:09:18 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-257fa191-f7bf-400a-81c5-3e416b847513 tempest-VolumeQuotasAdminTestJSON-704963405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:09:18 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-257fa191-f7bf-400a-81c5-3e416b847513 tempest-VolumeQuotasAdminTestJSON-704963405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:09:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-257fa191-f7bf-400a-81c5-3e416b847513 tempest-VolumeQuotasAdminTestJSON-704963405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:09:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-257fa191-f7bf-400a-81c5-3e416b847513 tempest-VolumeQuotasAdminTestJSON-704963405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:18 devstack sudo[86863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:09:18 devstack sudo[86863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:18 devstack sudo[86857]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-fcaa725e-ad52-45c8-b416-7bfed7d4f3fe tempest-SnapshotMetadataTestJSON-681748838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c31e6bb-df30-47a3-aade-73d400fc83fb -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6c31e6bb-df30-47a3-aade-73d400fc83fb.a16034da-aa6c-4fab-ab85-666b5d55f0f5" returned: 0 in 0.441s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:18 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-fcaa725e-ad52-45c8-b416-7bfed7d4f3fe tempest-SnapshotMetadataTestJSON-681748838 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6c31e6bb-df30-47a3-aade-73d400fc83fb.a16034da-aa6c-4fab-ab85-666b5d55f0f5 is being set with open permissions: ugo+rw
Apr 15 20:09:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-fcaa725e-ad52-45c8-b416-7bfed7d4f3fe tempest-SnapshotMetadataTestJSON-681748838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6c31e6bb-df30-47a3-aade-73d400fc83fb.a16034da-aa6c-4fab-ab85-666b5d55f0f5 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:18 devstack sudo[86865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6c31e6bb-df30-47a3-aade-73d400fc83fb.a16034da-aa6c-4fab-ab85-666b5d55f0f5
Apr 15 20:09:18 devstack sudo[86865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:18 devstack sudo[86863]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-257fa191-f7bf-400a-81c5-3e416b847513 tempest-VolumeQuotasAdminTestJSON-704963405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.471s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:18 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-257fa191-f7bf-400a-81c5-3e416b847513 tempest-VolumeQuotasAdminTestJSON-704963405 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:09:18 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-257fa191-f7bf-400a-81c5-3e416b847513 tempest-VolumeQuotasAdminTestJSON-704963405 None] Deleted volume successfully.
Apr 15 20:09:18 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-257fa191-f7bf-400a-81c5-3e416b847513 tempest-VolumeQuotasAdminTestJSON-704963405 None] Lock "cinder-9edd3b9f-a47c-430e-9da7-5d177ba0e90c-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:09:18 devstack sudo[86865]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-fcaa725e-ad52-45c8-b416-7bfed7d4f3fe tempest-SnapshotMetadataTestJSON-681748838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6c31e6bb-df30-47a3-aade-73d400fc83fb.a16034da-aa6c-4fab-ab85-666b5d55f0f5" returned: 0 in 0.498s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-fcaa725e-ad52-45c8-b416-7bfed7d4f3fe tempest-SnapshotMetadataTestJSON-681748838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6c31e6bb-df30-47a3-aade-73d400fc83fb.info {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:18 devstack sudo[86869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6c31e6bb-df30-47a3-aade-73d400fc83fb.info
Apr 15 20:09:18 devstack sudo[86869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:19 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-19db0655-a12e-40e8-a46f-9e7e4072482a tempest-GroupsTest-72358094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:09:19 devstack sudo[86869]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:19 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-19db0655-a12e-40e8-a46f-9e7e4072482a tempest-GroupsTest-72358094 None] Flow 'volume_create_manager' (107474bd-c44f-41e6-b000-090be66d743d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:09:19 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-19db0655-a12e-40e8-a46f-9e7e4072482a tempest-GroupsTest-72358094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2702fc4-0668-4e02-a450-2e88c268bc22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:19 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-fcaa725e-ad52-45c8-b416-7bfed7d4f3fe tempest-SnapshotMetadataTestJSON-681748838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6c31e6bb-df30-47a3-aade-73d400fc83fb.info" returned: 0 in 0.494s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:19 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-fcaa725e-ad52-45c8-b416-7bfed7d4f3fe tempest-SnapshotMetadataTestJSON-681748838 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6c31e6bb-df30-47a3-aade-73d400fc83fb.info is being set with open permissions: ugo+rw
Apr 15 20:09:19 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-fcaa725e-ad52-45c8-b416-7bfed7d4f3fe tempest-SnapshotMetadataTestJSON-681748838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6c31e6bb-df30-47a3-aade-73d400fc83fb.info {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:19 devstack sudo[86872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6c31e6bb-df30-47a3-aade-73d400fc83fb.info
Apr 15 20:09:19 devstack sudo[86872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:19 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-19db0655-a12e-40e8-a46f-9e7e4072482a tempest-GroupsTest-72358094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2702fc4-0668-4e02-a450-2e88c268bc22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:09:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2061465061',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=da1045c2-07cc-4bbf-9709-44a040732d34,host='devstack@QuobyteHD#QuobyteHD',id=5d1aef1a-e19f-4984-9d2a-4a61919c4b42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd4d9805cb9f4c4583e417516b54bb95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:09:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:09:19Z,use_quota=True,user_id='f4e07c6c0f014b01b8648d72d3be3863',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03666052-87d4-4330-8400-1be505119e5b),volume_type_id=03666052-87d4-4330-8400-1be505119e5b)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:19 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-19db0655-a12e-40e8-a46f-9e7e4072482a tempest-GroupsTest-72358094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2d3beee-89fc-48d3-8285-03995e1e18c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:19 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-19db0655-a12e-40e8-a46f-9e7e4072482a tempest-GroupsTest-72358094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2d3beee-89fc-48d3-8285-03995e1e18c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:19 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-19db0655-a12e-40e8-a46f-9e7e4072482a tempest-GroupsTest-72358094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bb0d2aa-5e9f-4a12-b274-a6814500bbbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:19 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-19db0655-a12e-40e8-a46f-9e7e4072482a tempest-GroupsTest-72358094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bb0d2aa-5e9f-4a12-b274-a6814500bbbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d1aef1a-e19f-4984-9d2a-4a61919c4b42', 'volume_name': 'volume-5d1aef1a-e19f-4984-9d2a-4a61919c4b42', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:19 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-19db0655-a12e-40e8-a46f-9e7e4072482a tempest-GroupsTest-72358094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2814c28f-f3e0-4b3d-afef-e7f66d348e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:19 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-19db0655-a12e-40e8-a46f-9e7e4072482a tempest-GroupsTest-72358094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2814c28f-f3e0-4b3d-afef-e7f66d348e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:19 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-19db0655-a12e-40e8-a46f-9e7e4072482a tempest-GroupsTest-72358094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9d8bd55-baab-45b6-b2dd-519564633d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:19 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-19db0655-a12e-40e8-a46f-9e7e4072482a tempest-GroupsTest-72358094 None] Volume 5d1aef1a-e19f-4984-9d2a-4a61919c4b42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d1aef1a-e19f-4984-9d2a-4a61919c4b42', 'volume_size': 1}
Apr 15 20:09:19 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-19db0655-a12e-40e8-a46f-9e7e4072482a tempest-GroupsTest-72358094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:09:19 devstack sudo[86872]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:19 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-fcaa725e-ad52-45c8-b416-7bfed7d4f3fe tempest-SnapshotMetadataTestJSON-681748838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6c31e6bb-df30-47a3-aade-73d400fc83fb.info" returned: 0 in 0.504s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:19 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-fcaa725e-ad52-45c8-b416-7bfed7d4f3fe tempest-SnapshotMetadataTestJSON-681748838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.027s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:09:19 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 2.492s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:09:19 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] Cloning volume 587ebe3f-f054-4285-aff1-593a63eac59a to volume f5f5b686-aaee-407a-b653-8cd90af20a36
Apr 15 20:09:19 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-fcaa725e-ad52-45c8-b416-7bfed7d4f3fe tempest-SnapshotMetadataTestJSON-681748838 None] Create snapshot completed successfully
Apr 15 20:09:19 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] Creating offline snapshot 2a4cd278-ffb8-4f36-9670-85010a63470c of volume 587ebe3f-f054-4285-aff1-593a63eac59a {{(pid=82646) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 20:09:19 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c05847f-7428-4cba-85ca-520a56d62318]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:09:19 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-587ebe3f-f054-4285-aff1-593a63eac59a {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:19 devstack sudo[86875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-587ebe3f-f054-4285-aff1-593a63eac59a
Apr 15 20:09:19 devstack sudo[86875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:20 devstack sudo[86875]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-587ebe3f-f054-4285-aff1-593a63eac59a" returned: 0 in 0.546s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-587ebe3f-f054-4285-aff1-593a63eac59a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-587ebe3f-f054-4285-aff1-593a63eac59a.2a4cd278-ffb8-4f36-9670-85010a63470c 1G {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:20 devstack sudo[86880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-587ebe3f-f054-4285-aff1-593a63eac59a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-587ebe3f-f054-4285-aff1-593a63eac59a.2a4cd278-ffb8-4f36-9670-85010a63470c 1G
Apr 15 20:09:20 devstack sudo[86880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:20 devstack sudo[86880]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-587ebe3f-f054-4285-aff1-593a63eac59a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-587ebe3f-f054-4285-aff1-593a63eac59a.2a4cd278-ffb8-4f36-9670-85010a63470c 1G" returned: 0 in 0.619s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-587ebe3f-f054-4285-aff1-593a63eac59a -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-587ebe3f-f054-4285-aff1-593a63eac59a.2a4cd278-ffb8-4f36-9670-85010a63470c {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:20 devstack sudo[86885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-587ebe3f-f054-4285-aff1-593a63eac59a -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-587ebe3f-f054-4285-aff1-593a63eac59a.2a4cd278-ffb8-4f36-9670-85010a63470c
Apr 15 20:09:20 devstack sudo[86885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:21 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-fb1258e0-67a7-4ba4-8348-4c738eef33ac tempest-SnapshotMetadataTestJSON-681748838 None] Acquiring lock "cinder-a16034da-aa6c-4fab-ab85-666b5d55f0f5-delete_snapshot" by "delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:09:21 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-fb1258e0-67a7-4ba4-8348-4c738eef33ac tempest-SnapshotMetadataTestJSON-681748838 None] Lock "cinder-a16034da-aa6c-4fab-ab85-666b5d55f0f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:09:21 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-fb1258e0-67a7-4ba4-8348-4c738eef33ac tempest-SnapshotMetadataTestJSON-681748838 None] Acquiring lock "cinder-quobyte-6c31e6bb-df30-47a3-aade-73d400fc83fb" by "delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:09:21 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-fb1258e0-67a7-4ba4-8348-4c738eef33ac tempest-SnapshotMetadataTestJSON-681748838 None] Lock "cinder-quobyte-6c31e6bb-df30-47a3-aade-73d400fc83fb" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:09:21 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-fb1258e0-67a7-4ba4-8348-4c738eef33ac tempest-SnapshotMetadataTestJSON-681748838 None] Acquiring lock "cinder-quobyte-a16034da-aa6c-4fab-ab85-666b5d55f0f5" by "_delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:09:21 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-fb1258e0-67a7-4ba4-8348-4c738eef33ac tempest-SnapshotMetadataTestJSON-681748838 None] Lock "cinder-quobyte-a16034da-aa6c-4fab-ab85-666b5d55f0f5" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:09:21 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-fb1258e0-67a7-4ba4-8348-4c738eef33ac tempest-SnapshotMetadataTestJSON-681748838 None] Deleting offline snapshot a16034da-aa6c-4fab-ab85-666b5d55f0f5 of volume 6c31e6bb-df30-47a3-aade-73d400fc83fb {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 20:09:21 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-fb1258e0-67a7-4ba4-8348-4c738eef33ac tempest-SnapshotMetadataTestJSON-681748838 None] snapshot_file for this snap is: volume-6c31e6bb-df30-47a3-aade-73d400fc83fb.a16034da-aa6c-4fab-ab85-666b5d55f0f5 {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 20:09:21 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0deec0-ef74-4163-ba02-052a2371fbf4]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:09:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-fb1258e0-67a7-4ba4-8348-4c738eef33ac tempest-SnapshotMetadataTestJSON-681748838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6c31e6bb-df30-47a3-aade-73d400fc83fb.a16034da-aa6c-4fab-ab85-666b5d55f0f5 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:21 devstack sudo[86887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6c31e6bb-df30-47a3-aade-73d400fc83fb.a16034da-aa6c-4fab-ab85-666b5d55f0f5
Apr 15 20:09:21 devstack sudo[86887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:21 devstack sudo[86885]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-587ebe3f-f054-4285-aff1-593a63eac59a -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-587ebe3f-f054-4285-aff1-593a63eac59a.2a4cd278-ffb8-4f36-9670-85010a63470c" returned: 0 in 0.539s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:21 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-587ebe3f-f054-4285-aff1-593a63eac59a.2a4cd278-ffb8-4f36-9670-85010a63470c is being set with open permissions: ugo+rw
Apr 15 20:09:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-587ebe3f-f054-4285-aff1-593a63eac59a.2a4cd278-ffb8-4f36-9670-85010a63470c {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:21 devstack sudo[86892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-587ebe3f-f054-4285-aff1-593a63eac59a.2a4cd278-ffb8-4f36-9670-85010a63470c
Apr 15 20:09:21 devstack sudo[86892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:21 devstack sudo[86887]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-fb1258e0-67a7-4ba4-8348-4c738eef33ac tempest-SnapshotMetadataTestJSON-681748838 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6c31e6bb-df30-47a3-aade-73d400fc83fb.a16034da-aa6c-4fab-ab85-666b5d55f0f5" returned: 0 in 0.634s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:21 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-fb1258e0-67a7-4ba4-8348-4c738eef33ac tempest-SnapshotMetadataTestJSON-681748838 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c31e6bb-df30-47a3-aade-73d400fc83fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82646) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 20:09:21 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ed5fa5-8f97-4b11-9c82-e44d4e12bbc6]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:09:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-fb1258e0-67a7-4ba4-8348-4c738eef33ac tempest-SnapshotMetadataTestJSON-681748838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6c31e6bb-df30-47a3-aade-73d400fc83fb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:21 devstack sudo[86892]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-587ebe3f-f054-4285-aff1-593a63eac59a.2a4cd278-ffb8-4f36-9670-85010a63470c" returned: 0 in 0.493s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-587ebe3f-f054-4285-aff1-593a63eac59a.info {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:22 devstack sudo[86898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6c31e6bb-df30-47a3-aade-73d400fc83fb
Apr 15 20:09:22 devstack sudo[86898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:22 devstack sudo[86900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-587ebe3f-f054-4285-aff1-593a63eac59a.info
Apr 15 20:09:22 devstack sudo[86900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:22 devstack sudo[86898]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-fb1258e0-67a7-4ba4-8348-4c738eef33ac tempest-SnapshotMetadataTestJSON-681748838 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6c31e6bb-df30-47a3-aade-73d400fc83fb" returned: 0 in 0.510s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-fb1258e0-67a7-4ba4-8348-4c738eef33ac tempest-SnapshotMetadataTestJSON-681748838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6c31e6bb-df30-47a3-aade-73d400fc83fb.a16034da-aa6c-4fab-ab85-666b5d55f0f5 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:22 devstack sudo[86906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6c31e6bb-df30-47a3-aade-73d400fc83fb.a16034da-aa6c-4fab-ab85-666b5d55f0f5
Apr 15 20:09:22 devstack sudo[86906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:22 devstack sudo[86900]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-587ebe3f-f054-4285-aff1-593a63eac59a.info" returned: 0 in 0.504s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:22 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-587ebe3f-f054-4285-aff1-593a63eac59a.info is being set with open permissions: ugo+rw
Apr 15 20:09:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-587ebe3f-f054-4285-aff1-593a63eac59a.info {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:22 devstack sudo[86908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-587ebe3f-f054-4285-aff1-593a63eac59a.info
Apr 15 20:09:22 devstack sudo[86908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:22 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd18b48b-21cd-4485-a48c-fafcc8226e85 tempest-VolumeQuotasNegativeTestJSON-1880156905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:09:22 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-dd18b48b-21cd-4485-a48c-fafcc8226e85 tempest-VolumeQuotasNegativeTestJSON-1880156905 None] Flow 'volume_create_manager' (a8e789b7-b0ff-4e55-b915-8e1a09890d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:09:22 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-dd18b48b-21cd-4485-a48c-fafcc8226e85 tempest-VolumeQuotasNegativeTestJSON-1880156905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (344fd7cc-c686-47e0-8058-96d156f9fef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:22 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-dd18b48b-21cd-4485-a48c-fafcc8226e85 tempest-VolumeQuotasNegativeTestJSON-1880156905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (344fd7cc-c686-47e0-8058-96d156f9fef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:09:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-69110279',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0616a3ca-137d-44c8-a47a-81993e784001,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a0a5d159be4494db45d800aa68fed2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:09:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:09:23Z,use_quota=True,user_id='7df184cd1d7c41019c45d82de318f75c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:22 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-dd18b48b-21cd-4485-a48c-fafcc8226e85 tempest-VolumeQuotasNegativeTestJSON-1880156905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12aa4257-79a9-4183-97c2-daa4cd118092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:22 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-dd18b48b-21cd-4485-a48c-fafcc8226e85 tempest-VolumeQuotasNegativeTestJSON-1880156905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12aa4257-79a9-4183-97c2-daa4cd118092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:22 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-dd18b48b-21cd-4485-a48c-fafcc8226e85 tempest-VolumeQuotasNegativeTestJSON-1880156905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b436830-e813-4bfc-a4a6-68bd955b06ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:22 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-dd18b48b-21cd-4485-a48c-fafcc8226e85 tempest-VolumeQuotasNegativeTestJSON-1880156905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b436830-e813-4bfc-a4a6-68bd955b06ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0616a3ca-137d-44c8-a47a-81993e784001', 'volume_name': 'volume-0616a3ca-137d-44c8-a47a-81993e784001', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:22 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-dd18b48b-21cd-4485-a48c-fafcc8226e85 tempest-VolumeQuotasNegativeTestJSON-1880156905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb9b851f-75c7-4f91-b90e-b8722a329437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:22 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-dd18b48b-21cd-4485-a48c-fafcc8226e85 tempest-VolumeQuotasNegativeTestJSON-1880156905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb9b851f-75c7-4f91-b90e-b8722a329437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:22 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-dd18b48b-21cd-4485-a48c-fafcc8226e85 tempest-VolumeQuotasNegativeTestJSON-1880156905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f105046c-6d20-4f7d-accf-a41c4925c63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:22 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-dd18b48b-21cd-4485-a48c-fafcc8226e85 tempest-VolumeQuotasNegativeTestJSON-1880156905 None] Volume 0616a3ca-137d-44c8-a47a-81993e784001: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0616a3ca-137d-44c8-a47a-81993e784001', 'volume_size': 1}
Apr 15 20:09:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-dd18b48b-21cd-4485-a48c-fafcc8226e85 tempest-VolumeQuotasNegativeTestJSON-1880156905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:09:22 devstack sudo[86906]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-fb1258e0-67a7-4ba4-8348-4c738eef33ac tempest-SnapshotMetadataTestJSON-681748838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6c31e6bb-df30-47a3-aade-73d400fc83fb.a16034da-aa6c-4fab-ab85-666b5d55f0f5" returned: 0 in 0.489s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-fb1258e0-67a7-4ba4-8348-4c738eef33ac tempest-SnapshotMetadataTestJSON-681748838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6c31e6bb-df30-47a3-aade-73d400fc83fb.a16034da-aa6c-4fab-ab85-666b5d55f0f5 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:22 devstack sudo[86914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6c31e6bb-df30-47a3-aade-73d400fc83fb.a16034da-aa6c-4fab-ab85-666b5d55f0f5
Apr 15 20:09:22 devstack sudo[86914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:22 devstack sudo[86908]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-587ebe3f-f054-4285-aff1-593a63eac59a.info" returned: 0 in 0.461s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:22 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] Acquiring lock "cinder-quobyte-f5f5b686-aaee-407a-b653-8cd90af20a36" by "_copy_volume_from_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:09:23 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] Lock "cinder-quobyte-f5f5b686-aaee-407a-b653-8cd90af20a36" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:09:23 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] snapshot: 2a4cd278-ffb8-4f36-9670-85010a63470c, volume: f5f5b686-aaee-407a-b653-8cd90af20a36,  {{(pid=82646) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 15 20:09:23 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:09:23 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:09:23 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:09:23 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:09:23 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:09:23 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d0bf53-ba1b-4b50-be70-df7093124573]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:09:23 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-587ebe3f-f054-4285-aff1-593a63eac59a.2a4cd278-ffb8-4f36-9670-85010a63470c {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:23 devstack sudo[86916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-587ebe3f-f054-4285-aff1-593a63eac59a.2a4cd278-ffb8-4f36-9670-85010a63470c
Apr 15 20:09:23 devstack sudo[86916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:23 devstack sudo[86914]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:23 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-fb1258e0-67a7-4ba4-8348-4c738eef33ac tempest-SnapshotMetadataTestJSON-681748838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6c31e6bb-df30-47a3-aade-73d400fc83fb.a16034da-aa6c-4fab-ab85-666b5d55f0f5" returned: 0 in 0.409s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:23 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-fb1258e0-67a7-4ba4-8348-4c738eef33ac tempest-SnapshotMetadataTestJSON-681748838 None] Lock "cinder-quobyte-a16034da-aa6c-4fab-ab85-666b5d55f0f5" released by "_delete_snapshot" :: held 2.111s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:09:23 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-fb1258e0-67a7-4ba4-8348-4c738eef33ac tempest-SnapshotMetadataTestJSON-681748838 None] Lock "cinder-quobyte-6c31e6bb-df30-47a3-aade-73d400fc83fb" released by "delete_snapshot" :: held 2.126s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:09:23 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-fb1258e0-67a7-4ba4-8348-4c738eef33ac tempest-SnapshotMetadataTestJSON-681748838 None] Created reservations ['00336138-0165-490e-99d9-38b7816ac096', '80035b6c-5b2b-42e6-9dc8-5cb78ccd4f5c', '5a214ffa-719d-46d5-9162-e8a3f7f30453', 'ec45cdc0-9c87-44d1-ba32-801941054045'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:09:23 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-fb1258e0-67a7-4ba4-8348-4c738eef33ac tempest-SnapshotMetadataTestJSON-681748838 None] Delete snapshot completed successfully.
Apr 15 20:09:23 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-fb1258e0-67a7-4ba4-8348-4c738eef33ac tempest-SnapshotMetadataTestJSON-681748838 None] Lock "cinder-a16034da-aa6c-4fab-ab85-666b5d55f0f5-delete_snapshot" released by "delete_snapshot" :: held 2.255s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:09:23 devstack sudo[86916]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:23 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-587ebe3f-f054-4285-aff1-593a63eac59a.2a4cd278-ffb8-4f36-9670-85010a63470c" returned: 0 in 0.540s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:23 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-587ebe3f-f054-4285-aff1-593a63eac59a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82646) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 20:09:23 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-587ebe3f-f054-4285-aff1-593a63eac59a {{(pid=82646) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 15 20:09:23 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] Creating direct copy from snapshot {{(pid=82646) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 15 20:09:23 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63d73f3-dd51-4ecb-95b0-e76660287e12]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:09:23 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-587ebe3f-f054-4285-aff1-593a63eac59a {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:23 devstack sudo[86922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-587ebe3f-f054-4285-aff1-593a63eac59a
Apr 15 20:09:23 devstack sudo[86922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:24 devstack sudo[86922]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-587ebe3f-f054-4285-aff1-593a63eac59a" returned: 0 in 0.468s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:24 devstack cinder-volume[82646]: DEBUG cinder.utils [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] Path /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f5f5b686-aaee-407a-b653-8cd90af20a36 not found in is_blk_device check {{(pid=82646) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 15 20:09:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-587ebe3f-f054-4285-aff1-593a63eac59a /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f5f5b686-aaee-407a-b653-8cd90af20a36 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:24 devstack sudo[86927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-587ebe3f-f054-4285-aff1-593a63eac59a /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f5f5b686-aaee-407a-b653-8cd90af20a36
Apr 15 20:09:24 devstack sudo[86927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:24 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-1804d35e-8054-4fae-8a80-74abc621e330 tempest-SnapshotMetadataTestJSON-681748838 None] Acquiring lock "cinder-6c31e6bb-df30-47a3-aade-73d400fc83fb-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:09:24 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-1804d35e-8054-4fae-8a80-74abc621e330 tempest-SnapshotMetadataTestJSON-681748838 None] Lock "cinder-6c31e6bb-df30-47a3-aade-73d400fc83fb-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:09:24 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-1804d35e-8054-4fae-8a80-74abc621e330 tempest-SnapshotMetadataTestJSON-681748838 None] Acquiring lock "cinder-quobyte-6c31e6bb-df30-47a3-aade-73d400fc83fb" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:09:24 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-1804d35e-8054-4fae-8a80-74abc621e330 tempest-SnapshotMetadataTestJSON-681748838 None] Lock "cinder-quobyte-6c31e6bb-df30-47a3-aade-73d400fc83fb" acquired by "delete_volume" :: waited 0.009s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:09:24 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea515f3-65a8-4495-b18f-080a2568af0b]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:09:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-1804d35e-8054-4fae-8a80-74abc621e330 tempest-SnapshotMetadataTestJSON-681748838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6c31e6bb-df30-47a3-aade-73d400fc83fb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:24 devstack sudo[86932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6c31e6bb-df30-47a3-aade-73d400fc83fb
Apr 15 20:09:24 devstack sudo[86932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:26 devstack sudo[86932]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:26 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-1804d35e-8054-4fae-8a80-74abc621e330 tempest-SnapshotMetadataTestJSON-681748838 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6c31e6bb-df30-47a3-aade-73d400fc83fb" returned: 0 in 1.483s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:26 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-1804d35e-8054-4fae-8a80-74abc621e330 tempest-SnapshotMetadataTestJSON-681748838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6c31e6bb-df30-47a3-aade-73d400fc83fb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:26 devstack sudo[86946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6c31e6bb-df30-47a3-aade-73d400fc83fb
Apr 15 20:09:26 devstack sudo[86946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:26 devstack sudo[86927]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:26 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-587ebe3f-f054-4285-aff1-593a63eac59a /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f5f5b686-aaee-407a-b653-8cd90af20a36" returned: 0 in 2.380s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:26 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64f13c4-97c3-4b24-9f83-86b970bf9208]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:09:26 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-587ebe3f-f054-4285-aff1-593a63eac59a {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:26 devstack sudo[86948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-587ebe3f-f054-4285-aff1-593a63eac59a
Apr 15 20:09:26 devstack sudo[86948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:26 devstack sudo[86946]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:26 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-1804d35e-8054-4fae-8a80-74abc621e330 tempest-SnapshotMetadataTestJSON-681748838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6c31e6bb-df30-47a3-aade-73d400fc83fb" returned: 0 in 0.635s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:26 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-1804d35e-8054-4fae-8a80-74abc621e330 tempest-SnapshotMetadataTestJSON-681748838 None] Lock "cinder-quobyte-6c31e6bb-df30-47a3-aade-73d400fc83fb" released by "delete_volume" :: held 2.146s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:09:26 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-1804d35e-8054-4fae-8a80-74abc621e330 tempest-SnapshotMetadataTestJSON-681748838 None] Created reservations ['3f33b694-180f-4e2c-855d-e9c6ac8623fe', '799fa5b0-4cfc-4d90-a134-630b3cecd888', '43da08c4-e788-49ca-a258-befdbaf534ed', '3721c5f6-c457-4c72-bd04-db09d6a97b54'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:09:26 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-1804d35e-8054-4fae-8a80-74abc621e330 tempest-SnapshotMetadataTestJSON-681748838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:09:26 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-1804d35e-8054-4fae-8a80-74abc621e330 tempest-SnapshotMetadataTestJSON-681748838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:09:26 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-1804d35e-8054-4fae-8a80-74abc621e330 tempest-SnapshotMetadataTestJSON-681748838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:09:26 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-1804d35e-8054-4fae-8a80-74abc621e330 tempest-SnapshotMetadataTestJSON-681748838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:09:26 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-1804d35e-8054-4fae-8a80-74abc621e330 tempest-SnapshotMetadataTestJSON-681748838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:09:26 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-1804d35e-8054-4fae-8a80-74abc621e330 tempest-SnapshotMetadataTestJSON-681748838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:26 devstack sudo[86951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:09:26 devstack sudo[86951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:27 devstack sudo[86951]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:27 devstack sudo[86948]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:27 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-1804d35e-8054-4fae-8a80-74abc621e330 tempest-SnapshotMetadataTestJSON-681748838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.414s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:27 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-1804d35e-8054-4fae-8a80-74abc621e330 tempest-SnapshotMetadataTestJSON-681748838 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:09:27 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-587ebe3f-f054-4285-aff1-593a63eac59a" returned: 0 in 0.736s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:27 devstack cinder-volume[82646]: DEBUG cinder.image.image_utils [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] Image conversion details: src /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-587ebe3f-f054-4285-aff1-593a63eac59a, size 1024.00 MB, duration 2.38 sec, destination /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f5f5b686-aaee-407a-b653-8cd90af20a36 {{(pid=82646) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 20:09:27 devstack cinder-volume[82646]: INFO cinder.image.image_utils [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] Converted 1024.00 MB image at 430.03 MB/s
Apr 15 20:09:27 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f5f5b686-aaee-407a-b653-8cd90af20a36 is being set with open permissions: ugo+rw
Apr 15 20:09:27 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f5f5b686-aaee-407a-b653-8cd90af20a36 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:27 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-1804d35e-8054-4fae-8a80-74abc621e330 tempest-SnapshotMetadataTestJSON-681748838 None] Deleted volume successfully.
Apr 15 20:09:27 devstack sudo[86957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f5f5b686-aaee-407a-b653-8cd90af20a36
Apr 15 20:09:27 devstack sudo[86957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:27 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-1804d35e-8054-4fae-8a80-74abc621e330 tempest-SnapshotMetadataTestJSON-681748838 None] Lock "cinder-6c31e6bb-df30-47a3-aade-73d400fc83fb-delete_volume" released by "delete_volume" :: held 2.747s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:09:27 devstack sudo[86957]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:27 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f5f5b686-aaee-407a-b653-8cd90af20a36" returned: 0 in 0.487s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:27 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] Lock "cinder-quobyte-f5f5b686-aaee-407a-b653-8cd90af20a36" released by "_copy_volume_from_snapshot" :: held 4.663s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:09:27 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] Acquiring lock "cinder-quobyte-2a4cd278-ffb8-4f36-9670-85010a63470c" by "_delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:09:27 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] Lock "cinder-quobyte-2a4cd278-ffb8-4f36-9670-85010a63470c" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:09:27 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] Deleting offline snapshot 2a4cd278-ffb8-4f36-9670-85010a63470c of volume 587ebe3f-f054-4285-aff1-593a63eac59a {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 20:09:27 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] snapshot_file for this snap is: volume-587ebe3f-f054-4285-aff1-593a63eac59a.2a4cd278-ffb8-4f36-9670-85010a63470c {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 20:09:27 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a6b8086-9b45-4bb7-9539-f076bb0b11d6]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:09:27 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-587ebe3f-f054-4285-aff1-593a63eac59a.2a4cd278-ffb8-4f36-9670-85010a63470c {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:27 devstack sudo[86960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-587ebe3f-f054-4285-aff1-593a63eac59a.2a4cd278-ffb8-4f36-9670-85010a63470c
Apr 15 20:09:27 devstack sudo[86960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:28 devstack sudo[86960]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:28 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-587ebe3f-f054-4285-aff1-593a63eac59a.2a4cd278-ffb8-4f36-9670-85010a63470c" returned: 0 in 0.571s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:28 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-587ebe3f-f054-4285-aff1-593a63eac59a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82646) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 20:09:28 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f091b3-d7c1-420d-b46f-e04f71e3734f]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:09:28 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-587ebe3f-f054-4285-aff1-593a63eac59a {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:28 devstack sudo[86965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-587ebe3f-f054-4285-aff1-593a63eac59a
Apr 15 20:09:28 devstack sudo[86965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:28 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac958229-20b0-4325-a820-41b3a0af6d71 tempest-VolumesMetadataTest-2137068834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:09:28 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ac958229-20b0-4325-a820-41b3a0af6d71 tempest-VolumesMetadataTest-2137068834 None] Flow 'volume_create_manager' (0a839d4f-cde6-4eba-b98f-d983d0e917e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:09:28 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ac958229-20b0-4325-a820-41b3a0af6d71 tempest-VolumesMetadataTest-2137068834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5d29c84-053b-42c7-9e1d-9fc372298199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:28 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ac958229-20b0-4325-a820-41b3a0af6d71 tempest-VolumesMetadataTest-2137068834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5d29c84-053b-42c7-9e1d-9fc372298199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:09:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1156986807',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=667e6a67-c93c-4445-9ed5-d91b26c2f42b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b183129cf574d80ba21b51be623ac11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:09:29Z,use_quota=True,user_id='a18044cf571547269d87cb684a98ab3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:28 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ac958229-20b0-4325-a820-41b3a0af6d71 tempest-VolumesMetadataTest-2137068834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dded5d8-e79c-45a1-8d65-0d5d86c2e0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:28 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ac958229-20b0-4325-a820-41b3a0af6d71 tempest-VolumesMetadataTest-2137068834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dded5d8-e79c-45a1-8d65-0d5d86c2e0fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:28 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ac958229-20b0-4325-a820-41b3a0af6d71 tempest-VolumesMetadataTest-2137068834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c337d139-2e59-4480-80d1-00c2d03187f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:28 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ac958229-20b0-4325-a820-41b3a0af6d71 tempest-VolumesMetadataTest-2137068834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c337d139-2e59-4480-80d1-00c2d03187f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '667e6a67-c93c-4445-9ed5-d91b26c2f42b', 'volume_name': 'volume-667e6a67-c93c-4445-9ed5-d91b26c2f42b', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:28 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ac958229-20b0-4325-a820-41b3a0af6d71 tempest-VolumesMetadataTest-2137068834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (656ee6d8-8e4e-4847-ad78-c6d43d5df6ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:28 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ac958229-20b0-4325-a820-41b3a0af6d71 tempest-VolumesMetadataTest-2137068834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (656ee6d8-8e4e-4847-ad78-c6d43d5df6ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:28 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ac958229-20b0-4325-a820-41b3a0af6d71 tempest-VolumesMetadataTest-2137068834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (262dc291-6df6-4cf1-9f3a-2b5c8ed0781b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:28 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-ac958229-20b0-4325-a820-41b3a0af6d71 tempest-VolumesMetadataTest-2137068834 None] Volume 667e6a67-c93c-4445-9ed5-d91b26c2f42b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-667e6a67-c93c-4445-9ed5-d91b26c2f42b', 'volume_size': 1}
Apr 15 20:09:28 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-ac958229-20b0-4325-a820-41b3a0af6d71 tempest-VolumesMetadataTest-2137068834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:09:28 devstack sudo[86965]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:28 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-587ebe3f-f054-4285-aff1-593a63eac59a" returned: 0 in 0.564s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:28 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-587ebe3f-f054-4285-aff1-593a63eac59a.2a4cd278-ffb8-4f36-9670-85010a63470c {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:28 devstack sudo[86970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-587ebe3f-f054-4285-aff1-593a63eac59a.2a4cd278-ffb8-4f36-9670-85010a63470c
Apr 15 20:09:28 devstack sudo[86970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:29 devstack sudo[86970]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-587ebe3f-f054-4285-aff1-593a63eac59a.2a4cd278-ffb8-4f36-9670-85010a63470c" returned: 0 in 0.510s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-587ebe3f-f054-4285-aff1-593a63eac59a.2a4cd278-ffb8-4f36-9670-85010a63470c {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:29 devstack sudo[86975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-587ebe3f-f054-4285-aff1-593a63eac59a.2a4cd278-ffb8-4f36-9670-85010a63470c
Apr 15 20:09:29 devstack sudo[86975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:29 devstack sudo[86975]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-587ebe3f-f054-4285-aff1-593a63eac59a.2a4cd278-ffb8-4f36-9670-85010a63470c" returned: 0 in 0.425s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:29 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] Lock "cinder-quobyte-2a4cd278-ffb8-4f36-9670-85010a63470c" released by "_delete_snapshot" :: held 2.122s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:09:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.116s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:09:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-19db0655-a12e-40e8-a46f-9e7e4072482a tempest-GroupsTest-72358094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.585s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:09:29 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-19db0655-a12e-40e8-a46f-9e7e4072482a tempest-GroupsTest-72358094 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=da1045c2-07cc-4bbf-9709-44a040732d34,created_at=2026-04-15T18:09:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2061465061',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=da1045c2-07cc-4bbf-9709-44a040732d34,host='devstack@QuobyteHD#QuobyteHD',id=5d1aef1a-e19f-4984-9d2a-4a61919c4b42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd4d9805cb9f4c4583e417516b54bb95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:09:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:09:19Z,use_quota=True,user_id='f4e07c6c0f014b01b8648d72d3be3863',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03666052-87d4-4330-8400-1be505119e5b),volume_type_id=03666052-87d4-4330-8400-1be505119e5b)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:09:29 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-19db0655-a12e-40e8-a46f-9e7e4072482a tempest-GroupsTest-72358094 None] Creating volume 5d1aef1a-e19f-4984-9d2a-4a61919c4b42 {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:09:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-19db0655-a12e-40e8-a46f-9e7e4072482a tempest-GroupsTest-72358094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:09:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-19db0655-a12e-40e8-a46f-9e7e4072482a tempest-GroupsTest-72358094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:09:29 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-19db0655-a12e-40e8-a46f-9e7e4072482a tempest-GroupsTest-72358094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:09:29 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-19db0655-a12e-40e8-a46f-9e7e4072482a tempest-GroupsTest-72358094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:09:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-19db0655-a12e-40e8-a46f-9e7e4072482a tempest-GroupsTest-72358094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:09:29 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-19db0655-a12e-40e8-a46f-9e7e4072482a tempest-GroupsTest-72358094 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:09:29 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-19db0655-a12e-40e8-a46f-9e7e4072482a tempest-GroupsTest-72358094 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:09:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-19db0655-a12e-40e8-a46f-9e7e4072482a tempest-GroupsTest-72358094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5d1aef1a-e19f-4984-9d2a-4a61919c4b42 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:29 devstack sudo[86978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5d1aef1a-e19f-4984-9d2a-4a61919c4b42 1073741824
Apr 15 20:09:29 devstack sudo[86978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:29 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (440ae917-9fcf-472e-a913-933e585d094d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5f5b686-aaee-407a-b653-8cd90af20a36', 'volume_size': 2, 'source_volid': '587ebe3f-f054-4285-aff1-593a63eac59a', 'source_volstatus': 'available'}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:29 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21be0e88-0bd9-4bbc-a530-aa9ac3bd1f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:29 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] Volume volume-f5f5b686-aaee-407a-b653-8cd90af20a36 (f5f5b686-aaee-407a-b653-8cd90af20a36): created successfully
Apr 15 20:09:29 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21be0e88-0bd9-4bbc-a530-aa9ac3bd1f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:29 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] Flow 'volume_create_manager' (ddd80de9-07c6-4021-bd35-f43cd06bc527) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:09:29 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-2377a795-2cbe-4721-acc1-9dc23d1255b2 tempest-VolumesCloneTest-1413489225 None] Created volume successfully.
Apr 15 20:09:30 devstack sudo[86978]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-19db0655-a12e-40e8-a46f-9e7e4072482a tempest-GroupsTest-72358094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5d1aef1a-e19f-4984-9d2a-4a61919c4b42 1073741824" returned: 0 in 0.526s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-19db0655-a12e-40e8-a46f-9e7e4072482a tempest-GroupsTest-72358094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5d1aef1a-e19f-4984-9d2a-4a61919c4b42 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:30 devstack sudo[86983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5d1aef1a-e19f-4984-9d2a-4a61919c4b42
Apr 15 20:09:30 devstack sudo[86983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:30 devstack sudo[86983]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-19db0655-a12e-40e8-a46f-9e7e4072482a tempest-GroupsTest-72358094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5d1aef1a-e19f-4984-9d2a-4a61919c4b42" returned: 0 in 0.482s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:30 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-19db0655-a12e-40e8-a46f-9e7e4072482a tempest-GroupsTest-72358094 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:09:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-19db0655-a12e-40e8-a46f-9e7e4072482a tempest-GroupsTest-72358094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:09:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-dd18b48b-21cd-4485-a48c-fafcc8226e85 tempest-VolumeQuotasNegativeTestJSON-1880156905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.045s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:09:30 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-dd18b48b-21cd-4485-a48c-fafcc8226e85 tempest-VolumeQuotasNegativeTestJSON-1880156905 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:09:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-69110279',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0616a3ca-137d-44c8-a47a-81993e784001,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a0a5d159be4494db45d800aa68fed2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:09:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:09:23Z,use_quota=True,user_id='7df184cd1d7c41019c45d82de318f75c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:09:30 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-dd18b48b-21cd-4485-a48c-fafcc8226e85 tempest-VolumeQuotasNegativeTestJSON-1880156905 None] Creating volume 0616a3ca-137d-44c8-a47a-81993e784001 {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:09:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-dd18b48b-21cd-4485-a48c-fafcc8226e85 tempest-VolumeQuotasNegativeTestJSON-1880156905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:09:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-dd18b48b-21cd-4485-a48c-fafcc8226e85 tempest-VolumeQuotasNegativeTestJSON-1880156905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:09:30 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-dd18b48b-21cd-4485-a48c-fafcc8226e85 tempest-VolumeQuotasNegativeTestJSON-1880156905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:09:30 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-dd18b48b-21cd-4485-a48c-fafcc8226e85 tempest-VolumeQuotasNegativeTestJSON-1880156905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:09:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-dd18b48b-21cd-4485-a48c-fafcc8226e85 tempest-VolumeQuotasNegativeTestJSON-1880156905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:09:30 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-dd18b48b-21cd-4485-a48c-fafcc8226e85 tempest-VolumeQuotasNegativeTestJSON-1880156905 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:09:30 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-dd18b48b-21cd-4485-a48c-fafcc8226e85 tempest-VolumeQuotasNegativeTestJSON-1880156905 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:09:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-dd18b48b-21cd-4485-a48c-fafcc8226e85 tempest-VolumeQuotasNegativeTestJSON-1880156905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0616a3ca-137d-44c8-a47a-81993e784001 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:30 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-19db0655-a12e-40e8-a46f-9e7e4072482a tempest-GroupsTest-72358094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9d8bd55-baab-45b6-b2dd-519564633d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d1aef1a-e19f-4984-9d2a-4a61919c4b42', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:30 devstack sudo[86986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0616a3ca-137d-44c8-a47a-81993e784001 1073741824
Apr 15 20:09:30 devstack sudo[86986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:30 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-19db0655-a12e-40e8-a46f-9e7e4072482a tempest-GroupsTest-72358094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebcac825-2be9-4c6f-996a-fd8ef71daf54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:30 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-19db0655-a12e-40e8-a46f-9e7e4072482a tempest-GroupsTest-72358094 None] Volume volume-5d1aef1a-e19f-4984-9d2a-4a61919c4b42 (5d1aef1a-e19f-4984-9d2a-4a61919c4b42): created successfully
Apr 15 20:09:30 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-19db0655-a12e-40e8-a46f-9e7e4072482a tempest-GroupsTest-72358094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebcac825-2be9-4c6f-996a-fd8ef71daf54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:30 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-19db0655-a12e-40e8-a46f-9e7e4072482a tempest-GroupsTest-72358094 None] Flow 'volume_create_manager' (107474bd-c44f-41e6-b000-090be66d743d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:09:30 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-19db0655-a12e-40e8-a46f-9e7e4072482a tempest-GroupsTest-72358094 None] Created volume successfully.
Apr 15 20:09:31 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-7e5e2ece-e6e9-497e-9d12-b1d79dcad234 tempest-VolumesCloneTest-1413489225 None] Acquiring lock "cinder-f5f5b686-aaee-407a-b653-8cd90af20a36-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:09:31 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-7e5e2ece-e6e9-497e-9d12-b1d79dcad234 tempest-VolumesCloneTest-1413489225 None] Lock "cinder-f5f5b686-aaee-407a-b653-8cd90af20a36-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:09:31 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-7e5e2ece-e6e9-497e-9d12-b1d79dcad234 tempest-VolumesCloneTest-1413489225 None] Acquiring lock "cinder-quobyte-f5f5b686-aaee-407a-b653-8cd90af20a36" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:09:31 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-7e5e2ece-e6e9-497e-9d12-b1d79dcad234 tempest-VolumesCloneTest-1413489225 None] Lock "cinder-quobyte-f5f5b686-aaee-407a-b653-8cd90af20a36" acquired by "delete_volume" :: waited 0.008s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:09:31 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d13d52e-d29b-4358-9bcc-1eb74bfaf1d1]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:09:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-7e5e2ece-e6e9-497e-9d12-b1d79dcad234 tempest-VolumesCloneTest-1413489225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f5f5b686-aaee-407a-b653-8cd90af20a36 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:31 devstack sudo[86988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f5f5b686-aaee-407a-b653-8cd90af20a36
Apr 15 20:09:31 devstack sudo[86988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:31 devstack sudo[86986]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-dd18b48b-21cd-4485-a48c-fafcc8226e85 tempest-VolumeQuotasNegativeTestJSON-1880156905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0616a3ca-137d-44c8-a47a-81993e784001 1073741824" returned: 0 in 0.630s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-dd18b48b-21cd-4485-a48c-fafcc8226e85 tempest-VolumeQuotasNegativeTestJSON-1880156905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0616a3ca-137d-44c8-a47a-81993e784001 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:31 devstack sudo[86993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0616a3ca-137d-44c8-a47a-81993e784001
Apr 15 20:09:31 devstack sudo[86993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:31 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-f01a8973-12aa-4207-af70-ff4605da1bba tempest-GroupsTest-72358094 None] Acquiring lock "cinder-quobyte-5d1aef1a-e19f-4984-9d2a-4a61919c4b42" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:09:31 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-f01a8973-12aa-4207-af70-ff4605da1bba tempest-GroupsTest-72358094 None] Lock "cinder-quobyte-5d1aef1a-e19f-4984-9d2a-4a61919c4b42" acquired by "delete_volume" :: waited 0.010s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:09:31 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[277eb1df-bb09-46dc-8247-9598ad19ac27]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:09:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-f01a8973-12aa-4207-af70-ff4605da1bba tempest-GroupsTest-72358094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5d1aef1a-e19f-4984-9d2a-4a61919c4b42 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:31 devstack sudo[86998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5d1aef1a-e19f-4984-9d2a-4a61919c4b42
Apr 15 20:09:31 devstack sudo[86998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:31 devstack sudo[86988]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-7e5e2ece-e6e9-497e-9d12-b1d79dcad234 tempest-VolumesCloneTest-1413489225 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f5f5b686-aaee-407a-b653-8cd90af20a36" returned: 0 in 0.591s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-7e5e2ece-e6e9-497e-9d12-b1d79dcad234 tempest-VolumesCloneTest-1413489225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f5f5b686-aaee-407a-b653-8cd90af20a36 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:31 devstack sudo[87000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f5f5b686-aaee-407a-b653-8cd90af20a36
Apr 15 20:09:31 devstack sudo[87000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:32 devstack sudo[86993]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-dd18b48b-21cd-4485-a48c-fafcc8226e85 tempest-VolumeQuotasNegativeTestJSON-1880156905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0616a3ca-137d-44c8-a47a-81993e784001" returned: 0 in 0.578s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:32 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-dd18b48b-21cd-4485-a48c-fafcc8226e85 tempest-VolumeQuotasNegativeTestJSON-1880156905 None] <== create_volume: return (1241ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:09:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-dd18b48b-21cd-4485-a48c-fafcc8226e85 tempest-VolumeQuotasNegativeTestJSON-1880156905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.246s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:09:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-ac958229-20b0-4325-a820-41b3a0af6d71 tempest-VolumesMetadataTest-2137068834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.421s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:09:32 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-ac958229-20b0-4325-a820-41b3a0af6d71 tempest-VolumesMetadataTest-2137068834 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:09:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1156986807',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=667e6a67-c93c-4445-9ed5-d91b26c2f42b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b183129cf574d80ba21b51be623ac11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:09:29Z,use_quota=True,user_id='a18044cf571547269d87cb684a98ab3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:09:32 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-ac958229-20b0-4325-a820-41b3a0af6d71 tempest-VolumesMetadataTest-2137068834 None] Creating volume 667e6a67-c93c-4445-9ed5-d91b26c2f42b {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:09:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-ac958229-20b0-4325-a820-41b3a0af6d71 tempest-VolumesMetadataTest-2137068834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:09:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-ac958229-20b0-4325-a820-41b3a0af6d71 tempest-VolumesMetadataTest-2137068834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:09:32 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-ac958229-20b0-4325-a820-41b3a0af6d71 tempest-VolumesMetadataTest-2137068834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:09:32 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-ac958229-20b0-4325-a820-41b3a0af6d71 tempest-VolumesMetadataTest-2137068834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:09:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-ac958229-20b0-4325-a820-41b3a0af6d71 tempest-VolumesMetadataTest-2137068834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:09:32 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-ac958229-20b0-4325-a820-41b3a0af6d71 tempest-VolumesMetadataTest-2137068834 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:09:32 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-ac958229-20b0-4325-a820-41b3a0af6d71 tempest-VolumesMetadataTest-2137068834 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:09:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-ac958229-20b0-4325-a820-41b3a0af6d71 tempest-VolumesMetadataTest-2137068834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-667e6a67-c93c-4445-9ed5-d91b26c2f42b 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:32 devstack sudo[86998]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:32 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-dd18b48b-21cd-4485-a48c-fafcc8226e85 tempest-VolumeQuotasNegativeTestJSON-1880156905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f105046c-6d20-4f7d-accf-a41c4925c63d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0616a3ca-137d-44c8-a47a-81993e784001', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:32 devstack sudo[87000]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:32 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-dd18b48b-21cd-4485-a48c-fafcc8226e85 tempest-VolumeQuotasNegativeTestJSON-1880156905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f670929-5354-4cb7-a0d9-138815b7b695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-f01a8973-12aa-4207-af70-ff4605da1bba tempest-GroupsTest-72358094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5d1aef1a-e19f-4984-9d2a-4a61919c4b42" returned: 0 in 0.518s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-7e5e2ece-e6e9-497e-9d12-b1d79dcad234 tempest-VolumesCloneTest-1413489225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f5f5b686-aaee-407a-b653-8cd90af20a36" returned: 0 in 0.428s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:32 devstack sudo[87007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-667e6a67-c93c-4445-9ed5-d91b26c2f42b 1073741824
Apr 15 20:09:32 devstack sudo[87007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-f01a8973-12aa-4207-af70-ff4605da1bba tempest-GroupsTest-72358094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5d1aef1a-e19f-4984-9d2a-4a61919c4b42 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:32 devstack sudo[87009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5d1aef1a-e19f-4984-9d2a-4a61919c4b42
Apr 15 20:09:32 devstack sudo[87009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:32 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-7e5e2ece-e6e9-497e-9d12-b1d79dcad234 tempest-VolumesCloneTest-1413489225 None] Lock "cinder-quobyte-f5f5b686-aaee-407a-b653-8cd90af20a36" released by "delete_volume" :: held 1.058s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:09:32 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-dd18b48b-21cd-4485-a48c-fafcc8226e85 tempest-VolumeQuotasNegativeTestJSON-1880156905 None] Volume volume-0616a3ca-137d-44c8-a47a-81993e784001 (0616a3ca-137d-44c8-a47a-81993e784001): created successfully
Apr 15 20:09:32 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-dd18b48b-21cd-4485-a48c-fafcc8226e85 tempest-VolumeQuotasNegativeTestJSON-1880156905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f670929-5354-4cb7-a0d9-138815b7b695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:32 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-dd18b48b-21cd-4485-a48c-fafcc8226e85 tempest-VolumeQuotasNegativeTestJSON-1880156905 None] Flow 'volume_create_manager' (a8e789b7-b0ff-4e55-b915-8e1a09890d90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:09:32 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-dd18b48b-21cd-4485-a48c-fafcc8226e85 tempest-VolumeQuotasNegativeTestJSON-1880156905 None] Created volume successfully.
Apr 15 20:09:32 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-7e5e2ece-e6e9-497e-9d12-b1d79dcad234 tempest-VolumesCloneTest-1413489225 None] Created reservations ['85ce52e6-1968-4765-8f11-ad053a9bad83', 'fed7da3d-7e70-4714-960e-37647351f08c', '91018530-c03c-4aa7-ba4b-cf2554a64410', '68b032d7-514f-4d71-ac41-cb5ca6984d63'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:09:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-7e5e2ece-e6e9-497e-9d12-b1d79dcad234 tempest-VolumesCloneTest-1413489225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:09:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-7e5e2ece-e6e9-497e-9d12-b1d79dcad234 tempest-VolumesCloneTest-1413489225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:09:32 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-7e5e2ece-e6e9-497e-9d12-b1d79dcad234 tempest-VolumesCloneTest-1413489225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:09:32 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-7e5e2ece-e6e9-497e-9d12-b1d79dcad234 tempest-VolumesCloneTest-1413489225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:09:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-7e5e2ece-e6e9-497e-9d12-b1d79dcad234 tempest-VolumesCloneTest-1413489225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:09:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-7e5e2ece-e6e9-497e-9d12-b1d79dcad234 tempest-VolumesCloneTest-1413489225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:32 devstack sudo[87011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:09:32 devstack sudo[87011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:32 devstack sudo[87009]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-f01a8973-12aa-4207-af70-ff4605da1bba tempest-GroupsTest-72358094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5d1aef1a-e19f-4984-9d2a-4a61919c4b42" returned: 0 in 0.503s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:32 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-f01a8973-12aa-4207-af70-ff4605da1bba tempest-GroupsTest-72358094 None] Lock "cinder-quobyte-5d1aef1a-e19f-4984-9d2a-4a61919c4b42" released by "delete_volume" :: held 1.050s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:09:32 devstack sudo[87007]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-ac958229-20b0-4325-a820-41b3a0af6d71 tempest-VolumesMetadataTest-2137068834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-667e6a67-c93c-4445-9ed5-d91b26c2f42b 1073741824" returned: 0 in 0.613s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:32 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-f01a8973-12aa-4207-af70-ff4605da1bba tempest-GroupsTest-72358094 None] Created reservations ['82e005f2-35c0-4da6-92fe-18eba26d97e9'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:09:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-ac958229-20b0-4325-a820-41b3a0af6d71 tempest-VolumesMetadataTest-2137068834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-667e6a67-c93c-4445-9ed5-d91b26c2f42b {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:32 devstack sudo[87018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-667e6a67-c93c-4445-9ed5-d91b26c2f42b
Apr 15 20:09:32 devstack sudo[87018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:32 devstack cinder-volume[82646]: WARNING cinder.quota [None req-f01a8973-12aa-4207-af70-ff4605da1bba tempest-GroupsTest-72358094 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-956409675 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-956409675, it is now deprecated. Please use the default quota class for default quota.
Apr 15 20:09:32 devstack cinder-volume[82646]: WARNING cinder.quota [None req-f01a8973-12aa-4207-af70-ff4605da1bba tempest-GroupsTest-72358094 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-956409675 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-956409675, it is now deprecated. Please use the default quota class for default quota.
Apr 15 20:09:32 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-f01a8973-12aa-4207-af70-ff4605da1bba tempest-GroupsTest-72358094 None] Created reservations ['bd3416b5-80c5-4f6b-b0f4-d696e4948b5b', '1ae3b6f6-b776-4870-bc8c-aca1e4dced9e', '0d44df08-c008-4191-989d-603f7df4a09f', '293a0f05-a080-4b74-ad13-401a87967a38'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:09:32 devstack sudo[87011]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-7e5e2ece-e6e9-497e-9d12-b1d79dcad234 tempest-VolumesCloneTest-1413489225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.556s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:32 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-7e5e2ece-e6e9-497e-9d12-b1d79dcad234 tempest-VolumesCloneTest-1413489225 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:09:32 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-7e5e2ece-e6e9-497e-9d12-b1d79dcad234 tempest-VolumesCloneTest-1413489225 None] Deleted volume successfully.
Apr 15 20:09:32 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-7e5e2ece-e6e9-497e-9d12-b1d79dcad234 tempest-VolumesCloneTest-1413489225 None] Lock "cinder-f5f5b686-aaee-407a-b653-8cd90af20a36-delete_volume" released by "delete_volume" :: held 1.783s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:09:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-f01a8973-12aa-4207-af70-ff4605da1bba tempest-GroupsTest-72358094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:09:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-f01a8973-12aa-4207-af70-ff4605da1bba tempest-GroupsTest-72358094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:09:32 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-f01a8973-12aa-4207-af70-ff4605da1bba tempest-GroupsTest-72358094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:09:32 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-f01a8973-12aa-4207-af70-ff4605da1bba tempest-GroupsTest-72358094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:09:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-f01a8973-12aa-4207-af70-ff4605da1bba tempest-GroupsTest-72358094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:09:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-f01a8973-12aa-4207-af70-ff4605da1bba tempest-GroupsTest-72358094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:32 devstack sudo[87020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:09:32 devstack sudo[87020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:33 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-5e1f5354-d188-4849-b667-44353ef2fff8 tempest-VolumeQuotasNegativeTestJSON-1880156905 None] Acquiring lock "cinder-0616a3ca-137d-44c8-a47a-81993e784001-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:09:33 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-5e1f5354-d188-4849-b667-44353ef2fff8 tempest-VolumeQuotasNegativeTestJSON-1880156905 None] Lock "cinder-0616a3ca-137d-44c8-a47a-81993e784001-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:09:33 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-5e1f5354-d188-4849-b667-44353ef2fff8 tempest-VolumeQuotasNegativeTestJSON-1880156905 None] Acquiring lock "cinder-quobyte-0616a3ca-137d-44c8-a47a-81993e784001" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:09:33 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-5e1f5354-d188-4849-b667-44353ef2fff8 tempest-VolumeQuotasNegativeTestJSON-1880156905 None] Lock "cinder-quobyte-0616a3ca-137d-44c8-a47a-81993e784001" acquired by "delete_volume" :: waited 0.021s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:09:33 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73ba117-a8ef-49b3-ba24-ffc56b47099d]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:09:33 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5e1f5354-d188-4849-b667-44353ef2fff8 tempest-VolumeQuotasNegativeTestJSON-1880156905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0616a3ca-137d-44c8-a47a-81993e784001 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:33 devstack sudo[87028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0616a3ca-137d-44c8-a47a-81993e784001
Apr 15 20:09:33 devstack sudo[87028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:33 devstack sudo[87018]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:33 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-ac958229-20b0-4325-a820-41b3a0af6d71 tempest-VolumesMetadataTest-2137068834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-667e6a67-c93c-4445-9ed5-d91b26c2f42b" returned: 0 in 0.521s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:33 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-ac958229-20b0-4325-a820-41b3a0af6d71 tempest-VolumesMetadataTest-2137068834 None] <== create_volume: return (1162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:09:33 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-ac958229-20b0-4325-a820-41b3a0af6d71 tempest-VolumesMetadataTest-2137068834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:09:33 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ac958229-20b0-4325-a820-41b3a0af6d71 tempest-VolumesMetadataTest-2137068834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (262dc291-6df6-4cf1-9f3a-2b5c8ed0781b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-667e6a67-c93c-4445-9ed5-d91b26c2f42b', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:33 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ac958229-20b0-4325-a820-41b3a0af6d71 tempest-VolumesMetadataTest-2137068834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba7a4f86-9a47-4466-9b18-c3468e91422e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:33 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-54ab636f-abf3-4664-9903-e4e351fc0bef tempest-VolumesCloneTest-1413489225 None] Acquiring lock "cinder-587ebe3f-f054-4285-aff1-593a63eac59a-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:09:33 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-ac958229-20b0-4325-a820-41b3a0af6d71 tempest-VolumesMetadataTest-2137068834 None] Volume volume-667e6a67-c93c-4445-9ed5-d91b26c2f42b (667e6a67-c93c-4445-9ed5-d91b26c2f42b): created successfully
Apr 15 20:09:33 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ac958229-20b0-4325-a820-41b3a0af6d71 tempest-VolumesMetadataTest-2137068834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba7a4f86-9a47-4466-9b18-c3468e91422e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:33 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ac958229-20b0-4325-a820-41b3a0af6d71 tempest-VolumesMetadataTest-2137068834 None] Flow 'volume_create_manager' (0a839d4f-cde6-4eba-b98f-d983d0e917e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:09:33 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-ac958229-20b0-4325-a820-41b3a0af6d71 tempest-VolumesMetadataTest-2137068834 None] Created volume successfully.
Apr 15 20:09:33 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-54ab636f-abf3-4664-9903-e4e351fc0bef tempest-VolumesCloneTest-1413489225 None] Lock "cinder-587ebe3f-f054-4285-aff1-593a63eac59a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:09:33 devstack sudo[87020]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:33 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-f01a8973-12aa-4207-af70-ff4605da1bba tempest-GroupsTest-72358094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.449s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:33 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-f01a8973-12aa-4207-af70-ff4605da1bba tempest-GroupsTest-72358094 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:09:33 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-f01a8973-12aa-4207-af70-ff4605da1bba tempest-GroupsTest-72358094 None] Delete group completed successfully.
Apr 15 20:09:33 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-54ab636f-abf3-4664-9903-e4e351fc0bef tempest-VolumesCloneTest-1413489225 None] Acquiring lock "cinder-quobyte-587ebe3f-f054-4285-aff1-593a63eac59a" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:09:33 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-54ab636f-abf3-4664-9903-e4e351fc0bef tempest-VolumesCloneTest-1413489225 None] Lock "cinder-quobyte-587ebe3f-f054-4285-aff1-593a63eac59a" acquired by "delete_volume" :: waited 0.007s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:09:33 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6571c3-3019-4974-b5cd-2d06755ca8a4]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:09:33 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-54ab636f-abf3-4664-9903-e4e351fc0bef tempest-VolumesCloneTest-1413489225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-587ebe3f-f054-4285-aff1-593a63eac59a {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:33 devstack sudo[87032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-587ebe3f-f054-4285-aff1-593a63eac59a
Apr 15 20:09:33 devstack sudo[87032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:33 devstack sudo[87028]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:33 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5e1f5354-d188-4849-b667-44353ef2fff8 tempest-VolumeQuotasNegativeTestJSON-1880156905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0616a3ca-137d-44c8-a47a-81993e784001" returned: 0 in 0.544s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:33 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5e1f5354-d188-4849-b667-44353ef2fff8 tempest-VolumeQuotasNegativeTestJSON-1880156905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0616a3ca-137d-44c8-a47a-81993e784001 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:33 devstack sudo[87037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0616a3ca-137d-44c8-a47a-81993e784001
Apr 15 20:09:33 devstack sudo[87037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:33 devstack sudo[87032]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:33 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-54ab636f-abf3-4664-9903-e4e351fc0bef tempest-VolumesCloneTest-1413489225 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-587ebe3f-f054-4285-aff1-593a63eac59a" returned: 0 in 0.472s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:33 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-54ab636f-abf3-4664-9903-e4e351fc0bef tempest-VolumesCloneTest-1413489225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-587ebe3f-f054-4285-aff1-593a63eac59a {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:33 devstack sudo[87042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-587ebe3f-f054-4285-aff1-593a63eac59a
Apr 15 20:09:33 devstack sudo[87042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:33 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-1d26ad05-85ed-48df-8317-169c17d50b97 tempest-GroupsTest-72358094 None] Created reservations ['63742acd-a160-4088-b265-4baacecc3bc3'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:09:33 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-1d26ad05-85ed-48df-8317-169c17d50b97 tempest-GroupsTest-72358094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:09:33 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-1d26ad05-85ed-48df-8317-169c17d50b97 tempest-GroupsTest-72358094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:09:33 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-1d26ad05-85ed-48df-8317-169c17d50b97 tempest-GroupsTest-72358094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:09:33 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-1d26ad05-85ed-48df-8317-169c17d50b97 tempest-GroupsTest-72358094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:09:33 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-1d26ad05-85ed-48df-8317-169c17d50b97 tempest-GroupsTest-72358094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:09:33 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-1d26ad05-85ed-48df-8317-169c17d50b97 tempest-GroupsTest-72358094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:34 devstack sudo[87044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:09:34 devstack sudo[87044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:34 devstack sudo[87037]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:34 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5e1f5354-d188-4849-b667-44353ef2fff8 tempest-VolumeQuotasNegativeTestJSON-1880156905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0616a3ca-137d-44c8-a47a-81993e784001" returned: 0 in 0.555s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:34 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-5e1f5354-d188-4849-b667-44353ef2fff8 tempest-VolumeQuotasNegativeTestJSON-1880156905 None] Lock "cinder-quobyte-0616a3ca-137d-44c8-a47a-81993e784001" released by "delete_volume" :: held 1.123s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:09:34 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-5e1f5354-d188-4849-b667-44353ef2fff8 tempest-VolumeQuotasNegativeTestJSON-1880156905 None] Created reservations ['d597258f-465a-494f-b344-924616512182', '75fedc63-cfbe-42fb-8a40-b5036d6aed10', '2590ebab-b1a2-4658-b9d6-c02e9b9ca112', 'a8712920-94a0-4ab7-8991-6aa147302806'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:09:34 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-5e1f5354-d188-4849-b667-44353ef2fff8 tempest-VolumeQuotasNegativeTestJSON-1880156905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:09:34 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-5e1f5354-d188-4849-b667-44353ef2fff8 tempest-VolumeQuotasNegativeTestJSON-1880156905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:09:34 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-5e1f5354-d188-4849-b667-44353ef2fff8 tempest-VolumeQuotasNegativeTestJSON-1880156905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:09:34 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-5e1f5354-d188-4849-b667-44353ef2fff8 tempest-VolumeQuotasNegativeTestJSON-1880156905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:09:34 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-5e1f5354-d188-4849-b667-44353ef2fff8 tempest-VolumeQuotasNegativeTestJSON-1880156905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:09:34 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5e1f5354-d188-4849-b667-44353ef2fff8 tempest-VolumeQuotasNegativeTestJSON-1880156905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:34 devstack sudo[87047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:09:34 devstack sudo[87047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:34 devstack sudo[87042]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:34 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-54ab636f-abf3-4664-9903-e4e351fc0bef tempest-VolumesCloneTest-1413489225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-587ebe3f-f054-4285-aff1-593a63eac59a" returned: 0 in 0.531s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:34 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-54ab636f-abf3-4664-9903-e4e351fc0bef tempest-VolumesCloneTest-1413489225 None] Lock "cinder-quobyte-587ebe3f-f054-4285-aff1-593a63eac59a" released by "delete_volume" :: held 1.034s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:09:34 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-54ab636f-abf3-4664-9903-e4e351fc0bef tempest-VolumesCloneTest-1413489225 None] Created reservations ['61a7a2a5-a31b-48dd-90ab-e7ff6fd32ce8', 'c18ca247-381f-4d94-94b7-aa421b58ed9b', '6451b8ab-ea6a-45c4-86c8-e0c16eead1bd', 'cdf4c977-d304-4862-ae95-aadce1ea3f96'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:09:34 devstack sudo[87044]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:34 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-1d26ad05-85ed-48df-8317-169c17d50b97 tempest-GroupsTest-72358094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.500s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:34 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-1d26ad05-85ed-48df-8317-169c17d50b97 tempest-GroupsTest-72358094 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:09:34 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-1d26ad05-85ed-48df-8317-169c17d50b97 tempest-GroupsTest-72358094 None] Delete group completed successfully.
Apr 15 20:09:34 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-93d17b3a-6114-4940-83c3-c3e2975d76f9 tempest-VolumesMetadataTest-2137068834 None] Acquiring lock "cinder-667e6a67-c93c-4445-9ed5-d91b26c2f42b-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:09:34 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-54ab636f-abf3-4664-9903-e4e351fc0bef tempest-VolumesCloneTest-1413489225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:09:34 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-54ab636f-abf3-4664-9903-e4e351fc0bef tempest-VolumesCloneTest-1413489225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:09:34 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-54ab636f-abf3-4664-9903-e4e351fc0bef tempest-VolumesCloneTest-1413489225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:09:34 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-54ab636f-abf3-4664-9903-e4e351fc0bef tempest-VolumesCloneTest-1413489225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:09:34 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-54ab636f-abf3-4664-9903-e4e351fc0bef tempest-VolumesCloneTest-1413489225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:09:34 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-54ab636f-abf3-4664-9903-e4e351fc0bef tempest-VolumesCloneTest-1413489225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:34 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-93d17b3a-6114-4940-83c3-c3e2975d76f9 tempest-VolumesMetadataTest-2137068834 None] Lock "cinder-667e6a67-c93c-4445-9ed5-d91b26c2f42b-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:09:34 devstack sudo[87051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:09:34 devstack sudo[87051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:34 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-93d17b3a-6114-4940-83c3-c3e2975d76f9 tempest-VolumesMetadataTest-2137068834 None] Acquiring lock "cinder-quobyte-667e6a67-c93c-4445-9ed5-d91b26c2f42b" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:09:34 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-93d17b3a-6114-4940-83c3-c3e2975d76f9 tempest-VolumesMetadataTest-2137068834 None] Lock "cinder-quobyte-667e6a67-c93c-4445-9ed5-d91b26c2f42b" acquired by "delete_volume" :: waited 0.008s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:09:34 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db42fac-d058-4112-a4b7-25363d2afad6]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:09:34 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-93d17b3a-6114-4940-83c3-c3e2975d76f9 tempest-VolumesMetadataTest-2137068834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-667e6a67-c93c-4445-9ed5-d91b26c2f42b {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:34 devstack sudo[87053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-667e6a67-c93c-4445-9ed5-d91b26c2f42b
Apr 15 20:09:34 devstack sudo[87053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:34 devstack sudo[87047]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:34 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5e1f5354-d188-4849-b667-44353ef2fff8 tempest-VolumeQuotasNegativeTestJSON-1880156905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.487s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:34 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-5e1f5354-d188-4849-b667-44353ef2fff8 tempest-VolumeQuotasNegativeTestJSON-1880156905 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:09:34 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-5e1f5354-d188-4849-b667-44353ef2fff8 tempest-VolumeQuotasNegativeTestJSON-1880156905 None] Deleted volume successfully.
Apr 15 20:09:34 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-5e1f5354-d188-4849-b667-44353ef2fff8 tempest-VolumeQuotasNegativeTestJSON-1880156905 None] Lock "cinder-0616a3ca-137d-44c8-a47a-81993e784001-delete_volume" released by "delete_volume" :: held 1.791s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:09:34 devstack sudo[87051]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:34 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-54ab636f-abf3-4664-9903-e4e351fc0bef tempest-VolumesCloneTest-1413489225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.442s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:34 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-54ab636f-abf3-4664-9903-e4e351fc0bef tempest-VolumesCloneTest-1413489225 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:09:35 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-54ab636f-abf3-4664-9903-e4e351fc0bef tempest-VolumesCloneTest-1413489225 None] Deleted volume successfully.
Apr 15 20:09:35 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-54ab636f-abf3-4664-9903-e4e351fc0bef tempest-VolumesCloneTest-1413489225 None] Lock "cinder-587ebe3f-f054-4285-aff1-593a63eac59a-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:09:35 devstack sudo[87053]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:35 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-93d17b3a-6114-4940-83c3-c3e2975d76f9 tempest-VolumesMetadataTest-2137068834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-667e6a67-c93c-4445-9ed5-d91b26c2f42b" returned: 0 in 0.481s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:35 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-93d17b3a-6114-4940-83c3-c3e2975d76f9 tempest-VolumesMetadataTest-2137068834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-667e6a67-c93c-4445-9ed5-d91b26c2f42b {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:35 devstack sudo[87060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-667e6a67-c93c-4445-9ed5-d91b26c2f42b
Apr 15 20:09:35 devstack sudo[87060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:35 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-9b5b6e22-2109-4cfb-94e8-0c189259cda9 tempest-GroupsTest-72358094 None] Group tempest-GroupsTest-Group-1185229884: creating
Apr 15 20:09:35 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-9b5b6e22-2109-4cfb-94e8-0c189259cda9 tempest-GroupsTest-72358094 None] Group tempest-GroupsTest-Group-1185229884: created successfully
Apr 15 20:09:35 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-9b5b6e22-2109-4cfb-94e8-0c189259cda9 tempest-GroupsTest-72358094 None] Create group completed successfully.
Apr 15 20:09:35 devstack sudo[87060]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:35 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-93d17b3a-6114-4940-83c3-c3e2975d76f9 tempest-VolumesMetadataTest-2137068834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-667e6a67-c93c-4445-9ed5-d91b26c2f42b" returned: 0 in 0.467s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:35 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-93d17b3a-6114-4940-83c3-c3e2975d76f9 tempest-VolumesMetadataTest-2137068834 None] Lock "cinder-quobyte-667e6a67-c93c-4445-9ed5-d91b26c2f42b" released by "delete_volume" :: held 0.986s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:09:35 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-93d17b3a-6114-4940-83c3-c3e2975d76f9 tempest-VolumesMetadataTest-2137068834 None] Created reservations ['8ad2900f-9813-47fc-bbc2-4419573463b6', '7630617a-1ed6-46f4-a3c7-6819e73d75c6', 'eeae315e-5587-4342-b506-82d06aad7268', 'f9b34e41-1969-4979-8019-12acfba9f092'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:09:35 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-93d17b3a-6114-4940-83c3-c3e2975d76f9 tempest-VolumesMetadataTest-2137068834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:09:35 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-93d17b3a-6114-4940-83c3-c3e2975d76f9 tempest-VolumesMetadataTest-2137068834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:09:35 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-93d17b3a-6114-4940-83c3-c3e2975d76f9 tempest-VolumesMetadataTest-2137068834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:09:35 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-93d17b3a-6114-4940-83c3-c3e2975d76f9 tempest-VolumesMetadataTest-2137068834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:09:35 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-93d17b3a-6114-4940-83c3-c3e2975d76f9 tempest-VolumesMetadataTest-2137068834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:09:35 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-93d17b3a-6114-4940-83c3-c3e2975d76f9 tempest-VolumesMetadataTest-2137068834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:35 devstack sudo[87063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:09:35 devstack sudo[87063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:36 devstack sudo[87063]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:36 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-93d17b3a-6114-4940-83c3-c3e2975d76f9 tempest-VolumesMetadataTest-2137068834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.519s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:36 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-93d17b3a-6114-4940-83c3-c3e2975d76f9 tempest-VolumesMetadataTest-2137068834 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:09:36 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-93d17b3a-6114-4940-83c3-c3e2975d76f9 tempest-VolumesMetadataTest-2137068834 None] Deleted volume successfully.
Apr 15 20:09:36 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-93d17b3a-6114-4940-83c3-c3e2975d76f9 tempest-VolumesMetadataTest-2137068834 None] Lock "cinder-667e6a67-c93c-4445-9ed5-d91b26c2f42b-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:09:36 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fa0097a-b025-4b74-b98e-e6155653d14c tempest-GroupsTest-72358094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:09:36 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-4fa0097a-b025-4b74-b98e-e6155653d14c tempest-GroupsTest-72358094 None] Flow 'volume_create_manager' (ae72f971-6828-41e7-990d-41aa276ab369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:09:36 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-4fa0097a-b025-4b74-b98e-e6155653d14c tempest-GroupsTest-72358094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25a54a15-7dd4-4c1c-b7ee-323ca179d278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:36 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-4fa0097a-b025-4b74-b98e-e6155653d14c tempest-GroupsTest-72358094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25a54a15-7dd4-4c1c-b7ee-323ca179d278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-568686772',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=4771844b-6a99-4542-b385-84ee0cb0a75a,host='devstack@QuobyteHD#QuobyteHD',id=9ef03303-e3ac-4b60-9066-178c2194ae65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd4d9805cb9f4c4583e417516b54bb95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:09:37Z,use_quota=True,user_id='f4e07c6c0f014b01b8648d72d3be3863',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(09f43d8f-b756-44bd-8b8c-710819861623),volume_type_id=09f43d8f-b756-44bd-8b8c-710819861623)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:36 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-4fa0097a-b025-4b74-b98e-e6155653d14c tempest-GroupsTest-72358094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (042b8bad-b14f-4d3b-b3cd-7d2025554721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:36 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-4fa0097a-b025-4b74-b98e-e6155653d14c tempest-GroupsTest-72358094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (042b8bad-b14f-4d3b-b3cd-7d2025554721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:36 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-4fa0097a-b025-4b74-b98e-e6155653d14c tempest-GroupsTest-72358094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddbcc696-5c5e-4b56-af24-8ed044f537f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:36 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-4fa0097a-b025-4b74-b98e-e6155653d14c tempest-GroupsTest-72358094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddbcc696-5c5e-4b56-af24-8ed044f537f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ef03303-e3ac-4b60-9066-178c2194ae65', 'volume_name': 'volume-9ef03303-e3ac-4b60-9066-178c2194ae65', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:36 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-4fa0097a-b025-4b74-b98e-e6155653d14c tempest-GroupsTest-72358094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eda2da7-da62-4934-982e-9acf13397879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:36 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-4fa0097a-b025-4b74-b98e-e6155653d14c tempest-GroupsTest-72358094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eda2da7-da62-4934-982e-9acf13397879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:36 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-4fa0097a-b025-4b74-b98e-e6155653d14c tempest-GroupsTest-72358094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e14c5ca3-b54f-4b6b-9c41-3ed16e6526d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:36 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-4fa0097a-b025-4b74-b98e-e6155653d14c tempest-GroupsTest-72358094 None] Volume 9ef03303-e3ac-4b60-9066-178c2194ae65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ef03303-e3ac-4b60-9066-178c2194ae65', 'volume_size': 1}
Apr 15 20:09:36 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-4fa0097a-b025-4b74-b98e-e6155653d14c tempest-GroupsTest-72358094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:09:36 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-4fa0097a-b025-4b74-b98e-e6155653d14c tempest-GroupsTest-72358094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:09:36 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-4fa0097a-b025-4b74-b98e-e6155653d14c tempest-GroupsTest-72358094 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=4771844b-6a99-4542-b385-84ee0cb0a75a,created_at=2026-04-15T18:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-568686772',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=4771844b-6a99-4542-b385-84ee0cb0a75a,host='devstack@QuobyteHD#QuobyteHD',id=9ef03303-e3ac-4b60-9066-178c2194ae65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd4d9805cb9f4c4583e417516b54bb95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:09:37Z,use_quota=True,user_id='f4e07c6c0f014b01b8648d72d3be3863',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(09f43d8f-b756-44bd-8b8c-710819861623),volume_type_id=09f43d8f-b756-44bd-8b8c-710819861623)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:09:36 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-4fa0097a-b025-4b74-b98e-e6155653d14c tempest-GroupsTest-72358094 None] Creating volume 9ef03303-e3ac-4b60-9066-178c2194ae65 {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:09:36 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-4fa0097a-b025-4b74-b98e-e6155653d14c tempest-GroupsTest-72358094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:09:36 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-4fa0097a-b025-4b74-b98e-e6155653d14c tempest-GroupsTest-72358094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:09:36 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-4fa0097a-b025-4b74-b98e-e6155653d14c tempest-GroupsTest-72358094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:09:36 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-4fa0097a-b025-4b74-b98e-e6155653d14c tempest-GroupsTest-72358094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:09:36 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-4fa0097a-b025-4b74-b98e-e6155653d14c tempest-GroupsTest-72358094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:09:36 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-4fa0097a-b025-4b74-b98e-e6155653d14c tempest-GroupsTest-72358094 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:09:36 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-4fa0097a-b025-4b74-b98e-e6155653d14c tempest-GroupsTest-72358094 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:09:36 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-4fa0097a-b025-4b74-b98e-e6155653d14c tempest-GroupsTest-72358094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9ef03303-e3ac-4b60-9066-178c2194ae65 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:36 devstack sudo[87067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9ef03303-e3ac-4b60-9066-178c2194ae65 1073741824
Apr 15 20:09:36 devstack sudo[87067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:37 devstack sudo[87067]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:37 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-4fa0097a-b025-4b74-b98e-e6155653d14c tempest-GroupsTest-72358094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9ef03303-e3ac-4b60-9066-178c2194ae65 1073741824" returned: 0 in 0.648s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:37 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-4fa0097a-b025-4b74-b98e-e6155653d14c tempest-GroupsTest-72358094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9ef03303-e3ac-4b60-9066-178c2194ae65 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:37 devstack sudo[87074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9ef03303-e3ac-4b60-9066-178c2194ae65
Apr 15 20:09:37 devstack sudo[87074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:37 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-f16dbc20-169e-4c3a-888b-411ee622aeb3 tempest-VolumesCloneNegativeTest-1807956823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:09:38 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f16dbc20-169e-4c3a-888b-411ee622aeb3 tempest-VolumesCloneNegativeTest-1807956823 None] Flow 'volume_create_manager' (33a0234d-7048-4c67-bcca-e8efcca22513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:09:38 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f16dbc20-169e-4c3a-888b-411ee622aeb3 tempest-VolumesCloneNegativeTest-1807956823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e8936f6-3f7b-4fe9-b20c-045429e1ab9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:38 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f16dbc20-169e-4c3a-888b-411ee622aeb3 tempest-VolumesCloneNegativeTest-1807956823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e8936f6-3f7b-4fe9-b20c-045429e1ab9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:09:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-13978388',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe48f8e3-ccf0-41c8-8714-cda134cb5746,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd2b8f1520a24f5fb01ab6bf5fee9e27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:09:38Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:09:38Z,use_quota=True,user_id='da48ae4412d94848a58d776a935cc3ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:38 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f16dbc20-169e-4c3a-888b-411ee622aeb3 tempest-VolumesCloneNegativeTest-1807956823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d9a2dd2-ca30-4696-b2dc-5d19965a9dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:38 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f16dbc20-169e-4c3a-888b-411ee622aeb3 tempest-VolumesCloneNegativeTest-1807956823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d9a2dd2-ca30-4696-b2dc-5d19965a9dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:38 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f16dbc20-169e-4c3a-888b-411ee622aeb3 tempest-VolumesCloneNegativeTest-1807956823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76d504c2-7b11-4be8-8751-89845b230b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:38 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f16dbc20-169e-4c3a-888b-411ee622aeb3 tempest-VolumesCloneNegativeTest-1807956823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76d504c2-7b11-4be8-8751-89845b230b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe48f8e3-ccf0-41c8-8714-cda134cb5746', 'volume_name': 'volume-fe48f8e3-ccf0-41c8-8714-cda134cb5746', 'volume_size': 2}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:38 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f16dbc20-169e-4c3a-888b-411ee622aeb3 tempest-VolumesCloneNegativeTest-1807956823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0af29c0-81e0-4e43-ac3d-2f174e3ca704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:38 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f16dbc20-169e-4c3a-888b-411ee622aeb3 tempest-VolumesCloneNegativeTest-1807956823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0af29c0-81e0-4e43-ac3d-2f174e3ca704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:38 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f16dbc20-169e-4c3a-888b-411ee622aeb3 tempest-VolumesCloneNegativeTest-1807956823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7d92719-c0b0-4590-b317-6d77087bc2a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:38 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-f16dbc20-169e-4c3a-888b-411ee622aeb3 tempest-VolumesCloneNegativeTest-1807956823 None] Volume fe48f8e3-ccf0-41c8-8714-cda134cb5746: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe48f8e3-ccf0-41c8-8714-cda134cb5746', 'volume_size': 2}
Apr 15 20:09:38 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-f16dbc20-169e-4c3a-888b-411ee622aeb3 tempest-VolumesCloneNegativeTest-1807956823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:09:38 devstack sudo[87074]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:38 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-4fa0097a-b025-4b74-b98e-e6155653d14c tempest-GroupsTest-72358094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9ef03303-e3ac-4b60-9066-178c2194ae65" returned: 0 in 0.467s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:38 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-4fa0097a-b025-4b74-b98e-e6155653d14c tempest-GroupsTest-72358094 None] <== create_volume: return (1178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:09:38 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-4fa0097a-b025-4b74-b98e-e6155653d14c tempest-GroupsTest-72358094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:09:38 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-f16dbc20-169e-4c3a-888b-411ee622aeb3 tempest-VolumesCloneNegativeTest-1807956823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.057s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:09:38 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-f16dbc20-169e-4c3a-888b-411ee622aeb3 tempest-VolumesCloneNegativeTest-1807956823 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:09:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-13978388',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe48f8e3-ccf0-41c8-8714-cda134cb5746,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd2b8f1520a24f5fb01ab6bf5fee9e27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:09:38Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:09:38Z,use_quota=True,user_id='da48ae4412d94848a58d776a935cc3ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:09:38 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-f16dbc20-169e-4c3a-888b-411ee622aeb3 tempest-VolumesCloneNegativeTest-1807956823 None] Creating volume fe48f8e3-ccf0-41c8-8714-cda134cb5746 {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:09:38 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-f16dbc20-169e-4c3a-888b-411ee622aeb3 tempest-VolumesCloneNegativeTest-1807956823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:09:38 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-f16dbc20-169e-4c3a-888b-411ee622aeb3 tempest-VolumesCloneNegativeTest-1807956823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:09:38 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-f16dbc20-169e-4c3a-888b-411ee622aeb3 tempest-VolumesCloneNegativeTest-1807956823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:09:38 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-f16dbc20-169e-4c3a-888b-411ee622aeb3 tempest-VolumesCloneNegativeTest-1807956823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:09:38 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-f16dbc20-169e-4c3a-888b-411ee622aeb3 tempest-VolumesCloneNegativeTest-1807956823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:09:38 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-f16dbc20-169e-4c3a-888b-411ee622aeb3 tempest-VolumesCloneNegativeTest-1807956823 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:09:38 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-f16dbc20-169e-4c3a-888b-411ee622aeb3 tempest-VolumesCloneNegativeTest-1807956823 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:09:38 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-f16dbc20-169e-4c3a-888b-411ee622aeb3 tempest-VolumesCloneNegativeTest-1807956823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-fe48f8e3-ccf0-41c8-8714-cda134cb5746 2147483648 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:38 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-4fa0097a-b025-4b74-b98e-e6155653d14c tempest-GroupsTest-72358094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e14c5ca3-b54f-4b6b-9c41-3ed16e6526d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ef03303-e3ac-4b60-9066-178c2194ae65', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:38 devstack sudo[87077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-fe48f8e3-ccf0-41c8-8714-cda134cb5746 2147483648
Apr 15 20:09:38 devstack sudo[87077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:38 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-4fa0097a-b025-4b74-b98e-e6155653d14c tempest-GroupsTest-72358094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2e8f803-68c0-4ca4-bad3-3077d4b8130f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:38 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-4fa0097a-b025-4b74-b98e-e6155653d14c tempest-GroupsTest-72358094 None] Volume volume-9ef03303-e3ac-4b60-9066-178c2194ae65 (9ef03303-e3ac-4b60-9066-178c2194ae65): created successfully
Apr 15 20:09:38 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-4fa0097a-b025-4b74-b98e-e6155653d14c tempest-GroupsTest-72358094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2e8f803-68c0-4ca4-bad3-3077d4b8130f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:38 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-4fa0097a-b025-4b74-b98e-e6155653d14c tempest-GroupsTest-72358094 None] Flow 'volume_create_manager' (ae72f971-6828-41e7-990d-41aa276ab369) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:09:38 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-4fa0097a-b025-4b74-b98e-e6155653d14c tempest-GroupsTest-72358094 None] Created volume successfully.
Apr 15 20:09:38 devstack sudo[87077]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:38 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-f16dbc20-169e-4c3a-888b-411ee622aeb3 tempest-VolumesCloneNegativeTest-1807956823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-fe48f8e3-ccf0-41c8-8714-cda134cb5746 2147483648" returned: 0 in 0.585s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:38 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-f16dbc20-169e-4c3a-888b-411ee622aeb3 tempest-VolumesCloneNegativeTest-1807956823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-fe48f8e3-ccf0-41c8-8714-cda134cb5746 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:38 devstack sudo[87082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-fe48f8e3-ccf0-41c8-8714-cda134cb5746
Apr 15 20:09:38 devstack sudo[87082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:39 devstack sudo[87082]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:39 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-f16dbc20-169e-4c3a-888b-411ee622aeb3 tempest-VolumesCloneNegativeTest-1807956823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-fe48f8e3-ccf0-41c8-8714-cda134cb5746" returned: 0 in 0.493s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:39 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-f16dbc20-169e-4c3a-888b-411ee622aeb3 tempest-VolumesCloneNegativeTest-1807956823 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:09:39 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-f16dbc20-169e-4c3a-888b-411ee622aeb3 tempest-VolumesCloneNegativeTest-1807956823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:09:39 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f16dbc20-169e-4c3a-888b-411ee622aeb3 tempest-VolumesCloneNegativeTest-1807956823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7d92719-c0b0-4590-b317-6d77087bc2a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe48f8e3-ccf0-41c8-8714-cda134cb5746', 'volume_size': 2}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:39 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f16dbc20-169e-4c3a-888b-411ee622aeb3 tempest-VolumesCloneNegativeTest-1807956823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fffa9550-0d3e-46eb-be9b-5787cb8705f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:39 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-f16dbc20-169e-4c3a-888b-411ee622aeb3 tempest-VolumesCloneNegativeTest-1807956823 None] Volume volume-fe48f8e3-ccf0-41c8-8714-cda134cb5746 (fe48f8e3-ccf0-41c8-8714-cda134cb5746): created successfully
Apr 15 20:09:39 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f16dbc20-169e-4c3a-888b-411ee622aeb3 tempest-VolumesCloneNegativeTest-1807956823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fffa9550-0d3e-46eb-be9b-5787cb8705f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:39 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f16dbc20-169e-4c3a-888b-411ee622aeb3 tempest-VolumesCloneNegativeTest-1807956823 None] Flow 'volume_create_manager' (33a0234d-7048-4c67-bcca-e8efcca22513) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:09:39 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-f16dbc20-169e-4c3a-888b-411ee622aeb3 tempest-VolumesCloneNegativeTest-1807956823 None] Created volume successfully.
Apr 15 20:09:39 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-9445daed-5109-4e70-8bce-98103ba413e8 tempest-GroupsTest-72358094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:09:39 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-9445daed-5109-4e70-8bce-98103ba413e8 tempest-GroupsTest-72358094 None] Flow 'volume_create_manager' (8413d772-4e9f-4295-9102-b2d26c299c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:09:39 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-9445daed-5109-4e70-8bce-98103ba413e8 tempest-GroupsTest-72358094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82ecb311-1579-4975-a6f6-62455a2cd3ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:39 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-9445daed-5109-4e70-8bce-98103ba413e8 tempest-GroupsTest-72358094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82ecb311-1579-4975-a6f6-62455a2cd3ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:09:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-228287539',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=4771844b-6a99-4542-b385-84ee0cb0a75a,host='devstack@QuobyteHD#QuobyteHD',id=ccc8918c-5571-4853-b1e2-d90749901088,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd4d9805cb9f4c4583e417516b54bb95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:09:39Z,use_quota=True,user_id='f4e07c6c0f014b01b8648d72d3be3863',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(09f43d8f-b756-44bd-8b8c-710819861623),volume_type_id=09f43d8f-b756-44bd-8b8c-710819861623)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:39 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-9445daed-5109-4e70-8bce-98103ba413e8 tempest-GroupsTest-72358094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (456d7cef-79d9-475b-a1e9-bdbef93215ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:39 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-9445daed-5109-4e70-8bce-98103ba413e8 tempest-GroupsTest-72358094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (456d7cef-79d9-475b-a1e9-bdbef93215ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:39 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-9445daed-5109-4e70-8bce-98103ba413e8 tempest-GroupsTest-72358094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de85e093-7090-4ad8-8b41-cd6180caea7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:39 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-9445daed-5109-4e70-8bce-98103ba413e8 tempest-GroupsTest-72358094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de85e093-7090-4ad8-8b41-cd6180caea7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccc8918c-5571-4853-b1e2-d90749901088', 'volume_name': 'volume-ccc8918c-5571-4853-b1e2-d90749901088', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:39 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-9445daed-5109-4e70-8bce-98103ba413e8 tempest-GroupsTest-72358094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bf2e3b2-6227-400b-8335-5025353a117c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:39 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-9445daed-5109-4e70-8bce-98103ba413e8 tempest-GroupsTest-72358094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bf2e3b2-6227-400b-8335-5025353a117c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:39 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-9445daed-5109-4e70-8bce-98103ba413e8 tempest-GroupsTest-72358094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffcc25fa-df70-488c-a78f-a177896220d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:39 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-9445daed-5109-4e70-8bce-98103ba413e8 tempest-GroupsTest-72358094 None] Volume ccc8918c-5571-4853-b1e2-d90749901088: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccc8918c-5571-4853-b1e2-d90749901088', 'volume_size': 1}
Apr 15 20:09:39 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-9445daed-5109-4e70-8bce-98103ba413e8 tempest-GroupsTest-72358094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:09:39 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-9445daed-5109-4e70-8bce-98103ba413e8 tempest-GroupsTest-72358094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:09:39 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-9445daed-5109-4e70-8bce-98103ba413e8 tempest-GroupsTest-72358094 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=4771844b-6a99-4542-b385-84ee0cb0a75a,created_at=2026-04-15T18:09:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-228287539',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=4771844b-6a99-4542-b385-84ee0cb0a75a,host='devstack@QuobyteHD#QuobyteHD',id=ccc8918c-5571-4853-b1e2-d90749901088,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd4d9805cb9f4c4583e417516b54bb95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:09:39Z,use_quota=True,user_id='f4e07c6c0f014b01b8648d72d3be3863',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(09f43d8f-b756-44bd-8b8c-710819861623),volume_type_id=09f43d8f-b756-44bd-8b8c-710819861623)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:09:39 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-9445daed-5109-4e70-8bce-98103ba413e8 tempest-GroupsTest-72358094 None] Creating volume ccc8918c-5571-4853-b1e2-d90749901088 {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:09:39 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-9445daed-5109-4e70-8bce-98103ba413e8 tempest-GroupsTest-72358094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:09:39 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-9445daed-5109-4e70-8bce-98103ba413e8 tempest-GroupsTest-72358094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:09:39 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-9445daed-5109-4e70-8bce-98103ba413e8 tempest-GroupsTest-72358094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:09:39 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-9445daed-5109-4e70-8bce-98103ba413e8 tempest-GroupsTest-72358094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:09:39 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-9445daed-5109-4e70-8bce-98103ba413e8 tempest-GroupsTest-72358094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:09:39 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-9445daed-5109-4e70-8bce-98103ba413e8 tempest-GroupsTest-72358094 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:09:39 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-9445daed-5109-4e70-8bce-98103ba413e8 tempest-GroupsTest-72358094 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:09:39 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-9445daed-5109-4e70-8bce-98103ba413e8 tempest-GroupsTest-72358094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-ccc8918c-5571-4853-b1e2-d90749901088 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:39 devstack sudo[87085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-ccc8918c-5571-4853-b1e2-d90749901088 1073741824
Apr 15 20:09:39 devstack sudo[87085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:39 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f9b5902-adff-4116-8c66-bf120ec07ff7 tempest-VolumeRetypeWithoutMigrationTest-421440037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:09:39 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-0f9b5902-adff-4116-8c66-bf120ec07ff7 tempest-VolumeRetypeWithoutMigrationTest-421440037 None] Flow 'volume_create_manager' (f4e06270-8bc0-416d-87ee-f47471bc28c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:09:39 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-0f9b5902-adff-4116-8c66-bf120ec07ff7 tempest-VolumeRetypeWithoutMigrationTest-421440037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0a84ad1-1434-4f7e-b4cc-79926840025b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:39 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-0f9b5902-adff-4116-8c66-bf120ec07ff7 tempest-VolumeRetypeWithoutMigrationTest-421440037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0a84ad1-1434-4f7e-b4cc-79926840025b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:09:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1141878811',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0036e8b3-4238-4750-9481-bf2b8ccccdd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83a949a03f72403b88a9840861f024bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:09:40Z,use_quota=True,user_id='51794a598a9847669e8759f0f9e2a449',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1435f032-edb7-4eb8-bd29-39e51d539c19),volume_type_id=1435f032-edb7-4eb8-bd29-39e51d539c19)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:39 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-0f9b5902-adff-4116-8c66-bf120ec07ff7 tempest-VolumeRetypeWithoutMigrationTest-421440037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e16b0d6-b072-4e2a-b921-10f0cd7e1910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:39 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-0f9b5902-adff-4116-8c66-bf120ec07ff7 tempest-VolumeRetypeWithoutMigrationTest-421440037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e16b0d6-b072-4e2a-b921-10f0cd7e1910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:39 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-0f9b5902-adff-4116-8c66-bf120ec07ff7 tempest-VolumeRetypeWithoutMigrationTest-421440037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44e6936a-d4a8-4ca4-bd77-8f72df89cf2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:39 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-0f9b5902-adff-4116-8c66-bf120ec07ff7 tempest-VolumeRetypeWithoutMigrationTest-421440037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44e6936a-d4a8-4ca4-bd77-8f72df89cf2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0036e8b3-4238-4750-9481-bf2b8ccccdd9', 'volume_name': 'volume-0036e8b3-4238-4750-9481-bf2b8ccccdd9', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:39 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-0f9b5902-adff-4116-8c66-bf120ec07ff7 tempest-VolumeRetypeWithoutMigrationTest-421440037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (311a5369-b87c-4270-934e-b2c0aebafb5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:39 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-0f9b5902-adff-4116-8c66-bf120ec07ff7 tempest-VolumeRetypeWithoutMigrationTest-421440037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (311a5369-b87c-4270-934e-b2c0aebafb5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:39 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-0f9b5902-adff-4116-8c66-bf120ec07ff7 tempest-VolumeRetypeWithoutMigrationTest-421440037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (822cd67f-5ad4-43f7-a8ed-10f07198dd4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:39 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-0f9b5902-adff-4116-8c66-bf120ec07ff7 tempest-VolumeRetypeWithoutMigrationTest-421440037 None] Volume 0036e8b3-4238-4750-9481-bf2b8ccccdd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0036e8b3-4238-4750-9481-bf2b8ccccdd9', 'volume_size': 1}
Apr 15 20:09:39 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-0f9b5902-adff-4116-8c66-bf120ec07ff7 tempest-VolumeRetypeWithoutMigrationTest-421440037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:09:39 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c018e9a-8e12-421c-bf8a-bfdc5484bbdf tempest-VolumesTransfersV355Test-698400945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:09:40 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-3c018e9a-8e12-421c-bf8a-bfdc5484bbdf tempest-VolumesTransfersV355Test-698400945 None] Flow 'volume_create_manager' (cf10031b-7caf-4e9f-8a7f-c70c3914c4a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:09:40 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-3c018e9a-8e12-421c-bf8a-bfdc5484bbdf tempest-VolumesTransfersV355Test-698400945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (086fafc9-84f6-4a92-8b78-5048348ac749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:40 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-3c018e9a-8e12-421c-bf8a-bfdc5484bbdf tempest-VolumesTransfersV355Test-698400945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (086fafc9-84f6-4a92-8b78-5048348ac749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:09:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1597257456',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37725001-cef9-4531-9e27-0ae45108dacd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3fa7ec83322448eb60ff247204fde37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:09:40Z,use_quota=True,user_id='1f304c8377dc49ea9813badd418d31db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:40 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-3c018e9a-8e12-421c-bf8a-bfdc5484bbdf tempest-VolumesTransfersV355Test-698400945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (092ec8be-c689-40c2-b980-4ec2bd871c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:40 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-3c018e9a-8e12-421c-bf8a-bfdc5484bbdf tempest-VolumesTransfersV355Test-698400945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (092ec8be-c689-40c2-b980-4ec2bd871c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:40 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-3c018e9a-8e12-421c-bf8a-bfdc5484bbdf tempest-VolumesTransfersV355Test-698400945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (944be817-5619-4e51-9ff2-58460f4758ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:40 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-3c018e9a-8e12-421c-bf8a-bfdc5484bbdf tempest-VolumesTransfersV355Test-698400945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (944be817-5619-4e51-9ff2-58460f4758ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37725001-cef9-4531-9e27-0ae45108dacd', 'volume_name': 'volume-37725001-cef9-4531-9e27-0ae45108dacd', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:40 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-3c018e9a-8e12-421c-bf8a-bfdc5484bbdf tempest-VolumesTransfersV355Test-698400945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a6c54e3-61ad-4ca6-8405-aa44154f1521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:40 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-3c018e9a-8e12-421c-bf8a-bfdc5484bbdf tempest-VolumesTransfersV355Test-698400945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a6c54e3-61ad-4ca6-8405-aa44154f1521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:40 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-3c018e9a-8e12-421c-bf8a-bfdc5484bbdf tempest-VolumesTransfersV355Test-698400945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (204c2719-5a8c-4829-b184-817e6be4b3cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:40 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-3c018e9a-8e12-421c-bf8a-bfdc5484bbdf tempest-VolumesTransfersV355Test-698400945 None] Volume 37725001-cef9-4531-9e27-0ae45108dacd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37725001-cef9-4531-9e27-0ae45108dacd', 'volume_size': 1}
Apr 15 20:09:40 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-3c018e9a-8e12-421c-bf8a-bfdc5484bbdf tempest-VolumesTransfersV355Test-698400945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:09:40 devstack sudo[87085]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:40 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-9445daed-5109-4e70-8bce-98103ba413e8 tempest-GroupsTest-72358094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-ccc8918c-5571-4853-b1e2-d90749901088 1073741824" returned: 0 in 0.612s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:40 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-9445daed-5109-4e70-8bce-98103ba413e8 tempest-GroupsTest-72358094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-ccc8918c-5571-4853-b1e2-d90749901088 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:40 devstack sudo[87090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-ccc8918c-5571-4853-b1e2-d90749901088
Apr 15 20:09:40 devstack sudo[87090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:40 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-75feb0f1-31a4-4789-aee2-eca3fc1b703d tempest-VolumesCloneNegativeTest-1807956823 None] Acquiring lock "cinder-fe48f8e3-ccf0-41c8-8714-cda134cb5746-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:09:40 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-75feb0f1-31a4-4789-aee2-eca3fc1b703d tempest-VolumesCloneNegativeTest-1807956823 None] Lock "cinder-fe48f8e3-ccf0-41c8-8714-cda134cb5746-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:09:40 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-75feb0f1-31a4-4789-aee2-eca3fc1b703d tempest-VolumesCloneNegativeTest-1807956823 None] Acquiring lock "cinder-quobyte-fe48f8e3-ccf0-41c8-8714-cda134cb5746" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:09:40 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-75feb0f1-31a4-4789-aee2-eca3fc1b703d tempest-VolumesCloneNegativeTest-1807956823 None] Lock "cinder-quobyte-fe48f8e3-ccf0-41c8-8714-cda134cb5746" acquired by "delete_volume" :: waited 0.007s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:09:40 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b39418-b978-42d6-9c7c-ee9c859c4ded]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:09:40 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-75feb0f1-31a4-4789-aee2-eca3fc1b703d tempest-VolumesCloneNegativeTest-1807956823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-fe48f8e3-ccf0-41c8-8714-cda134cb5746 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:40 devstack sudo[87092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-fe48f8e3-ccf0-41c8-8714-cda134cb5746
Apr 15 20:09:40 devstack sudo[87092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:40 devstack sudo[87090]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:40 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-9445daed-5109-4e70-8bce-98103ba413e8 tempest-GroupsTest-72358094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-ccc8918c-5571-4853-b1e2-d90749901088" returned: 0 in 0.453s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:40 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-9445daed-5109-4e70-8bce-98103ba413e8 tempest-GroupsTest-72358094 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:09:40 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-9445daed-5109-4e70-8bce-98103ba413e8 tempest-GroupsTest-72358094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:09:40 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-0f9b5902-adff-4116-8c66-bf120ec07ff7 tempest-VolumeRetypeWithoutMigrationTest-421440037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.917s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:09:40 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-0f9b5902-adff-4116-8c66-bf120ec07ff7 tempest-VolumeRetypeWithoutMigrationTest-421440037 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:09:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1141878811',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0036e8b3-4238-4750-9481-bf2b8ccccdd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83a949a03f72403b88a9840861f024bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:09:40Z,use_quota=True,user_id='51794a598a9847669e8759f0f9e2a449',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1435f032-edb7-4eb8-bd29-39e51d539c19),volume_type_id=1435f032-edb7-4eb8-bd29-39e51d539c19)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:09:40 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-0f9b5902-adff-4116-8c66-bf120ec07ff7 tempest-VolumeRetypeWithoutMigrationTest-421440037 None] Creating volume 0036e8b3-4238-4750-9481-bf2b8ccccdd9 {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:09:40 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-0f9b5902-adff-4116-8c66-bf120ec07ff7 tempest-VolumeRetypeWithoutMigrationTest-421440037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:09:40 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-0f9b5902-adff-4116-8c66-bf120ec07ff7 tempest-VolumeRetypeWithoutMigrationTest-421440037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:09:40 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-0f9b5902-adff-4116-8c66-bf120ec07ff7 tempest-VolumeRetypeWithoutMigrationTest-421440037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:09:40 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-0f9b5902-adff-4116-8c66-bf120ec07ff7 tempest-VolumeRetypeWithoutMigrationTest-421440037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:09:40 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-0f9b5902-adff-4116-8c66-bf120ec07ff7 tempest-VolumeRetypeWithoutMigrationTest-421440037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:09:40 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-0f9b5902-adff-4116-8c66-bf120ec07ff7 tempest-VolumeRetypeWithoutMigrationTest-421440037 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:09:40 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-0f9b5902-adff-4116-8c66-bf120ec07ff7 tempest-VolumeRetypeWithoutMigrationTest-421440037 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:09:40 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-0f9b5902-adff-4116-8c66-bf120ec07ff7 tempest-VolumeRetypeWithoutMigrationTest-421440037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0036e8b3-4238-4750-9481-bf2b8ccccdd9 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:40 devstack sudo[87095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0036e8b3-4238-4750-9481-bf2b8ccccdd9 1073741824
Apr 15 20:09:40 devstack sudo[87095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:40 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-9445daed-5109-4e70-8bce-98103ba413e8 tempest-GroupsTest-72358094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffcc25fa-df70-488c-a78f-a177896220d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccc8918c-5571-4853-b1e2-d90749901088', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:40 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-9445daed-5109-4e70-8bce-98103ba413e8 tempest-GroupsTest-72358094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b588011-08c6-4289-9ff2-612d28114d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:40 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-9445daed-5109-4e70-8bce-98103ba413e8 tempest-GroupsTest-72358094 None] Volume volume-ccc8918c-5571-4853-b1e2-d90749901088 (ccc8918c-5571-4853-b1e2-d90749901088): created successfully
Apr 15 20:09:40 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-9445daed-5109-4e70-8bce-98103ba413e8 tempest-GroupsTest-72358094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b588011-08c6-4289-9ff2-612d28114d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:40 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-9445daed-5109-4e70-8bce-98103ba413e8 tempest-GroupsTest-72358094 None] Flow 'volume_create_manager' (8413d772-4e9f-4295-9102-b2d26c299c15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:09:40 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-9445daed-5109-4e70-8bce-98103ba413e8 tempest-GroupsTest-72358094 None] Created volume successfully.
Apr 15 20:09:40 devstack sudo[87092]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:40 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-75feb0f1-31a4-4789-aee2-eca3fc1b703d tempest-VolumesCloneNegativeTest-1807956823 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-fe48f8e3-ccf0-41c8-8714-cda134cb5746" returned: 0 in 0.527s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:40 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-75feb0f1-31a4-4789-aee2-eca3fc1b703d tempest-VolumesCloneNegativeTest-1807956823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-fe48f8e3-ccf0-41c8-8714-cda134cb5746 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:40 devstack sudo[87100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-fe48f8e3-ccf0-41c8-8714-cda134cb5746
Apr 15 20:09:40 devstack sudo[87100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:41 devstack sudo[87095]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:41 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-0f9b5902-adff-4116-8c66-bf120ec07ff7 tempest-VolumeRetypeWithoutMigrationTest-421440037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0036e8b3-4238-4750-9481-bf2b8ccccdd9 1073741824" returned: 0 in 0.523s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:41 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-0f9b5902-adff-4116-8c66-bf120ec07ff7 tempest-VolumeRetypeWithoutMigrationTest-421440037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0036e8b3-4238-4750-9481-bf2b8ccccdd9 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:41 devstack sudo[87105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0036e8b3-4238-4750-9481-bf2b8ccccdd9
Apr 15 20:09:41 devstack sudo[87105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:41 devstack sudo[87100]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:41 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-75feb0f1-31a4-4789-aee2-eca3fc1b703d tempest-VolumesCloneNegativeTest-1807956823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-fe48f8e3-ccf0-41c8-8714-cda134cb5746" returned: 0 in 0.456s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:41 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-75feb0f1-31a4-4789-aee2-eca3fc1b703d tempest-VolumesCloneNegativeTest-1807956823 None] Lock "cinder-quobyte-fe48f8e3-ccf0-41c8-8714-cda134cb5746" released by "delete_volume" :: held 1.004s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:09:41 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-75feb0f1-31a4-4789-aee2-eca3fc1b703d tempest-VolumesCloneNegativeTest-1807956823 None] Created reservations ['f8d5efd4-5169-48f8-9eb2-d792f08df8e6', '8264d134-f7be-4394-9694-b08701fa266a', '297aa57f-46b6-4e37-82a2-fb2f7992cb61', 'b9a111ce-5b52-476b-b48b-6f9db4bf293e'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:09:41 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-75feb0f1-31a4-4789-aee2-eca3fc1b703d tempest-VolumesCloneNegativeTest-1807956823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:09:41 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-75feb0f1-31a4-4789-aee2-eca3fc1b703d tempest-VolumesCloneNegativeTest-1807956823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:09:41 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-75feb0f1-31a4-4789-aee2-eca3fc1b703d tempest-VolumesCloneNegativeTest-1807956823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:09:41 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-75feb0f1-31a4-4789-aee2-eca3fc1b703d tempest-VolumesCloneNegativeTest-1807956823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:09:41 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-75feb0f1-31a4-4789-aee2-eca3fc1b703d tempest-VolumesCloneNegativeTest-1807956823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:09:41 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-75feb0f1-31a4-4789-aee2-eca3fc1b703d tempest-VolumesCloneNegativeTest-1807956823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:41 devstack sudo[87108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:09:41 devstack sudo[87108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:41 devstack sudo[87105]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:41 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-0f9b5902-adff-4116-8c66-bf120ec07ff7 tempest-VolumeRetypeWithoutMigrationTest-421440037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0036e8b3-4238-4750-9481-bf2b8ccccdd9" returned: 0 in 0.444s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:41 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-0f9b5902-adff-4116-8c66-bf120ec07ff7 tempest-VolumeRetypeWithoutMigrationTest-421440037 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:09:41 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-0f9b5902-adff-4116-8c66-bf120ec07ff7 tempest-VolumeRetypeWithoutMigrationTest-421440037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:09:41 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-3c018e9a-8e12-421c-bf8a-bfdc5484bbdf tempest-VolumesTransfersV355Test-698400945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.520s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:09:41 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-3c018e9a-8e12-421c-bf8a-bfdc5484bbdf tempest-VolumesTransfersV355Test-698400945 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:09:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1597257456',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37725001-cef9-4531-9e27-0ae45108dacd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3fa7ec83322448eb60ff247204fde37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:09:40Z,use_quota=True,user_id='1f304c8377dc49ea9813badd418d31db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:09:41 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-3c018e9a-8e12-421c-bf8a-bfdc5484bbdf tempest-VolumesTransfersV355Test-698400945 None] Creating volume 37725001-cef9-4531-9e27-0ae45108dacd {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:09:41 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-3c018e9a-8e12-421c-bf8a-bfdc5484bbdf tempest-VolumesTransfersV355Test-698400945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:09:41 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-3c018e9a-8e12-421c-bf8a-bfdc5484bbdf tempest-VolumesTransfersV355Test-698400945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:09:41 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-3c018e9a-8e12-421c-bf8a-bfdc5484bbdf tempest-VolumesTransfersV355Test-698400945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:09:41 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-3c018e9a-8e12-421c-bf8a-bfdc5484bbdf tempest-VolumesTransfersV355Test-698400945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:09:41 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-3c018e9a-8e12-421c-bf8a-bfdc5484bbdf tempest-VolumesTransfersV355Test-698400945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:09:41 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-3c018e9a-8e12-421c-bf8a-bfdc5484bbdf tempest-VolumesTransfersV355Test-698400945 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:09:41 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-3c018e9a-8e12-421c-bf8a-bfdc5484bbdf tempest-VolumesTransfersV355Test-698400945 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:09:41 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-3c018e9a-8e12-421c-bf8a-bfdc5484bbdf tempest-VolumesTransfersV355Test-698400945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-37725001-cef9-4531-9e27-0ae45108dacd 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:41 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-0f9b5902-adff-4116-8c66-bf120ec07ff7 tempest-VolumeRetypeWithoutMigrationTest-421440037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (822cd67f-5ad4-43f7-a8ed-10f07198dd4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0036e8b3-4238-4750-9481-bf2b8ccccdd9', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:41 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-0f9b5902-adff-4116-8c66-bf120ec07ff7 tempest-VolumeRetypeWithoutMigrationTest-421440037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e657e676-d2b0-4cfc-9efc-88ba92c90454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:41 devstack sudo[87111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-37725001-cef9-4531-9e27-0ae45108dacd 1073741824
Apr 15 20:09:41 devstack sudo[87111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:41 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-0f9b5902-adff-4116-8c66-bf120ec07ff7 tempest-VolumeRetypeWithoutMigrationTest-421440037 None] Volume volume-0036e8b3-4238-4750-9481-bf2b8ccccdd9 (0036e8b3-4238-4750-9481-bf2b8ccccdd9): created successfully
Apr 15 20:09:41 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-0f9b5902-adff-4116-8c66-bf120ec07ff7 tempest-VolumeRetypeWithoutMigrationTest-421440037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e657e676-d2b0-4cfc-9efc-88ba92c90454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:41 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-0f9b5902-adff-4116-8c66-bf120ec07ff7 tempest-VolumeRetypeWithoutMigrationTest-421440037 None] Flow 'volume_create_manager' (f4e06270-8bc0-416d-87ee-f47471bc28c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:09:41 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-e6d1a608-5370-47f2-8356-2fd982c7859f tempest-GroupsTest-72358094 None] Update group completed successfully.
Apr 15 20:09:41 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-0f9b5902-adff-4116-8c66-bf120ec07ff7 tempest-VolumeRetypeWithoutMigrationTest-421440037 None] Created volume successfully.
Apr 15 20:09:41 devstack sudo[87108]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:41 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-75feb0f1-31a4-4789-aee2-eca3fc1b703d tempest-VolumesCloneNegativeTest-1807956823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.447s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:41 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-75feb0f1-31a4-4789-aee2-eca3fc1b703d tempest-VolumesCloneNegativeTest-1807956823 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:09:41 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-75feb0f1-31a4-4789-aee2-eca3fc1b703d tempest-VolumesCloneNegativeTest-1807956823 None] Deleted volume successfully.
Apr 15 20:09:41 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-75feb0f1-31a4-4789-aee2-eca3fc1b703d tempest-VolumesCloneNegativeTest-1807956823 None] Lock "cinder-fe48f8e3-ccf0-41c8-8714-cda134cb5746-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:09:42 devstack sudo[87111]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:42 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-3c018e9a-8e12-421c-bf8a-bfdc5484bbdf tempest-VolumesTransfersV355Test-698400945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-37725001-cef9-4531-9e27-0ae45108dacd 1073741824" returned: 0 in 0.508s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:42 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-3c018e9a-8e12-421c-bf8a-bfdc5484bbdf tempest-VolumesTransfersV355Test-698400945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-37725001-cef9-4531-9e27-0ae45108dacd {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:42 devstack sudo[87117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-37725001-cef9-4531-9e27-0ae45108dacd
Apr 15 20:09:42 devstack sudo[87117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:42 devstack sudo[87117]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:42 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-3c018e9a-8e12-421c-bf8a-bfdc5484bbdf tempest-VolumesTransfersV355Test-698400945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-37725001-cef9-4531-9e27-0ae45108dacd" returned: 0 in 0.476s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:42 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-3c018e9a-8e12-421c-bf8a-bfdc5484bbdf tempest-VolumesTransfersV355Test-698400945 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:09:42 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-3c018e9a-8e12-421c-bf8a-bfdc5484bbdf tempest-VolumesTransfersV355Test-698400945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:09:42 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-3c018e9a-8e12-421c-bf8a-bfdc5484bbdf tempest-VolumesTransfersV355Test-698400945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (204c2719-5a8c-4829-b184-817e6be4b3cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37725001-cef9-4531-9e27-0ae45108dacd', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:42 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-3c018e9a-8e12-421c-bf8a-bfdc5484bbdf tempest-VolumesTransfersV355Test-698400945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d3e0371-08e2-4d83-a68c-6251a5e81571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:42 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-3c018e9a-8e12-421c-bf8a-bfdc5484bbdf tempest-VolumesTransfersV355Test-698400945 None] Volume volume-37725001-cef9-4531-9e27-0ae45108dacd (37725001-cef9-4531-9e27-0ae45108dacd): created successfully
Apr 15 20:09:42 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-3c018e9a-8e12-421c-bf8a-bfdc5484bbdf tempest-VolumesTransfersV355Test-698400945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d3e0371-08e2-4d83-a68c-6251a5e81571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:42 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-3c018e9a-8e12-421c-bf8a-bfdc5484bbdf tempest-VolumesTransfersV355Test-698400945 None] Flow 'volume_create_manager' (cf10031b-7caf-4e9f-8a7f-c70c3914c4a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:09:42 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-3c018e9a-8e12-421c-bf8a-bfdc5484bbdf tempest-VolumesTransfersV355Test-698400945 None] Created volume successfully.
Apr 15 20:09:42 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-cf9dabcb-819d-44bd-a55d-2d53f0a4ebf5 tempest-GroupsTest-72358094 None] Update group completed successfully.
Apr 15 20:09:43 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-713f397f-14ec-4766-a2c1-f71e6c5d5c41 tempest-VolumeRetypeWithoutMigrationTest-421440037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:09:43 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-713f397f-14ec-4766-a2c1-f71e6c5d5c41 tempest-VolumeRetypeWithoutMigrationTest-421440037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:09:43 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-713f397f-14ec-4766-a2c1-f71e6c5d5c41 tempest-VolumeRetypeWithoutMigrationTest-421440037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:09:43 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-713f397f-14ec-4766-a2c1-f71e6c5d5c41 tempest-VolumeRetypeWithoutMigrationTest-421440037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:09:43 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-713f397f-14ec-4766-a2c1-f71e6c5d5c41 tempest-VolumeRetypeWithoutMigrationTest-421440037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:09:43 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-713f397f-14ec-4766-a2c1-f71e6c5d5c41 tempest-VolumeRetypeWithoutMigrationTest-421440037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:43 devstack sudo[87152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:09:43 devstack sudo[87152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:43 devstack sudo[87152]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:43 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-713f397f-14ec-4766-a2c1-f71e6c5d5c41 tempest-VolumeRetypeWithoutMigrationTest-421440037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.547s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:43 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-713f397f-14ec-4766-a2c1-f71e6c5d5c41 tempest-VolumeRetypeWithoutMigrationTest-421440037 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:09:43 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-713f397f-14ec-4766-a2c1-f71e6c5d5c41 tempest-VolumeRetypeWithoutMigrationTest-421440037 None] Retype volume completed successfully.
Apr 15 20:09:43 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-c5cd340b-9a70-43cd-813a-527777605b90 tempest-VolumesTransfersV355Test-1150199084 None] Transfer volume completed successfully.
Apr 15 20:09:44 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-63021b39-dedf-4aef-8e1f-c40cd813ec7d tempest-VolumesListTestJSON-498473273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:09:44 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-63021b39-dedf-4aef-8e1f-c40cd813ec7d tempest-VolumesListTestJSON-498473273 None] Flow 'volume_create_manager' (b4ae02a4-a0c0-485e-89ec-2ba94f178ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:09:44 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-63021b39-dedf-4aef-8e1f-c40cd813ec7d tempest-VolumesListTestJSON-498473273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ded8475d-8f8f-452a-8567-b1a97f59d907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:44 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-63021b39-dedf-4aef-8e1f-c40cd813ec7d tempest-VolumesListTestJSON-498473273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ded8475d-8f8f-452a-8567-b1a97f59d907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-710791786',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa3fb278-ff3c-4f77-9fe1-31d805ad5967,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dfb9c0c9b94147b7918a875606239d1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:09:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:09:44Z,use_quota=True,user_id='c90854b575624c1e8c93228931b94d5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:44 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-63021b39-dedf-4aef-8e1f-c40cd813ec7d tempest-VolumesListTestJSON-498473273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fdcaeec-9f9f-455f-81d6-50a41e538bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:44 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-63021b39-dedf-4aef-8e1f-c40cd813ec7d tempest-VolumesListTestJSON-498473273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fdcaeec-9f9f-455f-81d6-50a41e538bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:44 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-63021b39-dedf-4aef-8e1f-c40cd813ec7d tempest-VolumesListTestJSON-498473273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (187824bb-30bf-4c07-ac94-a7c33407fad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:44 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-63021b39-dedf-4aef-8e1f-c40cd813ec7d tempest-VolumesListTestJSON-498473273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (187824bb-30bf-4c07-ac94-a7c33407fad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa3fb278-ff3c-4f77-9fe1-31d805ad5967', 'volume_name': 'volume-fa3fb278-ff3c-4f77-9fe1-31d805ad5967', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:44 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-63021b39-dedf-4aef-8e1f-c40cd813ec7d tempest-VolumesListTestJSON-498473273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3664565b-6034-43eb-bd26-2c0febb37bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:44 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-63021b39-dedf-4aef-8e1f-c40cd813ec7d tempest-VolumesListTestJSON-498473273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3664565b-6034-43eb-bd26-2c0febb37bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:44 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-63021b39-dedf-4aef-8e1f-c40cd813ec7d tempest-VolumesListTestJSON-498473273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (342ceca1-b4cf-4241-b915-63c86de823c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:44 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-63021b39-dedf-4aef-8e1f-c40cd813ec7d tempest-VolumesListTestJSON-498473273 None] Volume fa3fb278-ff3c-4f77-9fe1-31d805ad5967: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa3fb278-ff3c-4f77-9fe1-31d805ad5967', 'volume_size': 1}
Apr 15 20:09:44 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-63021b39-dedf-4aef-8e1f-c40cd813ec7d tempest-VolumesListTestJSON-498473273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:09:44 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-63021b39-dedf-4aef-8e1f-c40cd813ec7d tempest-VolumesListTestJSON-498473273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:09:44 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-63021b39-dedf-4aef-8e1f-c40cd813ec7d tempest-VolumesListTestJSON-498473273 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-710791786',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa3fb278-ff3c-4f77-9fe1-31d805ad5967,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dfb9c0c9b94147b7918a875606239d1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:09:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:09:44Z,use_quota=True,user_id='c90854b575624c1e8c93228931b94d5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:09:44 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-63021b39-dedf-4aef-8e1f-c40cd813ec7d tempest-VolumesListTestJSON-498473273 None] Creating volume fa3fb278-ff3c-4f77-9fe1-31d805ad5967 {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:09:44 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-63021b39-dedf-4aef-8e1f-c40cd813ec7d tempest-VolumesListTestJSON-498473273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:09:44 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-63021b39-dedf-4aef-8e1f-c40cd813ec7d tempest-VolumesListTestJSON-498473273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:09:44 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-63021b39-dedf-4aef-8e1f-c40cd813ec7d tempest-VolumesListTestJSON-498473273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:09:44 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-63021b39-dedf-4aef-8e1f-c40cd813ec7d tempest-VolumesListTestJSON-498473273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:09:44 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-63021b39-dedf-4aef-8e1f-c40cd813ec7d tempest-VolumesListTestJSON-498473273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:09:44 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-63021b39-dedf-4aef-8e1f-c40cd813ec7d tempest-VolumesListTestJSON-498473273 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:09:44 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-63021b39-dedf-4aef-8e1f-c40cd813ec7d tempest-VolumesListTestJSON-498473273 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:09:44 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-63021b39-dedf-4aef-8e1f-c40cd813ec7d tempest-VolumesListTestJSON-498473273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-fa3fb278-ff3c-4f77-9fe1-31d805ad5967 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:44 devstack sudo[87158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-fa3fb278-ff3c-4f77-9fe1-31d805ad5967 1073741824
Apr 15 20:09:44 devstack sudo[87158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:44 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-545e7e21-1ca3-4791-b8fa-2683c8b49875 tempest-GroupsTest-72358094 None] Acquiring lock "cinder-quobyte-9ef03303-e3ac-4b60-9066-178c2194ae65" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:09:44 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-545e7e21-1ca3-4791-b8fa-2683c8b49875 tempest-GroupsTest-72358094 None] Lock "cinder-quobyte-9ef03303-e3ac-4b60-9066-178c2194ae65" acquired by "delete_volume" :: waited 0.014s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:09:44 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[990ade30-34b4-487b-a100-940cb1b20285]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:09:44 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-545e7e21-1ca3-4791-b8fa-2683c8b49875 tempest-GroupsTest-72358094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9ef03303-e3ac-4b60-9066-178c2194ae65 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:44 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-7bfbd4b3-1396-41b5-b626-1438bee62c96 tempest-VolumesTransfersV355Test-1752719892 None] Acquiring lock "cinder-37725001-cef9-4531-9e27-0ae45108dacd-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:09:44 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-7bfbd4b3-1396-41b5-b626-1438bee62c96 tempest-VolumesTransfersV355Test-1752719892 None] Lock "cinder-37725001-cef9-4531-9e27-0ae45108dacd-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:09:44 devstack sudo[87160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9ef03303-e3ac-4b60-9066-178c2194ae65
Apr 15 20:09:44 devstack sudo[87160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:44 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-7bfbd4b3-1396-41b5-b626-1438bee62c96 tempest-VolumesTransfersV355Test-1752719892 None] Acquiring lock "cinder-quobyte-37725001-cef9-4531-9e27-0ae45108dacd" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:09:44 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-a4327696-0396-47f2-99fb-d8f911ec0ee4 tempest-VolumeRetypeWithoutMigrationTest-421440037 None] Acquiring lock "cinder-0036e8b3-4238-4750-9481-bf2b8ccccdd9-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:09:44 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-7bfbd4b3-1396-41b5-b626-1438bee62c96 tempest-VolumesTransfersV355Test-1752719892 None] Lock "cinder-quobyte-37725001-cef9-4531-9e27-0ae45108dacd" acquired by "delete_volume" :: waited 0.016s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:09:44 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-a4327696-0396-47f2-99fb-d8f911ec0ee4 tempest-VolumeRetypeWithoutMigrationTest-421440037 None] Lock "cinder-0036e8b3-4238-4750-9481-bf2b8ccccdd9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:09:44 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba56e060-2339-4f99-858e-c3f99166542a]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:09:44 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-7bfbd4b3-1396-41b5-b626-1438bee62c96 tempest-VolumesTransfersV355Test-1752719892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-37725001-cef9-4531-9e27-0ae45108dacd {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:44 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-a4327696-0396-47f2-99fb-d8f911ec0ee4 tempest-VolumeRetypeWithoutMigrationTest-421440037 None] Acquiring lock "cinder-quobyte-0036e8b3-4238-4750-9481-bf2b8ccccdd9" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:09:44 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-a4327696-0396-47f2-99fb-d8f911ec0ee4 tempest-VolumeRetypeWithoutMigrationTest-421440037 None] Lock "cinder-quobyte-0036e8b3-4238-4750-9481-bf2b8ccccdd9" acquired by "delete_volume" :: waited 0.011s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:09:44 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[56bceb29-8110-46f3-8847-6607c329c86f]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:09:44 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-a4327696-0396-47f2-99fb-d8f911ec0ee4 tempest-VolumeRetypeWithoutMigrationTest-421440037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0036e8b3-4238-4750-9481-bf2b8ccccdd9 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:44 devstack sudo[87158]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:44 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-63021b39-dedf-4aef-8e1f-c40cd813ec7d tempest-VolumesListTestJSON-498473273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-fa3fb278-ff3c-4f77-9fe1-31d805ad5967 1073741824" returned: 0 in 0.614s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:44 devstack sudo[87165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-37725001-cef9-4531-9e27-0ae45108dacd
Apr 15 20:09:44 devstack sudo[87165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:44 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-63021b39-dedf-4aef-8e1f-c40cd813ec7d tempest-VolumesListTestJSON-498473273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-fa3fb278-ff3c-4f77-9fe1-31d805ad5967 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:44 devstack sudo[87168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-fa3fb278-ff3c-4f77-9fe1-31d805ad5967
Apr 15 20:09:44 devstack sudo[87168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:45 devstack sudo[87166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0036e8b3-4238-4750-9481-bf2b8ccccdd9
Apr 15 20:09:45 devstack sudo[87166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:45 devstack sudo[87160]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:45 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-545e7e21-1ca3-4791-b8fa-2683c8b49875 tempest-GroupsTest-72358094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9ef03303-e3ac-4b60-9066-178c2194ae65" returned: 0 in 0.570s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:45 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-545e7e21-1ca3-4791-b8fa-2683c8b49875 tempest-GroupsTest-72358094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9ef03303-e3ac-4b60-9066-178c2194ae65 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:45 devstack sudo[87174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9ef03303-e3ac-4b60-9066-178c2194ae65
Apr 15 20:09:45 devstack sudo[87174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:45 devstack sudo[87165]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:45 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-7bfbd4b3-1396-41b5-b626-1438bee62c96 tempest-VolumesTransfersV355Test-1752719892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-37725001-cef9-4531-9e27-0ae45108dacd" returned: 0 in 0.508s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:45 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-7bfbd4b3-1396-41b5-b626-1438bee62c96 tempest-VolumesTransfersV355Test-1752719892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-37725001-cef9-4531-9e27-0ae45108dacd {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:45 devstack sudo[87181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-37725001-cef9-4531-9e27-0ae45108dacd
Apr 15 20:09:45 devstack sudo[87181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:45 devstack sudo[87168]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:45 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-63021b39-dedf-4aef-8e1f-c40cd813ec7d tempest-VolumesListTestJSON-498473273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-fa3fb278-ff3c-4f77-9fe1-31d805ad5967" returned: 0 in 0.488s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:45 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-63021b39-dedf-4aef-8e1f-c40cd813ec7d tempest-VolumesListTestJSON-498473273 None] <== create_volume: return (1130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:09:45 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-63021b39-dedf-4aef-8e1f-c40cd813ec7d tempest-VolumesListTestJSON-498473273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:09:45 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-63021b39-dedf-4aef-8e1f-c40cd813ec7d tempest-VolumesListTestJSON-498473273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (342ceca1-b4cf-4241-b915-63c86de823c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa3fb278-ff3c-4f77-9fe1-31d805ad5967', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:45 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-63021b39-dedf-4aef-8e1f-c40cd813ec7d tempest-VolumesListTestJSON-498473273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0328ce83-99fc-4ad3-ba79-c1cb5f88c8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:45 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-63021b39-dedf-4aef-8e1f-c40cd813ec7d tempest-VolumesListTestJSON-498473273 None] Volume volume-fa3fb278-ff3c-4f77-9fe1-31d805ad5967 (fa3fb278-ff3c-4f77-9fe1-31d805ad5967): created successfully
Apr 15 20:09:45 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-63021b39-dedf-4aef-8e1f-c40cd813ec7d tempest-VolumesListTestJSON-498473273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0328ce83-99fc-4ad3-ba79-c1cb5f88c8f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:45 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-63021b39-dedf-4aef-8e1f-c40cd813ec7d tempest-VolumesListTestJSON-498473273 None] Flow 'volume_create_manager' (b4ae02a4-a0c0-485e-89ec-2ba94f178ba4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:09:45 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-63021b39-dedf-4aef-8e1f-c40cd813ec7d tempest-VolumesListTestJSON-498473273 None] Created volume successfully.
Apr 15 20:09:45 devstack sudo[87166]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:45 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-a4327696-0396-47f2-99fb-d8f911ec0ee4 tempest-VolumeRetypeWithoutMigrationTest-421440037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0036e8b3-4238-4750-9481-bf2b8ccccdd9" returned: 0 in 0.616s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:45 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-a4327696-0396-47f2-99fb-d8f911ec0ee4 tempest-VolumeRetypeWithoutMigrationTest-421440037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0036e8b3-4238-4750-9481-bf2b8ccccdd9 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:45 devstack sudo[87185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0036e8b3-4238-4750-9481-bf2b8ccccdd9
Apr 15 20:09:45 devstack sudo[87185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:45 devstack sudo[87174]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:45 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-545e7e21-1ca3-4791-b8fa-2683c8b49875 tempest-GroupsTest-72358094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9ef03303-e3ac-4b60-9066-178c2194ae65" returned: 0 in 0.455s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:45 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-545e7e21-1ca3-4791-b8fa-2683c8b49875 tempest-GroupsTest-72358094 None] Lock "cinder-quobyte-9ef03303-e3ac-4b60-9066-178c2194ae65" released by "delete_volume" :: held 1.058s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:09:45 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-545e7e21-1ca3-4791-b8fa-2683c8b49875 tempest-GroupsTest-72358094 None] Acquiring lock "cinder-quobyte-ccc8918c-5571-4853-b1e2-d90749901088" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:09:45 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-545e7e21-1ca3-4791-b8fa-2683c8b49875 tempest-GroupsTest-72358094 None] Lock "cinder-quobyte-ccc8918c-5571-4853-b1e2-d90749901088" acquired by "delete_volume" :: waited 0.006s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:09:45 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a725d2-6f06-48db-9bcd-965bd623c52b]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:09:45 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-545e7e21-1ca3-4791-b8fa-2683c8b49875 tempest-GroupsTest-72358094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-ccc8918c-5571-4853-b1e2-d90749901088 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:45 devstack sudo[87188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-ccc8918c-5571-4853-b1e2-d90749901088
Apr 15 20:09:45 devstack sudo[87188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:45 devstack sudo[87181]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:45 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-7bfbd4b3-1396-41b5-b626-1438bee62c96 tempest-VolumesTransfersV355Test-1752719892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-37725001-cef9-4531-9e27-0ae45108dacd" returned: 0 in 0.526s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:45 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-7bfbd4b3-1396-41b5-b626-1438bee62c96 tempest-VolumesTransfersV355Test-1752719892 None] Lock "cinder-quobyte-37725001-cef9-4531-9e27-0ae45108dacd" released by "delete_volume" :: held 1.073s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:09:45 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-7bfbd4b3-1396-41b5-b626-1438bee62c96 tempest-VolumesTransfersV355Test-1752719892 None] Created reservations ['f88c1e52-d32b-4bd9-ba6a-18b7fe82beaf', '92bfc676-62ea-4061-95ae-0cef5bc597b9', 'e3c87d29-8451-4b7d-ba67-cc487957e407', 'f1dc0277-87d1-4f7f-9ab9-ae0f0ddb867c'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:09:45 devstack sudo[87185]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-a4327696-0396-47f2-99fb-d8f911ec0ee4 tempest-VolumeRetypeWithoutMigrationTest-421440037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0036e8b3-4238-4750-9481-bf2b8ccccdd9" returned: 0 in 0.479s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:46 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-a4327696-0396-47f2-99fb-d8f911ec0ee4 tempest-VolumeRetypeWithoutMigrationTest-421440037 None] Lock "cinder-quobyte-0036e8b3-4238-4750-9481-bf2b8ccccdd9" released by "delete_volume" :: held 1.119s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:09:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-7bfbd4b3-1396-41b5-b626-1438bee62c96 tempest-VolumesTransfersV355Test-1752719892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:09:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-7bfbd4b3-1396-41b5-b626-1438bee62c96 tempest-VolumesTransfersV355Test-1752719892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:09:46 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-7bfbd4b3-1396-41b5-b626-1438bee62c96 tempest-VolumesTransfersV355Test-1752719892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:09:46 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-7bfbd4b3-1396-41b5-b626-1438bee62c96 tempest-VolumesTransfersV355Test-1752719892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:09:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-7bfbd4b3-1396-41b5-b626-1438bee62c96 tempest-VolumesTransfersV355Test-1752719892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:09:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-7bfbd4b3-1396-41b5-b626-1438bee62c96 tempest-VolumesTransfersV355Test-1752719892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:46 devstack sudo[87193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:09:46 devstack sudo[87193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:46 devstack cinder-volume[82646]: WARNING cinder.quota [None req-a4327696-0396-47f2-99fb-d8f911ec0ee4 tempest-VolumeRetypeWithoutMigrationTest-421440037 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 15 20:09:46 devstack cinder-volume[82646]: WARNING cinder.quota [None req-a4327696-0396-47f2-99fb-d8f911ec0ee4 tempest-VolumeRetypeWithoutMigrationTest-421440037 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 15 20:09:46 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-a4327696-0396-47f2-99fb-d8f911ec0ee4 tempest-VolumeRetypeWithoutMigrationTest-421440037 None] Created reservations ['016df881-7c8c-480a-a7bd-6693b319ce14', '35f54881-73ee-4506-9254-04f009a43ebb', '1455b48a-bdfb-44d6-ae45-477b08ae2341', 'bae35de7-b3db-43bb-bb9a-2e747b6f822f'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:09:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-a4327696-0396-47f2-99fb-d8f911ec0ee4 tempest-VolumeRetypeWithoutMigrationTest-421440037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:09:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-a4327696-0396-47f2-99fb-d8f911ec0ee4 tempest-VolumeRetypeWithoutMigrationTest-421440037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:09:46 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-a4327696-0396-47f2-99fb-d8f911ec0ee4 tempest-VolumeRetypeWithoutMigrationTest-421440037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:09:46 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-a4327696-0396-47f2-99fb-d8f911ec0ee4 tempest-VolumeRetypeWithoutMigrationTest-421440037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:09:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-a4327696-0396-47f2-99fb-d8f911ec0ee4 tempest-VolumeRetypeWithoutMigrationTest-421440037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:09:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-a4327696-0396-47f2-99fb-d8f911ec0ee4 tempest-VolumeRetypeWithoutMigrationTest-421440037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:46 devstack sudo[87195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:09:46 devstack sudo[87195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:46 devstack sudo[87188]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-545e7e21-1ca3-4791-b8fa-2683c8b49875 tempest-GroupsTest-72358094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-ccc8918c-5571-4853-b1e2-d90749901088" returned: 0 in 0.551s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-545e7e21-1ca3-4791-b8fa-2683c8b49875 tempest-GroupsTest-72358094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-ccc8918c-5571-4853-b1e2-d90749901088 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:46 devstack sudo[87200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-ccc8918c-5571-4853-b1e2-d90749901088
Apr 15 20:09:46 devstack sudo[87200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:46 devstack sudo[87193]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-7bfbd4b3-1396-41b5-b626-1438bee62c96 tempest-VolumesTransfersV355Test-1752719892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.419s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:46 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-7bfbd4b3-1396-41b5-b626-1438bee62c96 tempest-VolumesTransfersV355Test-1752719892 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:09:46 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-7bfbd4b3-1396-41b5-b626-1438bee62c96 tempest-VolumesTransfersV355Test-1752719892 None] Deleted volume successfully.
Apr 15 20:09:46 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-7bfbd4b3-1396-41b5-b626-1438bee62c96 tempest-VolumesTransfersV355Test-1752719892 None] Lock "cinder-37725001-cef9-4531-9e27-0ae45108dacd-delete_volume" released by "delete_volume" :: held 1.711s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:09:46 devstack sudo[87195]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-a4327696-0396-47f2-99fb-d8f911ec0ee4 tempest-VolumeRetypeWithoutMigrationTest-421440037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.436s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:46 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-a4327696-0396-47f2-99fb-d8f911ec0ee4 tempest-VolumeRetypeWithoutMigrationTest-421440037 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:09:46 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-a4327696-0396-47f2-99fb-d8f911ec0ee4 tempest-VolumeRetypeWithoutMigrationTest-421440037 None] Deleted volume successfully.
Apr 15 20:09:46 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-a4327696-0396-47f2-99fb-d8f911ec0ee4 tempest-VolumeRetypeWithoutMigrationTest-421440037 None] Lock "cinder-0036e8b3-4238-4750-9481-bf2b8ccccdd9-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:09:46 devstack sudo[87200]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-545e7e21-1ca3-4791-b8fa-2683c8b49875 tempest-GroupsTest-72358094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-ccc8918c-5571-4853-b1e2-d90749901088" returned: 0 in 0.445s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:46 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-545e7e21-1ca3-4791-b8fa-2683c8b49875 tempest-GroupsTest-72358094 None] Lock "cinder-quobyte-ccc8918c-5571-4853-b1e2-d90749901088" released by "delete_volume" :: held 1.019s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:09:46 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-545e7e21-1ca3-4791-b8fa-2683c8b49875 tempest-GroupsTest-72358094 None] Created reservations ['26d4fbfc-a3f7-4be3-9857-c8e7dcf83b04'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:09:46 devstack cinder-volume[82646]: WARNING cinder.quota [None req-545e7e21-1ca3-4791-b8fa-2683c8b49875 tempest-GroupsTest-72358094 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-56235191 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-56235191, it is now deprecated. Please use the default quota class for default quota.
Apr 15 20:09:46 devstack cinder-volume[82646]: WARNING cinder.quota [None req-545e7e21-1ca3-4791-b8fa-2683c8b49875 tempest-GroupsTest-72358094 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-56235191 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-56235191, it is now deprecated. Please use the default quota class for default quota.
Apr 15 20:09:46 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-545e7e21-1ca3-4791-b8fa-2683c8b49875 tempest-GroupsTest-72358094 None] Created reservations ['8039c0dc-b112-45de-8300-cc5fd1eb9bb7', '1c145d6b-1c58-47dc-8759-9969deb9510a', 'ee516612-8651-4e98-ba6e-7318acea343e', 'e5ab1da0-e625-4f15-9652-c2aaf165b5f3'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:09:46 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a18b776-d30a-423a-ae44-84fe052a1185 tempest-VolumesListTestJSON-498473273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:09:46 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-4a18b776-d30a-423a-ae44-84fe052a1185 tempest-VolumesListTestJSON-498473273 None] Flow 'volume_create_manager' (a0f964ec-1b95-4dd8-9a58-6e635929fe47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:09:46 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-4a18b776-d30a-423a-ae44-84fe052a1185 tempest-VolumesListTestJSON-498473273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a358a0d-99aa-456e-beff-f8b9a282e0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:46 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-4a18b776-d30a-423a-ae44-84fe052a1185 tempest-VolumesListTestJSON-498473273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a358a0d-99aa-456e-beff-f8b9a282e0ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:09:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1617203618',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e723f9c9-f606-4b32-8768-5729101c4a3e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dfb9c0c9b94147b7918a875606239d1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:09:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:09:47Z,use_quota=True,user_id='c90854b575624c1e8c93228931b94d5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:46 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-4a18b776-d30a-423a-ae44-84fe052a1185 tempest-VolumesListTestJSON-498473273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08ef2105-7899-4dad-a712-435e1c731c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:46 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-4a18b776-d30a-423a-ae44-84fe052a1185 tempest-VolumesListTestJSON-498473273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08ef2105-7899-4dad-a712-435e1c731c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:46 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-4a18b776-d30a-423a-ae44-84fe052a1185 tempest-VolumesListTestJSON-498473273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e02cb991-0dfe-4281-9e72-0008a9887420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:46 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-4a18b776-d30a-423a-ae44-84fe052a1185 tempest-VolumesListTestJSON-498473273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e02cb991-0dfe-4281-9e72-0008a9887420) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e723f9c9-f606-4b32-8768-5729101c4a3e', 'volume_name': 'volume-e723f9c9-f606-4b32-8768-5729101c4a3e', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:46 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-4a18b776-d30a-423a-ae44-84fe052a1185 tempest-VolumesListTestJSON-498473273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ca96452-b3fe-4d97-81f8-d16b269bfa01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:46 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-4a18b776-d30a-423a-ae44-84fe052a1185 tempest-VolumesListTestJSON-498473273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ca96452-b3fe-4d97-81f8-d16b269bfa01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:46 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-4a18b776-d30a-423a-ae44-84fe052a1185 tempest-VolumesListTestJSON-498473273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (234b46b1-5ef1-45fb-8621-7a157ad96e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:46 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-4a18b776-d30a-423a-ae44-84fe052a1185 tempest-VolumesListTestJSON-498473273 None] Volume e723f9c9-f606-4b32-8768-5729101c4a3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e723f9c9-f606-4b32-8768-5729101c4a3e', 'volume_size': 1}
Apr 15 20:09:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-4a18b776-d30a-423a-ae44-84fe052a1185 tempest-VolumesListTestJSON-498473273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:09:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-4a18b776-d30a-423a-ae44-84fe052a1185 tempest-VolumesListTestJSON-498473273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:09:46 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-4a18b776-d30a-423a-ae44-84fe052a1185 tempest-VolumesListTestJSON-498473273 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:09:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1617203618',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e723f9c9-f606-4b32-8768-5729101c4a3e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dfb9c0c9b94147b7918a875606239d1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:09:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:09:47Z,use_quota=True,user_id='c90854b575624c1e8c93228931b94d5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:09:46 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-4a18b776-d30a-423a-ae44-84fe052a1185 tempest-VolumesListTestJSON-498473273 None] Creating volume e723f9c9-f606-4b32-8768-5729101c4a3e {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:09:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-4a18b776-d30a-423a-ae44-84fe052a1185 tempest-VolumesListTestJSON-498473273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:09:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-4a18b776-d30a-423a-ae44-84fe052a1185 tempest-VolumesListTestJSON-498473273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:09:46 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-4a18b776-d30a-423a-ae44-84fe052a1185 tempest-VolumesListTestJSON-498473273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:09:46 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-4a18b776-d30a-423a-ae44-84fe052a1185 tempest-VolumesListTestJSON-498473273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:09:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-4a18b776-d30a-423a-ae44-84fe052a1185 tempest-VolumesListTestJSON-498473273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:09:46 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-4a18b776-d30a-423a-ae44-84fe052a1185 tempest-VolumesListTestJSON-498473273 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:09:46 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-4a18b776-d30a-423a-ae44-84fe052a1185 tempest-VolumesListTestJSON-498473273 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:09:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-4a18b776-d30a-423a-ae44-84fe052a1185 tempest-VolumesListTestJSON-498473273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e723f9c9-f606-4b32-8768-5729101c4a3e 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:46 devstack sudo[87205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e723f9c9-f606-4b32-8768-5729101c4a3e 1073741824
Apr 15 20:09:46 devstack sudo[87205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:46 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-545e7e21-1ca3-4791-b8fa-2683c8b49875 tempest-GroupsTest-72358094 None] Created reservations ['d43ef9ed-7fb5-4715-86a3-50613f2dbbc2', '630eddf5-0809-4987-8ae7-dd59beee7903', 'c0432e2b-3fd0-4dff-b251-a8d87555a245', '5b843b8b-d305-4a38-a6eb-3acd47c73c9f'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:09:47 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-545e7e21-1ca3-4791-b8fa-2683c8b49875 tempest-GroupsTest-72358094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:09:47 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-545e7e21-1ca3-4791-b8fa-2683c8b49875 tempest-GroupsTest-72358094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:09:47 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-545e7e21-1ca3-4791-b8fa-2683c8b49875 tempest-GroupsTest-72358094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:09:47 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-545e7e21-1ca3-4791-b8fa-2683c8b49875 tempest-GroupsTest-72358094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:09:47 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-545e7e21-1ca3-4791-b8fa-2683c8b49875 tempest-GroupsTest-72358094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:09:47 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-545e7e21-1ca3-4791-b8fa-2683c8b49875 tempest-GroupsTest-72358094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:47 devstack sudo[87207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:09:47 devstack sudo[87207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:47 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-86cb7380-591e-4ec0-9542-43443a69b831 tempest-VolumesTransfersV355Test-698400945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:09:47 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-86cb7380-591e-4ec0-9542-43443a69b831 tempest-VolumesTransfersV355Test-698400945 None] Flow 'volume_create_manager' (297a8a50-3e73-402f-a096-557f0df8d33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:09:47 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-86cb7380-591e-4ec0-9542-43443a69b831 tempest-VolumesTransfersV355Test-698400945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6c51736-6a96-4c13-b54a-f40609fe14a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:47 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-86cb7380-591e-4ec0-9542-43443a69b831 tempest-VolumesTransfersV355Test-698400945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6c51736-6a96-4c13-b54a-f40609fe14a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:09:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1388230222',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b4eb247-7ab2-4005-a20b-e1f579219b48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3fa7ec83322448eb60ff247204fde37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:09:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:09:47Z,use_quota=True,user_id='1f304c8377dc49ea9813badd418d31db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:47 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-86cb7380-591e-4ec0-9542-43443a69b831 tempest-VolumesTransfersV355Test-698400945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da9d71fc-8fc3-497e-a1a9-9f527e6e5688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:47 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-86cb7380-591e-4ec0-9542-43443a69b831 tempest-VolumesTransfersV355Test-698400945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da9d71fc-8fc3-497e-a1a9-9f527e6e5688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:47 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-86cb7380-591e-4ec0-9542-43443a69b831 tempest-VolumesTransfersV355Test-698400945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f9655fa-c4f3-430d-9df9-11ca1718f172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:47 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-86cb7380-591e-4ec0-9542-43443a69b831 tempest-VolumesTransfersV355Test-698400945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f9655fa-c4f3-430d-9df9-11ca1718f172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b4eb247-7ab2-4005-a20b-e1f579219b48', 'volume_name': 'volume-3b4eb247-7ab2-4005-a20b-e1f579219b48', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:47 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-86cb7380-591e-4ec0-9542-43443a69b831 tempest-VolumesTransfersV355Test-698400945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cfa8ab0-60f7-4092-9999-71c7ab301541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:47 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-86cb7380-591e-4ec0-9542-43443a69b831 tempest-VolumesTransfersV355Test-698400945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cfa8ab0-60f7-4092-9999-71c7ab301541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:47 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-86cb7380-591e-4ec0-9542-43443a69b831 tempest-VolumesTransfersV355Test-698400945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea9fdb56-a5a3-48e4-a6d9-6675c2ed92b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:47 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-86cb7380-591e-4ec0-9542-43443a69b831 tempest-VolumesTransfersV355Test-698400945 None] Volume 3b4eb247-7ab2-4005-a20b-e1f579219b48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b4eb247-7ab2-4005-a20b-e1f579219b48', 'volume_size': 1}
Apr 15 20:09:47 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-86cb7380-591e-4ec0-9542-43443a69b831 tempest-VolumesTransfersV355Test-698400945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:09:47 devstack sudo[87205]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:47 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-4a18b776-d30a-423a-ae44-84fe052a1185 tempest-VolumesListTestJSON-498473273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e723f9c9-f606-4b32-8768-5729101c4a3e 1073741824" returned: 0 in 0.578s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:47 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-4a18b776-d30a-423a-ae44-84fe052a1185 tempest-VolumesListTestJSON-498473273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e723f9c9-f606-4b32-8768-5729101c4a3e {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:47 devstack sudo[87213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e723f9c9-f606-4b32-8768-5729101c4a3e
Apr 15 20:09:47 devstack sudo[87213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:47 devstack sudo[87207]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:47 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-545e7e21-1ca3-4791-b8fa-2683c8b49875 tempest-GroupsTest-72358094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.489s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:47 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-545e7e21-1ca3-4791-b8fa-2683c8b49875 tempest-GroupsTest-72358094 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:09:47 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-545e7e21-1ca3-4791-b8fa-2683c8b49875 tempest-GroupsTest-72358094 None] Delete group completed successfully.
Apr 15 20:09:48 devstack sudo[87213]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-4a18b776-d30a-423a-ae44-84fe052a1185 tempest-VolumesListTestJSON-498473273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e723f9c9-f606-4b32-8768-5729101c4a3e" returned: 0 in 0.513s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:48 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-4a18b776-d30a-423a-ae44-84fe052a1185 tempest-VolumesListTestJSON-498473273 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:09:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-4a18b776-d30a-423a-ae44-84fe052a1185 tempest-VolumesListTestJSON-498473273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:09:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-86cb7380-591e-4ec0-9542-43443a69b831 tempest-VolumesTransfersV355Test-698400945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.566s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:09:48 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-86cb7380-591e-4ec0-9542-43443a69b831 tempest-VolumesTransfersV355Test-698400945 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:09:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1388230222',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b4eb247-7ab2-4005-a20b-e1f579219b48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3fa7ec83322448eb60ff247204fde37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:09:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:09:47Z,use_quota=True,user_id='1f304c8377dc49ea9813badd418d31db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:09:48 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-86cb7380-591e-4ec0-9542-43443a69b831 tempest-VolumesTransfersV355Test-698400945 None] Creating volume 3b4eb247-7ab2-4005-a20b-e1f579219b48 {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:09:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-86cb7380-591e-4ec0-9542-43443a69b831 tempest-VolumesTransfersV355Test-698400945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:09:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-86cb7380-591e-4ec0-9542-43443a69b831 tempest-VolumesTransfersV355Test-698400945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:09:48 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-86cb7380-591e-4ec0-9542-43443a69b831 tempest-VolumesTransfersV355Test-698400945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:09:48 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-86cb7380-591e-4ec0-9542-43443a69b831 tempest-VolumesTransfersV355Test-698400945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:09:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-86cb7380-591e-4ec0-9542-43443a69b831 tempest-VolumesTransfersV355Test-698400945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:09:48 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-86cb7380-591e-4ec0-9542-43443a69b831 tempest-VolumesTransfersV355Test-698400945 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:09:48 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-86cb7380-591e-4ec0-9542-43443a69b831 tempest-VolumesTransfersV355Test-698400945 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:09:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-86cb7380-591e-4ec0-9542-43443a69b831 tempest-VolumesTransfersV355Test-698400945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3b4eb247-7ab2-4005-a20b-e1f579219b48 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-4a18b776-d30a-423a-ae44-84fe052a1185 tempest-VolumesListTestJSON-498473273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (234b46b1-5ef1-45fb-8621-7a157ad96e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e723f9c9-f606-4b32-8768-5729101c4a3e', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:48 devstack sudo[87217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3b4eb247-7ab2-4005-a20b-e1f579219b48 1073741824
Apr 15 20:09:48 devstack sudo[87217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-4a18b776-d30a-423a-ae44-84fe052a1185 tempest-VolumesListTestJSON-498473273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f573a82d-4ddb-447e-8cef-cdbc3ec96a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:48 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-4a18b776-d30a-423a-ae44-84fe052a1185 tempest-VolumesListTestJSON-498473273 None] Volume volume-e723f9c9-f606-4b32-8768-5729101c4a3e (e723f9c9-f606-4b32-8768-5729101c4a3e): created successfully
Apr 15 20:09:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-4a18b776-d30a-423a-ae44-84fe052a1185 tempest-VolumesListTestJSON-498473273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f573a82d-4ddb-447e-8cef-cdbc3ec96a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-4a18b776-d30a-423a-ae44-84fe052a1185 tempest-VolumesListTestJSON-498473273 None] Flow 'volume_create_manager' (a0f964ec-1b95-4dd8-9a58-6e635929fe47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:09:48 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-4a18b776-d30a-423a-ae44-84fe052a1185 tempest-VolumesListTestJSON-498473273 None] Created volume successfully.
Apr 15 20:09:48 devstack sudo[87217]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-86cb7380-591e-4ec0-9542-43443a69b831 tempest-VolumesTransfersV355Test-698400945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3b4eb247-7ab2-4005-a20b-e1f579219b48 1073741824" returned: 0 in 0.613s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-86cb7380-591e-4ec0-9542-43443a69b831 tempest-VolumesTransfersV355Test-698400945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3b4eb247-7ab2-4005-a20b-e1f579219b48 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:48 devstack sudo[87222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3b4eb247-7ab2-4005-a20b-e1f579219b48
Apr 15 20:09:48 devstack sudo[87222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:48 devstack cinder-volume[82646]: DEBUG oslo_service.periodic_task [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 15 20:09:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:09:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:09:48 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:09:48 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:09:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:09:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:48 devstack sudo[87224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:09:48 devstack sudo[87224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:49 devstack sudo[87222]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:49 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-86cb7380-591e-4ec0-9542-43443a69b831 tempest-VolumesTransfersV355Test-698400945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3b4eb247-7ab2-4005-a20b-e1f579219b48" returned: 0 in 0.525s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:49 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-86cb7380-591e-4ec0-9542-43443a69b831 tempest-VolumesTransfersV355Test-698400945 None] <== create_volume: return (1175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:09:49 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-86cb7380-591e-4ec0-9542-43443a69b831 tempest-VolumesTransfersV355Test-698400945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.179s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:09:49 devstack cinder-volume[82646]: DEBUG dbcounter [-] [82646] Writing DB stats cinder:UPDATE=208,cinder:SELECT=189,cinder:INSERT=61,cinder:DELETE=16 {{(pid=82646) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 20:09:49 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-86cb7380-591e-4ec0-9542-43443a69b831 tempest-VolumesTransfersV355Test-698400945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea9fdb56-a5a3-48e4-a6d9-6675c2ed92b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b4eb247-7ab2-4005-a20b-e1f579219b48', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:49 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-86cb7380-591e-4ec0-9542-43443a69b831 tempest-VolumesTransfersV355Test-698400945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (508a1dea-c063-46d3-92ad-36c0c5cb1a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:49 devstack cinder-volume[82646]: DEBUG dbcounter [-] [82646] Writing DB stats cinder:SELECT=170,cinder:UPDATE=231,cinder:INSERT=37,cinder:DELETE=13 {{(pid=82646) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 20:09:49 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-86cb7380-591e-4ec0-9542-43443a69b831 tempest-VolumesTransfersV355Test-698400945 None] Volume volume-3b4eb247-7ab2-4005-a20b-e1f579219b48 (3b4eb247-7ab2-4005-a20b-e1f579219b48): created successfully
Apr 15 20:09:49 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-86cb7380-591e-4ec0-9542-43443a69b831 tempest-VolumesTransfersV355Test-698400945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (508a1dea-c063-46d3-92ad-36c0c5cb1a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:49 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-86cb7380-591e-4ec0-9542-43443a69b831 tempest-VolumesTransfersV355Test-698400945 None] Flow 'volume_create_manager' (297a8a50-3e73-402f-a096-557f0df8d33d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:09:49 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-86cb7380-591e-4ec0-9542-43443a69b831 tempest-VolumesTransfersV355Test-698400945 None] Created volume successfully.
Apr 15 20:09:49 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f08e002-b58e-441e-ad72-5e40581f27d6 tempest-VolumesListTestJSON-498473273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:09:49 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-2f08e002-b58e-441e-ad72-5e40581f27d6 tempest-VolumesListTestJSON-498473273 None] Flow 'volume_create_manager' (6a7592a0-97f2-405b-b244-eb1736a3175a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:09:49 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-2f08e002-b58e-441e-ad72-5e40581f27d6 tempest-VolumesListTestJSON-498473273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0d65af5-56b8-45f9-b16f-429d4eef1647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:49 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-2f08e002-b58e-441e-ad72-5e40581f27d6 tempest-VolumesListTestJSON-498473273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0d65af5-56b8-45f9-b16f-429d4eef1647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:09:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1049369126',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04877ef8-08bf-4e0d-9a6d-48c16dd0aac8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dfb9c0c9b94147b7918a875606239d1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:09:49Z,use_quota=True,user_id='c90854b575624c1e8c93228931b94d5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:49 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-2f08e002-b58e-441e-ad72-5e40581f27d6 tempest-VolumesListTestJSON-498473273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6e68fd5-3186-497c-a0b9-a4e3a55c4be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:49 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-2f08e002-b58e-441e-ad72-5e40581f27d6 tempest-VolumesListTestJSON-498473273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6e68fd5-3186-497c-a0b9-a4e3a55c4be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:49 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-2f08e002-b58e-441e-ad72-5e40581f27d6 tempest-VolumesListTestJSON-498473273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08a43a3c-15e5-463b-bd05-3f6257696b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:49 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-2f08e002-b58e-441e-ad72-5e40581f27d6 tempest-VolumesListTestJSON-498473273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08a43a3c-15e5-463b-bd05-3f6257696b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04877ef8-08bf-4e0d-9a6d-48c16dd0aac8', 'volume_name': 'volume-04877ef8-08bf-4e0d-9a6d-48c16dd0aac8', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:49 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-2f08e002-b58e-441e-ad72-5e40581f27d6 tempest-VolumesListTestJSON-498473273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d9fcf7c-abb3-47cd-8ff4-47ef5fd13f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:49 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-2f08e002-b58e-441e-ad72-5e40581f27d6 tempest-VolumesListTestJSON-498473273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d9fcf7c-abb3-47cd-8ff4-47ef5fd13f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:49 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-2f08e002-b58e-441e-ad72-5e40581f27d6 tempest-VolumesListTestJSON-498473273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f91fe1a-09aa-4eac-9be9-9e712c694418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:49 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-2f08e002-b58e-441e-ad72-5e40581f27d6 tempest-VolumesListTestJSON-498473273 None] Volume 04877ef8-08bf-4e0d-9a6d-48c16dd0aac8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04877ef8-08bf-4e0d-9a6d-48c16dd0aac8', 'volume_size': 1}
Apr 15 20:09:49 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-2f08e002-b58e-441e-ad72-5e40581f27d6 tempest-VolumesListTestJSON-498473273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:09:49 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-2f08e002-b58e-441e-ad72-5e40581f27d6 tempest-VolumesListTestJSON-498473273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:09:49 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-2f08e002-b58e-441e-ad72-5e40581f27d6 tempest-VolumesListTestJSON-498473273 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:09:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1049369126',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04877ef8-08bf-4e0d-9a6d-48c16dd0aac8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dfb9c0c9b94147b7918a875606239d1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:09:49Z,use_quota=True,user_id='c90854b575624c1e8c93228931b94d5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:09:49 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-2f08e002-b58e-441e-ad72-5e40581f27d6 tempest-VolumesListTestJSON-498473273 None] Creating volume 04877ef8-08bf-4e0d-9a6d-48c16dd0aac8 {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:09:49 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-2f08e002-b58e-441e-ad72-5e40581f27d6 tempest-VolumesListTestJSON-498473273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:09:49 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-2f08e002-b58e-441e-ad72-5e40581f27d6 tempest-VolumesListTestJSON-498473273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:09:49 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-2f08e002-b58e-441e-ad72-5e40581f27d6 tempest-VolumesListTestJSON-498473273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:09:49 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-2f08e002-b58e-441e-ad72-5e40581f27d6 tempest-VolumesListTestJSON-498473273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:09:49 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-2f08e002-b58e-441e-ad72-5e40581f27d6 tempest-VolumesListTestJSON-498473273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:09:49 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-2f08e002-b58e-441e-ad72-5e40581f27d6 tempest-VolumesListTestJSON-498473273 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:09:49 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-2f08e002-b58e-441e-ad72-5e40581f27d6 tempest-VolumesListTestJSON-498473273 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:09:49 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-2f08e002-b58e-441e-ad72-5e40581f27d6 tempest-VolumesListTestJSON-498473273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-04877ef8-08bf-4e0d-9a6d-48c16dd0aac8 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:49 devstack sudo[87227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-04877ef8-08bf-4e0d-9a6d-48c16dd0aac8 1073741824
Apr 15 20:09:49 devstack sudo[87227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:49 devstack sudo[87224]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:49 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.749s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:49 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:09:49 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-a8907944-3f81-4a5e-a436-df09280e3cef tempest-VolumesTransfersV355Test-1752719892 None] Acquiring lock "cinder-3b4eb247-7ab2-4005-a20b-e1f579219b48-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:09:49 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-a8907944-3f81-4a5e-a436-df09280e3cef tempest-VolumesTransfersV355Test-1752719892 None] Lock "cinder-3b4eb247-7ab2-4005-a20b-e1f579219b48-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:09:49 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-a8907944-3f81-4a5e-a436-df09280e3cef tempest-VolumesTransfersV355Test-1752719892 None] Acquiring lock "cinder-quobyte-3b4eb247-7ab2-4005-a20b-e1f579219b48" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:09:49 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-a8907944-3f81-4a5e-a436-df09280e3cef tempest-VolumesTransfersV355Test-1752719892 None] Lock "cinder-quobyte-3b4eb247-7ab2-4005-a20b-e1f579219b48" acquired by "delete_volume" :: waited 0.009s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:09:49 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[f21c9324-c1da-4bea-9d36-494c8ba2b24c]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:09:49 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-a8907944-3f81-4a5e-a436-df09280e3cef tempest-VolumesTransfersV355Test-1752719892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3b4eb247-7ab2-4005-a20b-e1f579219b48 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:49 devstack sudo[87230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3b4eb247-7ab2-4005-a20b-e1f579219b48
Apr 15 20:09:49 devstack sudo[87230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:50 devstack sudo[87227]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:50 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-2f08e002-b58e-441e-ad72-5e40581f27d6 tempest-VolumesListTestJSON-498473273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-04877ef8-08bf-4e0d-9a6d-48c16dd0aac8 1073741824" returned: 0 in 0.697s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:50 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-2f08e002-b58e-441e-ad72-5e40581f27d6 tempest-VolumesListTestJSON-498473273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-04877ef8-08bf-4e0d-9a6d-48c16dd0aac8 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:50 devstack sudo[87235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-04877ef8-08bf-4e0d-9a6d-48c16dd0aac8
Apr 15 20:09:50 devstack sudo[87235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:50 devstack sudo[87230]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:50 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-a8907944-3f81-4a5e-a436-df09280e3cef tempest-VolumesTransfersV355Test-1752719892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3b4eb247-7ab2-4005-a20b-e1f579219b48" returned: 0 in 0.629s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:50 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-a8907944-3f81-4a5e-a436-df09280e3cef tempest-VolumesTransfersV355Test-1752719892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3b4eb247-7ab2-4005-a20b-e1f579219b48 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:50 devstack sudo[87240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3b4eb247-7ab2-4005-a20b-e1f579219b48
Apr 15 20:09:50 devstack sudo[87240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:50 devstack sudo[87235]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:50 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-2f08e002-b58e-441e-ad72-5e40581f27d6 tempest-VolumesListTestJSON-498473273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-04877ef8-08bf-4e0d-9a6d-48c16dd0aac8" returned: 0 in 0.515s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:50 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-2f08e002-b58e-441e-ad72-5e40581f27d6 tempest-VolumesListTestJSON-498473273 None] <== create_volume: return (1243ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:09:50 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-2f08e002-b58e-441e-ad72-5e40581f27d6 tempest-VolumesListTestJSON-498473273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.245s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:09:50 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-2f08e002-b58e-441e-ad72-5e40581f27d6 tempest-VolumesListTestJSON-498473273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f91fe1a-09aa-4eac-9be9-9e712c694418) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04877ef8-08bf-4e0d-9a6d-48c16dd0aac8', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:50 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-2f08e002-b58e-441e-ad72-5e40581f27d6 tempest-VolumesListTestJSON-498473273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b923b7fe-615a-491d-8b22-ae80021aea2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:50 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-2f08e002-b58e-441e-ad72-5e40581f27d6 tempest-VolumesListTestJSON-498473273 None] Volume volume-04877ef8-08bf-4e0d-9a6d-48c16dd0aac8 (04877ef8-08bf-4e0d-9a6d-48c16dd0aac8): created successfully
Apr 15 20:09:50 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-2f08e002-b58e-441e-ad72-5e40581f27d6 tempest-VolumesListTestJSON-498473273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b923b7fe-615a-491d-8b22-ae80021aea2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:50 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-2f08e002-b58e-441e-ad72-5e40581f27d6 tempest-VolumesListTestJSON-498473273 None] Flow 'volume_create_manager' (6a7592a0-97f2-405b-b244-eb1736a3175a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:09:50 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-2f08e002-b58e-441e-ad72-5e40581f27d6 tempest-VolumesListTestJSON-498473273 None] Created volume successfully.
Apr 15 20:09:50 devstack sudo[87240]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:50 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-a8907944-3f81-4a5e-a436-df09280e3cef tempest-VolumesTransfersV355Test-1752719892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3b4eb247-7ab2-4005-a20b-e1f579219b48" returned: 0 in 0.517s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:50 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-a8907944-3f81-4a5e-a436-df09280e3cef tempest-VolumesTransfersV355Test-1752719892 None] Lock "cinder-quobyte-3b4eb247-7ab2-4005-a20b-e1f579219b48" released by "delete_volume" :: held 1.174s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:09:50 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-a8907944-3f81-4a5e-a436-df09280e3cef tempest-VolumesTransfersV355Test-1752719892 None] Created reservations ['23c4c429-689b-4918-ace1-53f096a56b01', '97e55bef-9b21-4d92-83c3-839171206fcb', 'ebcb0f3e-2e34-4ba4-89f6-1801245194f0', 'b1700b16-e1cd-49d6-b11a-48504b73b408'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:09:51 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-a8907944-3f81-4a5e-a436-df09280e3cef tempest-VolumesTransfersV355Test-1752719892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:09:51 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-a8907944-3f81-4a5e-a436-df09280e3cef tempest-VolumesTransfersV355Test-1752719892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:09:51 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-a8907944-3f81-4a5e-a436-df09280e3cef tempest-VolumesTransfersV355Test-1752719892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:09:51 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-a8907944-3f81-4a5e-a436-df09280e3cef tempest-VolumesTransfersV355Test-1752719892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:09:51 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-a8907944-3f81-4a5e-a436-df09280e3cef tempest-VolumesTransfersV355Test-1752719892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:09:51 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-a8907944-3f81-4a5e-a436-df09280e3cef tempest-VolumesTransfersV355Test-1752719892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:51 devstack sudo[87244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:09:51 devstack sudo[87244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:51 devstack sudo[87244]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:51 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-a8907944-3f81-4a5e-a436-df09280e3cef tempest-VolumesTransfersV355Test-1752719892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.514s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:51 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-a8907944-3f81-4a5e-a436-df09280e3cef tempest-VolumesTransfersV355Test-1752719892 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:09:51 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-a8907944-3f81-4a5e-a436-df09280e3cef tempest-VolumesTransfersV355Test-1752719892 None] Deleted volume successfully.
Apr 15 20:09:51 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-a8907944-3f81-4a5e-a436-df09280e3cef tempest-VolumesTransfersV355Test-1752719892 None] Lock "cinder-3b4eb247-7ab2-4005-a20b-e1f579219b48-delete_volume" released by "delete_volume" :: held 1.832s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:09:51 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-18614a55-f7e3-4245-8b7c-63f82eb42d6f tempest-GroupsV314Test-2097971262 None] Group tempest-GroupsV314Test-Group-246056676: creating
Apr 15 20:09:51 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-18614a55-f7e3-4245-8b7c-63f82eb42d6f tempest-GroupsV314Test-2097971262 None] Group tempest-GroupsV314Test-Group-246056676: created successfully
Apr 15 20:09:51 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-18614a55-f7e3-4245-8b7c-63f82eb42d6f tempest-GroupsV314Test-2097971262 None] Create group completed successfully.
Apr 15 20:09:53 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a69fb97-1429-446b-96a9-295b79ef1eda tempest-GroupsV314Test-2097971262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:09:53 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-1a69fb97-1429-446b-96a9-295b79ef1eda tempest-GroupsV314Test-2097971262 None] Flow 'volume_create_manager' (a6f3a11e-af93-4316-8eed-e754b786085f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:09:53 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-1a69fb97-1429-446b-96a9-295b79ef1eda tempest-GroupsV314Test-2097971262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0756ffc4-b47a-4abb-a0a4-adf28d2fc118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:53 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-1a69fb97-1429-446b-96a9-295b79ef1eda tempest-GroupsV314Test-2097971262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0756ffc4-b47a-4abb-a0a4-adf28d2fc118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:09:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1868601314',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=4962fee6-efd6-498c-ba0c-18cce1d5ff26,host='devstack@QuobyteHD#QuobyteHD',id=a7f17777-0abe-4a87-884c-69d483f407ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70d1afd7a2b642d19319055c6bccf785',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:09:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:09:53Z,use_quota=True,user_id='456fe7b7357143c68c5718f43196facb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eba9c688-114b-4ecd-b9d3-002dbf02021e),volume_type_id=eba9c688-114b-4ecd-b9d3-002dbf02021e)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:53 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-1a69fb97-1429-446b-96a9-295b79ef1eda tempest-GroupsV314Test-2097971262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d10dd85-962b-4a05-9b86-637814d429d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:53 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-1a69fb97-1429-446b-96a9-295b79ef1eda tempest-GroupsV314Test-2097971262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d10dd85-962b-4a05-9b86-637814d429d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:53 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-1a69fb97-1429-446b-96a9-295b79ef1eda tempest-GroupsV314Test-2097971262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87e67461-d040-4d7c-91bb-7be9e7a39252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:53 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-1a69fb97-1429-446b-96a9-295b79ef1eda tempest-GroupsV314Test-2097971262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87e67461-d040-4d7c-91bb-7be9e7a39252) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7f17777-0abe-4a87-884c-69d483f407ed', 'volume_name': 'volume-a7f17777-0abe-4a87-884c-69d483f407ed', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:53 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-1a69fb97-1429-446b-96a9-295b79ef1eda tempest-GroupsV314Test-2097971262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28c68dc5-15d2-42f6-a085-6ac6bf0d9c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:53 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-1a69fb97-1429-446b-96a9-295b79ef1eda tempest-GroupsV314Test-2097971262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28c68dc5-15d2-42f6-a085-6ac6bf0d9c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:53 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-1a69fb97-1429-446b-96a9-295b79ef1eda tempest-GroupsV314Test-2097971262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09abac09-db67-42d9-8e4e-7f044aac6214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:53 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-1a69fb97-1429-446b-96a9-295b79ef1eda tempest-GroupsV314Test-2097971262 None] Volume a7f17777-0abe-4a87-884c-69d483f407ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7f17777-0abe-4a87-884c-69d483f407ed', 'volume_size': 1}
Apr 15 20:09:53 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-1a69fb97-1429-446b-96a9-295b79ef1eda tempest-GroupsV314Test-2097971262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:09:53 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-1a69fb97-1429-446b-96a9-295b79ef1eda tempest-GroupsV314Test-2097971262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:09:53 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-1a69fb97-1429-446b-96a9-295b79ef1eda tempest-GroupsV314Test-2097971262 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=4962fee6-efd6-498c-ba0c-18cce1d5ff26,created_at=2026-04-15T18:09:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1868601314',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=4962fee6-efd6-498c-ba0c-18cce1d5ff26,host='devstack@QuobyteHD#QuobyteHD',id=a7f17777-0abe-4a87-884c-69d483f407ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70d1afd7a2b642d19319055c6bccf785',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:09:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:09:53Z,use_quota=True,user_id='456fe7b7357143c68c5718f43196facb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eba9c688-114b-4ecd-b9d3-002dbf02021e),volume_type_id=eba9c688-114b-4ecd-b9d3-002dbf02021e)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:09:53 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-1a69fb97-1429-446b-96a9-295b79ef1eda tempest-GroupsV314Test-2097971262 None] Creating volume a7f17777-0abe-4a87-884c-69d483f407ed {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:09:53 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-1a69fb97-1429-446b-96a9-295b79ef1eda tempest-GroupsV314Test-2097971262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:09:53 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-1a69fb97-1429-446b-96a9-295b79ef1eda tempest-GroupsV314Test-2097971262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:09:53 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-1a69fb97-1429-446b-96a9-295b79ef1eda tempest-GroupsV314Test-2097971262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:09:53 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-1a69fb97-1429-446b-96a9-295b79ef1eda tempest-GroupsV314Test-2097971262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:09:53 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-1a69fb97-1429-446b-96a9-295b79ef1eda tempest-GroupsV314Test-2097971262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:09:53 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-1a69fb97-1429-446b-96a9-295b79ef1eda tempest-GroupsV314Test-2097971262 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:09:53 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-1a69fb97-1429-446b-96a9-295b79ef1eda tempest-GroupsV314Test-2097971262 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:09:53 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-1a69fb97-1429-446b-96a9-295b79ef1eda tempest-GroupsV314Test-2097971262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7f17777-0abe-4a87-884c-69d483f407ed 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:53 devstack sudo[87247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7f17777-0abe-4a87-884c-69d483f407ed 1073741824
Apr 15 20:09:53 devstack sudo[87247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:53 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-76a31228-0012-4f2f-a989-7d1b01807bf9 tempest-VolumesListTestJSON-498473273 None] Acquiring lock "cinder-04877ef8-08bf-4e0d-9a6d-48c16dd0aac8-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:09:53 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-76a31228-0012-4f2f-a989-7d1b01807bf9 tempest-VolumesListTestJSON-498473273 None] Lock "cinder-04877ef8-08bf-4e0d-9a6d-48c16dd0aac8-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:09:53 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-76a31228-0012-4f2f-a989-7d1b01807bf9 tempest-VolumesListTestJSON-498473273 None] Acquiring lock "cinder-quobyte-04877ef8-08bf-4e0d-9a6d-48c16dd0aac8" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:09:53 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-76a31228-0012-4f2f-a989-7d1b01807bf9 tempest-VolumesListTestJSON-498473273 None] Lock "cinder-quobyte-04877ef8-08bf-4e0d-9a6d-48c16dd0aac8" acquired by "delete_volume" :: waited 0.009s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:09:53 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[150cb323-b4f4-4665-af52-1b58a5f9a907]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:09:53 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-76a31228-0012-4f2f-a989-7d1b01807bf9 tempest-VolumesListTestJSON-498473273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-04877ef8-08bf-4e0d-9a6d-48c16dd0aac8 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:53 devstack sudo[87252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-04877ef8-08bf-4e0d-9a6d-48c16dd0aac8
Apr 15 20:09:53 devstack sudo[87252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:53 devstack sudo[87247]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:53 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-1a69fb97-1429-446b-96a9-295b79ef1eda tempest-GroupsV314Test-2097971262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7f17777-0abe-4a87-884c-69d483f407ed 1073741824" returned: 0 in 0.606s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:53 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-1a69fb97-1429-446b-96a9-295b79ef1eda tempest-GroupsV314Test-2097971262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7f17777-0abe-4a87-884c-69d483f407ed {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:53 devstack sudo[87254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7f17777-0abe-4a87-884c-69d483f407ed
Apr 15 20:09:53 devstack sudo[87254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:54 devstack sudo[87252]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:54 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-76a31228-0012-4f2f-a989-7d1b01807bf9 tempest-VolumesListTestJSON-498473273 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-04877ef8-08bf-4e0d-9a6d-48c16dd0aac8" returned: 0 in 0.638s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:54 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-76a31228-0012-4f2f-a989-7d1b01807bf9 tempest-VolumesListTestJSON-498473273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-04877ef8-08bf-4e0d-9a6d-48c16dd0aac8 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:54 devstack sudo[87260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-04877ef8-08bf-4e0d-9a6d-48c16dd0aac8
Apr 15 20:09:54 devstack sudo[87260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:54 devstack sudo[87254]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:54 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-1a69fb97-1429-446b-96a9-295b79ef1eda tempest-GroupsV314Test-2097971262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7f17777-0abe-4a87-884c-69d483f407ed" returned: 0 in 0.543s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:54 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-1a69fb97-1429-446b-96a9-295b79ef1eda tempest-GroupsV314Test-2097971262 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:09:54 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-1a69fb97-1429-446b-96a9-295b79ef1eda tempest-GroupsV314Test-2097971262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.176s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:09:54 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-1a69fb97-1429-446b-96a9-295b79ef1eda tempest-GroupsV314Test-2097971262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09abac09-db67-42d9-8e4e-7f044aac6214) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7f17777-0abe-4a87-884c-69d483f407ed', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:54 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-1a69fb97-1429-446b-96a9-295b79ef1eda tempest-GroupsV314Test-2097971262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5f0090e-e7ac-4191-be68-b51b4661d217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:54 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-1a69fb97-1429-446b-96a9-295b79ef1eda tempest-GroupsV314Test-2097971262 None] Volume volume-a7f17777-0abe-4a87-884c-69d483f407ed (a7f17777-0abe-4a87-884c-69d483f407ed): created successfully
Apr 15 20:09:54 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-1a69fb97-1429-446b-96a9-295b79ef1eda tempest-GroupsV314Test-2097971262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5f0090e-e7ac-4191-be68-b51b4661d217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:54 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-1a69fb97-1429-446b-96a9-295b79ef1eda tempest-GroupsV314Test-2097971262 None] Flow 'volume_create_manager' (a6f3a11e-af93-4316-8eed-e754b786085f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:09:54 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-1a69fb97-1429-446b-96a9-295b79ef1eda tempest-GroupsV314Test-2097971262 None] Created volume successfully.
Apr 15 20:09:54 devstack sudo[87260]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:54 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-76a31228-0012-4f2f-a989-7d1b01807bf9 tempest-VolumesListTestJSON-498473273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-04877ef8-08bf-4e0d-9a6d-48c16dd0aac8" returned: 0 in 0.516s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:54 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-76a31228-0012-4f2f-a989-7d1b01807bf9 tempest-VolumesListTestJSON-498473273 None] Lock "cinder-quobyte-04877ef8-08bf-4e0d-9a6d-48c16dd0aac8" released by "delete_volume" :: held 1.181s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:09:54 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-76a31228-0012-4f2f-a989-7d1b01807bf9 tempest-VolumesListTestJSON-498473273 None] Created reservations ['c49d631b-4f77-4975-9be7-f083bf39d70b', '37657fef-4b0a-4be8-98f9-4b25a734cfaa', 'd6483408-b099-4894-aa15-b225ba76bfe3', '249fb632-a83b-4b86-86db-a96c2e5b825d'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:09:55 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-40d2868e-9f5d-4689-8ff2-76e4a35397ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:09:55 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-40d2868e-9f5d-4689-8ff2-76e4a35397ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Flow 'volume_create_manager' (66798812-a792-4e0e-b7b3-db180b92d9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:09:55 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-40d2868e-9f5d-4689-8ff2-76e4a35397ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b7e65f2-12ac-491e-be63-bf0b594e1a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:55 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-40d2868e-9f5d-4689-8ff2-76e4a35397ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b7e65f2-12ac-491e-be63-bf0b594e1a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:09:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1882612223',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95142a00-f940-4dc8-9f7f-432818503ee0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='050166e451a54eb88f7c460512efd75e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:09:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:09:55Z,use_quota=True,user_id='77fcc2c30b8d4d2796c0a2685e239c84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:55 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-40d2868e-9f5d-4689-8ff2-76e4a35397ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e6622c0-a923-48e7-8f33-71bcf259b6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:55 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-40d2868e-9f5d-4689-8ff2-76e4a35397ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e6622c0-a923-48e7-8f33-71bcf259b6bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:55 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-40d2868e-9f5d-4689-8ff2-76e4a35397ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa7b685d-de68-4ec9-afc7-ef754aafc50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:55 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-40d2868e-9f5d-4689-8ff2-76e4a35397ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa7b685d-de68-4ec9-afc7-ef754aafc50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95142a00-f940-4dc8-9f7f-432818503ee0', 'volume_name': 'volume-95142a00-f940-4dc8-9f7f-432818503ee0', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:55 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-40d2868e-9f5d-4689-8ff2-76e4a35397ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0659cc23-c125-43ff-8735-15bdd830cdac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:55 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-40d2868e-9f5d-4689-8ff2-76e4a35397ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0659cc23-c125-43ff-8735-15bdd830cdac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:55 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-40d2868e-9f5d-4689-8ff2-76e4a35397ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf739720-d58e-49ce-a227-300de77d1021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:55 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-40d2868e-9f5d-4689-8ff2-76e4a35397ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Volume 95142a00-f940-4dc8-9f7f-432818503ee0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95142a00-f940-4dc8-9f7f-432818503ee0', 'volume_size': 1}
Apr 15 20:09:55 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-40d2868e-9f5d-4689-8ff2-76e4a35397ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:09:55 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-40d2868e-9f5d-4689-8ff2-76e4a35397ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:09:55 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-40d2868e-9f5d-4689-8ff2-76e4a35397ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:09:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1882612223',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95142a00-f940-4dc8-9f7f-432818503ee0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='050166e451a54eb88f7c460512efd75e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:09:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:09:55Z,use_quota=True,user_id='77fcc2c30b8d4d2796c0a2685e239c84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:09:55 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-40d2868e-9f5d-4689-8ff2-76e4a35397ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Creating volume 95142a00-f940-4dc8-9f7f-432818503ee0 {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:09:55 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-40d2868e-9f5d-4689-8ff2-76e4a35397ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:09:55 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-40d2868e-9f5d-4689-8ff2-76e4a35397ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:09:55 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-40d2868e-9f5d-4689-8ff2-76e4a35397ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:09:55 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-40d2868e-9f5d-4689-8ff2-76e4a35397ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:09:55 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-40d2868e-9f5d-4689-8ff2-76e4a35397ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:09:55 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-40d2868e-9f5d-4689-8ff2-76e4a35397ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:09:55 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-40d2868e-9f5d-4689-8ff2-76e4a35397ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:09:55 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-40d2868e-9f5d-4689-8ff2-76e4a35397ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95142a00-f940-4dc8-9f7f-432818503ee0 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:55 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-76a31228-0012-4f2f-a989-7d1b01807bf9 tempest-VolumesListTestJSON-498473273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:09:55 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-76a31228-0012-4f2f-a989-7d1b01807bf9 tempest-VolumesListTestJSON-498473273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:09:55 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-76a31228-0012-4f2f-a989-7d1b01807bf9 tempest-VolumesListTestJSON-498473273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:09:55 devstack sudo[87263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95142a00-f940-4dc8-9f7f-432818503ee0 1073741824
Apr 15 20:09:55 devstack sudo[87263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:55 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-76a31228-0012-4f2f-a989-7d1b01807bf9 tempest-VolumesListTestJSON-498473273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:09:55 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-76a31228-0012-4f2f-a989-7d1b01807bf9 tempest-VolumesListTestJSON-498473273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:09:55 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-76a31228-0012-4f2f-a989-7d1b01807bf9 tempest-VolumesListTestJSON-498473273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:55 devstack sudo[87265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:09:55 devstack sudo[87265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:55 devstack sudo[87265]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:55 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-76a31228-0012-4f2f-a989-7d1b01807bf9 tempest-VolumesListTestJSON-498473273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.549s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:55 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-76a31228-0012-4f2f-a989-7d1b01807bf9 tempest-VolumesListTestJSON-498473273 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:09:55 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-76a31228-0012-4f2f-a989-7d1b01807bf9 tempest-VolumesListTestJSON-498473273 None] Deleted volume successfully.
Apr 15 20:09:55 devstack sudo[87263]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:55 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-40d2868e-9f5d-4689-8ff2-76e4a35397ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95142a00-f940-4dc8-9f7f-432818503ee0 1073741824" returned: 0 in 0.594s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:55 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-76a31228-0012-4f2f-a989-7d1b01807bf9 tempest-VolumesListTestJSON-498473273 None] Lock "cinder-04877ef8-08bf-4e0d-9a6d-48c16dd0aac8-delete_volume" released by "delete_volume" :: held 1.995s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:09:55 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-40d2868e-9f5d-4689-8ff2-76e4a35397ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95142a00-f940-4dc8-9f7f-432818503ee0 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:55 devstack sudo[87271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95142a00-f940-4dc8-9f7f-432818503ee0
Apr 15 20:09:55 devstack sudo[87271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:56 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-552ce88e-4778-4792-b123-cef7303ab96c tempest-VolumesExtendTest-1563095803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:09:56 devstack sudo[87271]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:56 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-552ce88e-4778-4792-b123-cef7303ab96c tempest-VolumesExtendTest-1563095803 None] Flow 'volume_create_manager' (1198d510-6757-4eaa-b057-95ca5b089680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:09:56 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-552ce88e-4778-4792-b123-cef7303ab96c tempest-VolumesExtendTest-1563095803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0eace44-6d15-4c21-b352-1cd1ee2088e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:56 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-40d2868e-9f5d-4689-8ff2-76e4a35397ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95142a00-f940-4dc8-9f7f-432818503ee0" returned: 0 in 0.472s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:56 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-40d2868e-9f5d-4689-8ff2-76e4a35397ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:09:56 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-40d2868e-9f5d-4689-8ff2-76e4a35397ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:09:56 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-552ce88e-4778-4792-b123-cef7303ab96c tempest-VolumesExtendTest-1563095803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0eace44-6d15-4c21-b352-1cd1ee2088e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:09:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-189743868',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e01c1321-f397-494f-9109-a5a2674b9d7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acd6766cf57c4b06915de0f14b3188be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:09:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:09:56Z,use_quota=True,user_id='876149b72a1e46898ab8be6279506c33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:56 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-552ce88e-4778-4792-b123-cef7303ab96c tempest-VolumesExtendTest-1563095803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2b67328-11d7-4492-aa28-afbd573b4fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:56 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-552ce88e-4778-4792-b123-cef7303ab96c tempest-VolumesExtendTest-1563095803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2b67328-11d7-4492-aa28-afbd573b4fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:56 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-552ce88e-4778-4792-b123-cef7303ab96c tempest-VolumesExtendTest-1563095803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93fb2552-bef4-40fb-b4b4-c33b13c2935e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:56 devstack cinder-volume[82646]: DEBUG cinder.image.glance [None req-552ce88e-4778-4792-b123-cef7303ab96c tempest-VolumesExtendTest-1563095803 None] Creating Keystone auth plugin from conf {{(pid=82646) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 15 20:09:56 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-40d2868e-9f5d-4689-8ff2-76e4a35397ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf739720-d58e-49ce-a227-300de77d1021) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95142a00-f940-4dc8-9f7f-432818503ee0', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:56 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-40d2868e-9f5d-4689-8ff2-76e4a35397ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edd09701-59d3-4723-a19a-079c51038aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:56 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-9372f4a8-9b8f-453a-b7b4-c5627960f4c3 tempest-VolumesListTestJSON-498473273 None] Acquiring lock "cinder-e723f9c9-f606-4b32-8768-5729101c4a3e-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:09:56 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-40d2868e-9f5d-4689-8ff2-76e4a35397ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Volume volume-95142a00-f940-4dc8-9f7f-432818503ee0 (95142a00-f940-4dc8-9f7f-432818503ee0): created successfully
Apr 15 20:09:56 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-40d2868e-9f5d-4689-8ff2-76e4a35397ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edd09701-59d3-4723-a19a-079c51038aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:56 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-40d2868e-9f5d-4689-8ff2-76e4a35397ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Flow 'volume_create_manager' (66798812-a792-4e0e-b7b3-db180b92d9c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:09:56 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-9372f4a8-9b8f-453a-b7b4-c5627960f4c3 tempest-VolumesListTestJSON-498473273 None] Lock "cinder-e723f9c9-f606-4b32-8768-5729101c4a3e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:09:56 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-40d2868e-9f5d-4689-8ff2-76e4a35397ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Created volume successfully.
Apr 15 20:09:56 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-9372f4a8-9b8f-453a-b7b4-c5627960f4c3 tempest-VolumesListTestJSON-498473273 None] Acquiring lock "cinder-quobyte-e723f9c9-f606-4b32-8768-5729101c4a3e" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:09:56 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-9372f4a8-9b8f-453a-b7b4-c5627960f4c3 tempest-VolumesListTestJSON-498473273 None] Lock "cinder-quobyte-e723f9c9-f606-4b32-8768-5729101c4a3e" acquired by "delete_volume" :: waited 0.015s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:09:56 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[59008448-8300-4194-a2ba-bf8fc52919ef]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:09:56 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-9372f4a8-9b8f-453a-b7b4-c5627960f4c3 tempest-VolumesListTestJSON-498473273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e723f9c9-f606-4b32-8768-5729101c4a3e {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:56 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-6a48ddc2-e50e-4cee-ba7c-f26f4aceec8b tempest-GroupsV314Test-2097971262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:09:56 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-6a48ddc2-e50e-4cee-ba7c-f26f4aceec8b tempest-GroupsV314Test-2097971262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:09:56 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-6a48ddc2-e50e-4cee-ba7c-f26f4aceec8b tempest-GroupsV314Test-2097971262 None] Cloning volume a7f17777-0abe-4a87-884c-69d483f407ed to volume b9a6939b-9290-43e5-8ba5-69212334ed18
Apr 15 20:09:56 devstack sudo[87275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e723f9c9-f606-4b32-8768-5729101c4a3e
Apr 15 20:09:56 devstack sudo[87275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:56 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-552ce88e-4778-4792-b123-cef7303ab96c tempest-VolumesExtendTest-1563095803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93fb2552-bef4-40fb-b4b4-c33b13c2935e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e01c1321-f397-494f-9109-a5a2674b9d7d', 'volume_name': 'volume-e01c1321-f397-494f-9109-a5a2674b9d7d', 'volume_size': 1, 'image_id': '565a23e3-dcfa-4a62-b361-219578b0cd92', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/565a23e3-dcfa-4a62-b361-219578b0cd92', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '27d9c820db6c4abea4324fe8ea0f90e6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '565a23e3-dcfa-4a62-b361-219578b0cd92', 'created_at': datetime.datetime(2026, 4, 15, 18, 0, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 18, 0, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/565a23e3-dcfa-4a62-b361-219578b0cd92/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe15d316680>}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:56 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-552ce88e-4778-4792-b123-cef7303ab96c tempest-VolumesExtendTest-1563095803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b86aec28-6878-4016-8742-dfe6c52eafca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:56 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-552ce88e-4778-4792-b123-cef7303ab96c tempest-VolumesExtendTest-1563095803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b86aec28-6878-4016-8742-dfe6c52eafca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:09:56 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-552ce88e-4778-4792-b123-cef7303ab96c tempest-VolumesExtendTest-1563095803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bacb59d-ca38-47f0-a9a8-251dd745d56c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:09:56 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-552ce88e-4778-4792-b123-cef7303ab96c tempest-VolumesExtendTest-1563095803 None] Volume e01c1321-f397-494f-9109-a5a2674b9d7d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e01c1321-f397-494f-9109-a5a2674b9d7d', 'volume_size': 1, 'image_id': '565a23e3-dcfa-4a62-b361-219578b0cd92', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/565a23e3-dcfa-4a62-b361-219578b0cd92', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '27d9c820db6c4abea4324fe8ea0f90e6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '565a23e3-dcfa-4a62-b361-219578b0cd92', 'created_at': datetime.datetime(2026, 4, 15, 18, 0, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 18, 0, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/565a23e3-dcfa-4a62-b361-219578b0cd92/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe15d316680>}
Apr 15 20:09:56 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-552ce88e-4778-4792-b123-cef7303ab96c tempest-VolumesExtendTest-1563095803 None] Trying to clone e01c1321-f397-494f-9109-a5a2674b9d7d from image 565a23e3-dcfa-4a62-b361-219578b0cd92 at location (None, [{'url': 'file:///opt/stack/data/glance/images/565a23e3-dcfa-4a62-b361-219578b0cd92', 'metadata': {}}]). {{(pid=82646) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 15 20:09:56 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-6a48ddc2-e50e-4cee-ba7c-f26f4aceec8b tempest-GroupsV314Test-2097971262 None] Creating offline snapshot d137dd4e-5cb3-43cc-b791-ddc8d754274e of volume a7f17777-0abe-4a87-884c-69d483f407ed {{(pid=82646) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 20:09:56 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff9166c-9292-4e46-8553-f08081ef4b6e]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:09:56 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6a48ddc2-e50e-4cee-ba7c-f26f4aceec8b tempest-GroupsV314Test-2097971262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7f17777-0abe-4a87-884c-69d483f407ed {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:56 devstack sudo[87277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7f17777-0abe-4a87-884c-69d483f407ed
Apr 15 20:09:56 devstack sudo[87277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:56 devstack cinder-volume[82646]: DEBUG cinder.image.image_utils [None req-552ce88e-4778-4792-b123-cef7303ab96c tempest-VolumesExtendTest-1563095803 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_565a23e3-dcfa-4a62-b361-219578b0cd92_b2xqbn4vdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82646) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 15 20:09:56 devstack cinder-volume[82646]: INFO cinder.image.image_utils [None req-552ce88e-4778-4792-b123-cef7303ab96c tempest-VolumesExtendTest-1563095803 None] Image download 20.69 MB at 20.69 MB/s
Apr 15 20:09:56 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7c6228-646a-40c0-b85f-fad43aad31cc]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:09:56 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-552ce88e-4778-4792-b123-cef7303ab96c tempest-VolumesExtendTest-1563095803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_565a23e3-dcfa-4a62-b361-219578b0cd92_b2xqbn4vdevstack@QuobyteHD {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:56 devstack sudo[87280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_565a23e3-dcfa-4a62-b361-219578b0cd92_b2xqbn4vdevstack@QuobyteHD
Apr 15 20:09:56 devstack sudo[87280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:56 devstack sudo[87275]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:56 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-9372f4a8-9b8f-453a-b7b4-c5627960f4c3 tempest-VolumesListTestJSON-498473273 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e723f9c9-f606-4b32-8768-5729101c4a3e" returned: 0 in 0.529s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:56 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-9372f4a8-9b8f-453a-b7b4-c5627960f4c3 tempest-VolumesListTestJSON-498473273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e723f9c9-f606-4b32-8768-5729101c4a3e {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:56 devstack sudo[87286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e723f9c9-f606-4b32-8768-5729101c4a3e
Apr 15 20:09:56 devstack sudo[87286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:56 devstack sudo[87277]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:56 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6a48ddc2-e50e-4cee-ba7c-f26f4aceec8b tempest-GroupsV314Test-2097971262 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7f17777-0abe-4a87-884c-69d483f407ed" returned: 0 in 0.495s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:56 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6a48ddc2-e50e-4cee-ba7c-f26f4aceec8b tempest-GroupsV314Test-2097971262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7f17777-0abe-4a87-884c-69d483f407ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7f17777-0abe-4a87-884c-69d483f407ed.d137dd4e-5cb3-43cc-b791-ddc8d754274e 1G {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:56 devstack sudo[87290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7f17777-0abe-4a87-884c-69d483f407ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7f17777-0abe-4a87-884c-69d483f407ed.d137dd4e-5cb3-43cc-b791-ddc8d754274e 1G
Apr 15 20:09:56 devstack sudo[87290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:57 devstack sudo[87280]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:57 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-552ce88e-4778-4792-b123-cef7303ab96c tempest-VolumesExtendTest-1563095803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_565a23e3-dcfa-4a62-b361-219578b0cd92_b2xqbn4vdevstack@QuobyteHD" returned: 0 in 0.474s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:57 devstack cinder-volume[82646]: DEBUG cinder.image.image_utils [None req-552ce88e-4778-4792-b123-cef7303ab96c tempest-VolumesExtendTest-1563095803 None] Temporary image 565a23e3-dcfa-4a62-b361-219578b0cd92 is fetched for user 876149b72a1e46898ab8be6279506c33. {{(pid=82646) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 15 20:09:57 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4682bd-eb82-4619-bd42-db49d79d2e66]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:09:57 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-552ce88e-4778-4792-b123-cef7303ab96c tempest-VolumesExtendTest-1563095803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_565a23e3-dcfa-4a62-b361-219578b0cd92_b2xqbn4vdevstack@QuobyteHD {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:57 devstack sudo[87296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_565a23e3-dcfa-4a62-b361-219578b0cd92_b2xqbn4vdevstack@QuobyteHD
Apr 15 20:09:57 devstack sudo[87296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:57 devstack sudo[87286]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:57 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-9372f4a8-9b8f-453a-b7b4-c5627960f4c3 tempest-VolumesListTestJSON-498473273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e723f9c9-f606-4b32-8768-5729101c4a3e" returned: 0 in 0.438s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:57 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-9372f4a8-9b8f-453a-b7b4-c5627960f4c3 tempest-VolumesListTestJSON-498473273 None] Lock "cinder-quobyte-e723f9c9-f606-4b32-8768-5729101c4a3e" released by "delete_volume" :: held 1.005s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:09:57 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-e3402c5c-fbb2-465c-a161-77b88ae34b9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:09:57 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-9372f4a8-9b8f-453a-b7b4-c5627960f4c3 tempest-VolumesListTestJSON-498473273 None] Created reservations ['9248af9e-e83b-498b-9b20-88e1a2eda9dd', '8d484133-a7fa-4771-9dc6-76bfcffc349a', 'dd9ab2ab-3ee0-4414-a611-fa7cea5e7e19', '1a42d69c-84ba-42cb-b8a8-010a0baa92f4'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:09:57 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-9372f4a8-9b8f-453a-b7b4-c5627960f4c3 tempest-VolumesListTestJSON-498473273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:09:57 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-9372f4a8-9b8f-453a-b7b4-c5627960f4c3 tempest-VolumesListTestJSON-498473273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:09:57 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-9372f4a8-9b8f-453a-b7b4-c5627960f4c3 tempest-VolumesListTestJSON-498473273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:09:57 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-9372f4a8-9b8f-453a-b7b4-c5627960f4c3 tempest-VolumesListTestJSON-498473273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:09:57 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-9372f4a8-9b8f-453a-b7b4-c5627960f4c3 tempest-VolumesListTestJSON-498473273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:09:57 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-9372f4a8-9b8f-453a-b7b4-c5627960f4c3 tempest-VolumesListTestJSON-498473273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:57 devstack sudo[87301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:09:57 devstack sudo[87301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:57 devstack sudo[87290]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:57 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6a48ddc2-e50e-4cee-ba7c-f26f4aceec8b tempest-GroupsV314Test-2097971262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7f17777-0abe-4a87-884c-69d483f407ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7f17777-0abe-4a87-884c-69d483f407ed.d137dd4e-5cb3-43cc-b791-ddc8d754274e 1G" returned: 0 in 0.570s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:57 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6a48ddc2-e50e-4cee-ba7c-f26f4aceec8b tempest-GroupsV314Test-2097971262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7f17777-0abe-4a87-884c-69d483f407ed -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7f17777-0abe-4a87-884c-69d483f407ed.d137dd4e-5cb3-43cc-b791-ddc8d754274e {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:57 devstack sudo[87303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7f17777-0abe-4a87-884c-69d483f407ed -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7f17777-0abe-4a87-884c-69d483f407ed.d137dd4e-5cb3-43cc-b791-ddc8d754274e
Apr 15 20:09:57 devstack sudo[87303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:57 devstack sudo[87296]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:57 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-552ce88e-4778-4792-b123-cef7303ab96c tempest-VolumesExtendTest-1563095803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_565a23e3-dcfa-4a62-b361-219578b0cd92_b2xqbn4vdevstack@QuobyteHD" returned: 0 in 0.524s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:57 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-552ce88e-4778-4792-b123-cef7303ab96c tempest-VolumesExtendTest-1563095803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:09:57 devstack sudo[87301]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:57 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-9372f4a8-9b8f-453a-b7b4-c5627960f4c3 tempest-VolumesListTestJSON-498473273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.426s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:57 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-9372f4a8-9b8f-453a-b7b4-c5627960f4c3 tempest-VolumesListTestJSON-498473273 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:09:57 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-9372f4a8-9b8f-453a-b7b4-c5627960f4c3 tempest-VolumesListTestJSON-498473273 None] Deleted volume successfully.
Apr 15 20:09:57 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-9372f4a8-9b8f-453a-b7b4-c5627960f4c3 tempest-VolumesListTestJSON-498473273 None] Lock "cinder-e723f9c9-f606-4b32-8768-5729101c4a3e-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:09:57 devstack sudo[87303]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:57 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6a48ddc2-e50e-4cee-ba7c-f26f4aceec8b tempest-GroupsV314Test-2097971262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7f17777-0abe-4a87-884c-69d483f407ed -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7f17777-0abe-4a87-884c-69d483f407ed.d137dd4e-5cb3-43cc-b791-ddc8d754274e" returned: 0 in 0.418s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:57 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-6a48ddc2-e50e-4cee-ba7c-f26f4aceec8b tempest-GroupsV314Test-2097971262 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7f17777-0abe-4a87-884c-69d483f407ed.d137dd4e-5cb3-43cc-b791-ddc8d754274e is being set with open permissions: ugo+rw: NotImplementedError
Apr 15 20:09:57 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6a48ddc2-e50e-4cee-ba7c-f26f4aceec8b tempest-GroupsV314Test-2097971262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7f17777-0abe-4a87-884c-69d483f407ed.d137dd4e-5cb3-43cc-b791-ddc8d754274e {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:57 devstack sudo[87312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7f17777-0abe-4a87-884c-69d483f407ed.d137dd4e-5cb3-43cc-b791-ddc8d754274e
Apr 15 20:09:57 devstack sudo[87312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:58 devstack sudo[87312]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:58 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6a48ddc2-e50e-4cee-ba7c-f26f4aceec8b tempest-GroupsV314Test-2097971262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7f17777-0abe-4a87-884c-69d483f407ed.d137dd4e-5cb3-43cc-b791-ddc8d754274e" returned: 0 in 0.397s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:58 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6a48ddc2-e50e-4cee-ba7c-f26f4aceec8b tempest-GroupsV314Test-2097971262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7f17777-0abe-4a87-884c-69d483f407ed.info {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:58 devstack sudo[87315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7f17777-0abe-4a87-884c-69d483f407ed.info
Apr 15 20:09:58 devstack sudo[87315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:58 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-3b0c032f-1dac-4096-a8b4-b81f0e9ef275 tempest-VolumesListTestJSON-498473273 None] Acquiring lock "cinder-fa3fb278-ff3c-4f77-9fe1-31d805ad5967-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:09:58 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-3b0c032f-1dac-4096-a8b4-b81f0e9ef275 tempest-VolumesListTestJSON-498473273 None] Lock "cinder-fa3fb278-ff3c-4f77-9fe1-31d805ad5967-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:09:58 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-3b0c032f-1dac-4096-a8b4-b81f0e9ef275 tempest-VolumesListTestJSON-498473273 None] Acquiring lock "cinder-quobyte-fa3fb278-ff3c-4f77-9fe1-31d805ad5967" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:09:58 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-3b0c032f-1dac-4096-a8b4-b81f0e9ef275 tempest-VolumesListTestJSON-498473273 None] Lock "cinder-quobyte-fa3fb278-ff3c-4f77-9fe1-31d805ad5967" acquired by "delete_volume" :: waited 0.006s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:09:58 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[648762e0-202d-4478-90ff-0f6e379a3a29]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:09:58 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-3b0c032f-1dac-4096-a8b4-b81f0e9ef275 tempest-VolumesListTestJSON-498473273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-fa3fb278-ff3c-4f77-9fe1-31d805ad5967 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:58 devstack sudo[87317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-fa3fb278-ff3c-4f77-9fe1-31d805ad5967
Apr 15 20:09:58 devstack sudo[87317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:58 devstack sudo[87315]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:58 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6a48ddc2-e50e-4cee-ba7c-f26f4aceec8b tempest-GroupsV314Test-2097971262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7f17777-0abe-4a87-884c-69d483f407ed.info" returned: 0 in 0.434s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:58 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-6a48ddc2-e50e-4cee-ba7c-f26f4aceec8b tempest-GroupsV314Test-2097971262 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7f17777-0abe-4a87-884c-69d483f407ed.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 15 20:09:58 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6a48ddc2-e50e-4cee-ba7c-f26f4aceec8b tempest-GroupsV314Test-2097971262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7f17777-0abe-4a87-884c-69d483f407ed.info {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:58 devstack sudo[87320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7f17777-0abe-4a87-884c-69d483f407ed.info
Apr 15 20:09:58 devstack sudo[87320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:59 devstack sudo[87317]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:59 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-3b0c032f-1dac-4096-a8b4-b81f0e9ef275 tempest-VolumesListTestJSON-498473273 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-fa3fb278-ff3c-4f77-9fe1-31d805ad5967" returned: 0 in 0.459s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:59 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-3b0c032f-1dac-4096-a8b4-b81f0e9ef275 tempest-VolumesListTestJSON-498473273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-fa3fb278-ff3c-4f77-9fe1-31d805ad5967 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:59 devstack sudo[87325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-fa3fb278-ff3c-4f77-9fe1-31d805ad5967
Apr 15 20:09:59 devstack sudo[87325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:59 devstack sudo[87320]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:59 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6a48ddc2-e50e-4cee-ba7c-f26f4aceec8b tempest-GroupsV314Test-2097971262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7f17777-0abe-4a87-884c-69d483f407ed.info" returned: 0 in 0.403s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:59 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-6a48ddc2-e50e-4cee-ba7c-f26f4aceec8b tempest-GroupsV314Test-2097971262 None] Acquiring lock "cinder-quobyte-b9a6939b-9290-43e5-8ba5-69212334ed18" by "_copy_volume_from_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:09:59 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-6a48ddc2-e50e-4cee-ba7c-f26f4aceec8b tempest-GroupsV314Test-2097971262 None] Lock "cinder-quobyte-b9a6939b-9290-43e5-8ba5-69212334ed18" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:09:59 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-6a48ddc2-e50e-4cee-ba7c-f26f4aceec8b tempest-GroupsV314Test-2097971262 None] snapshot: d137dd4e-5cb3-43cc-b791-ddc8d754274e, volume: b9a6939b-9290-43e5-8ba5-69212334ed18,  {{(pid=82646) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 15 20:09:59 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-6a48ddc2-e50e-4cee-ba7c-f26f4aceec8b tempest-GroupsV314Test-2097971262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:09:59 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-6a48ddc2-e50e-4cee-ba7c-f26f4aceec8b tempest-GroupsV314Test-2097971262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:09:59 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-6a48ddc2-e50e-4cee-ba7c-f26f4aceec8b tempest-GroupsV314Test-2097971262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:09:59 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-6a48ddc2-e50e-4cee-ba7c-f26f4aceec8b tempest-GroupsV314Test-2097971262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:09:59 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-6a48ddc2-e50e-4cee-ba7c-f26f4aceec8b tempest-GroupsV314Test-2097971262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:09:59 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f86bcfe-d635-4874-80df-990af75453b0]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:09:59 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6a48ddc2-e50e-4cee-ba7c-f26f4aceec8b tempest-GroupsV314Test-2097971262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7f17777-0abe-4a87-884c-69d483f407ed.d137dd4e-5cb3-43cc-b791-ddc8d754274e {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:59 devstack sudo[87328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7f17777-0abe-4a87-884c-69d483f407ed.d137dd4e-5cb3-43cc-b791-ddc8d754274e
Apr 15 20:09:59 devstack sudo[87328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:59 devstack sudo[87325]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:59 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-3b0c032f-1dac-4096-a8b4-b81f0e9ef275 tempest-VolumesListTestJSON-498473273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-fa3fb278-ff3c-4f77-9fe1-31d805ad5967" returned: 0 in 0.470s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:59 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-3b0c032f-1dac-4096-a8b4-b81f0e9ef275 tempest-VolumesListTestJSON-498473273 None] Lock "cinder-quobyte-fa3fb278-ff3c-4f77-9fe1-31d805ad5967" released by "delete_volume" :: held 0.967s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:09:59 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-3b0c032f-1dac-4096-a8b4-b81f0e9ef275 tempest-VolumesListTestJSON-498473273 None] Created reservations ['33af9d0e-63ea-4ac0-8aa5-6ed9799a4359', 'fab1047d-8091-4fc7-bc94-50c39879a79a', 'c2bd8c47-a528-43c2-a9e0-149cde0f6de6', '27d98105-4728-4315-abb8-64a1b02d11c2'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:09:59 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-3b0c032f-1dac-4096-a8b4-b81f0e9ef275 tempest-VolumesListTestJSON-498473273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:09:59 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-3b0c032f-1dac-4096-a8b4-b81f0e9ef275 tempest-VolumesListTestJSON-498473273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:09:59 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-3b0c032f-1dac-4096-a8b4-b81f0e9ef275 tempest-VolumesListTestJSON-498473273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:09:59 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-3b0c032f-1dac-4096-a8b4-b81f0e9ef275 tempest-VolumesListTestJSON-498473273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:09:59 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-3b0c032f-1dac-4096-a8b4-b81f0e9ef275 tempest-VolumesListTestJSON-498473273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:09:59 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-3b0c032f-1dac-4096-a8b4-b81f0e9ef275 tempest-VolumesListTestJSON-498473273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:59 devstack sudo[87331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:09:59 devstack sudo[87331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:09:59 devstack sudo[87328]: pam_unix(sudo:session): session closed for user root
Apr 15 20:09:59 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6a48ddc2-e50e-4cee-ba7c-f26f4aceec8b tempest-GroupsV314Test-2097971262 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7f17777-0abe-4a87-884c-69d483f407ed.d137dd4e-5cb3-43cc-b791-ddc8d754274e" returned: 0 in 0.568s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:09:59 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-6a48ddc2-e50e-4cee-ba7c-f26f4aceec8b tempest-GroupsV314Test-2097971262 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7f17777-0abe-4a87-884c-69d483f407ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82646) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 20:09:59 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-6a48ddc2-e50e-4cee-ba7c-f26f4aceec8b tempest-GroupsV314Test-2097971262 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7f17777-0abe-4a87-884c-69d483f407ed {{(pid=82646) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 15 20:09:59 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-6a48ddc2-e50e-4cee-ba7c-f26f4aceec8b tempest-GroupsV314Test-2097971262 None] Creating direct copy from snapshot {{(pid=82646) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 15 20:09:59 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b31391d-3eb4-4f52-99de-6e3c5cb92212]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:09:59 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6a48ddc2-e50e-4cee-ba7c-f26f4aceec8b tempest-GroupsV314Test-2097971262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7f17777-0abe-4a87-884c-69d483f407ed {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:09:59 devstack sudo[87336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7f17777-0abe-4a87-884c-69d483f407ed
Apr 15 20:09:59 devstack sudo[87336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:00 devstack sudo[87331]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:00 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-3b0c032f-1dac-4096-a8b4-b81f0e9ef275 tempest-VolumesListTestJSON-498473273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.492s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:00 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-3b0c032f-1dac-4096-a8b4-b81f0e9ef275 tempest-VolumesListTestJSON-498473273 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:10:00 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-3b0c032f-1dac-4096-a8b4-b81f0e9ef275 tempest-VolumesListTestJSON-498473273 None] Deleted volume successfully.
Apr 15 20:10:00 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-3b0c032f-1dac-4096-a8b4-b81f0e9ef275 tempest-VolumesListTestJSON-498473273 None] Lock "cinder-fa3fb278-ff3c-4f77-9fe1-31d805ad5967-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:10:00 devstack sudo[87336]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:00 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6a48ddc2-e50e-4cee-ba7c-f26f4aceec8b tempest-GroupsV314Test-2097971262 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7f17777-0abe-4a87-884c-69d483f407ed" returned: 0 in 0.569s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:00 devstack cinder-volume[82646]: DEBUG cinder.utils [None req-6a48ddc2-e50e-4cee-ba7c-f26f4aceec8b tempest-GroupsV314Test-2097971262 None] Path /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b9a6939b-9290-43e5-8ba5-69212334ed18 not found in is_blk_device check {{(pid=82646) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 15 20:10:00 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6a48ddc2-e50e-4cee-ba7c-f26f4aceec8b tempest-GroupsV314Test-2097971262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7f17777-0abe-4a87-884c-69d483f407ed /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b9a6939b-9290-43e5-8ba5-69212334ed18 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:00 devstack sudo[87342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7f17777-0abe-4a87-884c-69d483f407ed /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b9a6939b-9290-43e5-8ba5-69212334ed18
Apr 15 20:10:00 devstack sudo[87342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:02 devstack sudo[87342]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:02 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6a48ddc2-e50e-4cee-ba7c-f26f4aceec8b tempest-GroupsV314Test-2097971262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7f17777-0abe-4a87-884c-69d483f407ed /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b9a6939b-9290-43e5-8ba5-69212334ed18" returned: 0 in 2.178s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:02 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[10fb7568-4083-41fb-96db-0f4d2f594c21]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:10:02 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6a48ddc2-e50e-4cee-ba7c-f26f4aceec8b tempest-GroupsV314Test-2097971262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7f17777-0abe-4a87-884c-69d483f407ed {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:02 devstack sudo[87354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7f17777-0abe-4a87-884c-69d483f407ed
Apr 15 20:10:02 devstack sudo[87354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:02 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-51681659-a6a1-40db-95c4-70fbcb68de2a tempest-VolumesNegativeTest-356501862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:10:02 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-51681659-a6a1-40db-95c4-70fbcb68de2a tempest-VolumesNegativeTest-356501862 None] Flow 'volume_create_manager' (b21e315e-18d9-4e41-b632-48ed34347406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:10:02 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-51681659-a6a1-40db-95c4-70fbcb68de2a tempest-VolumesNegativeTest-356501862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2fc1df9-3e96-4617-be22-75df3f8d7d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:02 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-51681659-a6a1-40db-95c4-70fbcb68de2a tempest-VolumesNegativeTest-356501862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2fc1df9-3e96-4617-be22-75df3f8d7d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:10:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-760928759',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39b0669a-8718-4d3a-966b-152638f44fb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c37a1b281fd4c7194edd67f0d47ba9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:10:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:10:03Z,use_quota=True,user_id='3309ed0b451249e382c809a7b83dd395',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:02 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-51681659-a6a1-40db-95c4-70fbcb68de2a tempest-VolumesNegativeTest-356501862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcb7e740-bcc9-49e5-b0c0-0eae74a65701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:02 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-51681659-a6a1-40db-95c4-70fbcb68de2a tempest-VolumesNegativeTest-356501862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcb7e740-bcc9-49e5-b0c0-0eae74a65701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:02 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-51681659-a6a1-40db-95c4-70fbcb68de2a tempest-VolumesNegativeTest-356501862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04dfd202-d5ee-4de7-863c-12f2a1ffcd61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:02 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-51681659-a6a1-40db-95c4-70fbcb68de2a tempest-VolumesNegativeTest-356501862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04dfd202-d5ee-4de7-863c-12f2a1ffcd61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39b0669a-8718-4d3a-966b-152638f44fb9', 'volume_name': 'volume-39b0669a-8718-4d3a-966b-152638f44fb9', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:02 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-51681659-a6a1-40db-95c4-70fbcb68de2a tempest-VolumesNegativeTest-356501862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61dc538f-ee20-41e3-b227-57048547efa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:02 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-51681659-a6a1-40db-95c4-70fbcb68de2a tempest-VolumesNegativeTest-356501862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61dc538f-ee20-41e3-b227-57048547efa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:02 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-51681659-a6a1-40db-95c4-70fbcb68de2a tempest-VolumesNegativeTest-356501862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74926fd2-a0d8-426f-94a1-6807bf4680f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:02 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-51681659-a6a1-40db-95c4-70fbcb68de2a tempest-VolumesNegativeTest-356501862 None] Volume 39b0669a-8718-4d3a-966b-152638f44fb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39b0669a-8718-4d3a-966b-152638f44fb9', 'volume_size': 1}
Apr 15 20:10:02 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-51681659-a6a1-40db-95c4-70fbcb68de2a tempest-VolumesNegativeTest-356501862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:10:03 devstack sudo[87354]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:03 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6a48ddc2-e50e-4cee-ba7c-f26f4aceec8b tempest-GroupsV314Test-2097971262 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7f17777-0abe-4a87-884c-69d483f407ed" returned: 0 in 0.586s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:03 devstack cinder-volume[82646]: DEBUG cinder.image.image_utils [None req-6a48ddc2-e50e-4cee-ba7c-f26f4aceec8b tempest-GroupsV314Test-2097971262 None] Image conversion details: src /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7f17777-0abe-4a87-884c-69d483f407ed, size 1024.00 MB, duration 2.18 sec, destination /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b9a6939b-9290-43e5-8ba5-69212334ed18 {{(pid=82646) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 20:10:03 devstack cinder-volume[82646]: INFO cinder.image.image_utils [None req-6a48ddc2-e50e-4cee-ba7c-f26f4aceec8b tempest-GroupsV314Test-2097971262 None] Converted 1024.00 MB image at 470.02 MB/s
Apr 15 20:10:03 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-6a48ddc2-e50e-4cee-ba7c-f26f4aceec8b tempest-GroupsV314Test-2097971262 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b9a6939b-9290-43e5-8ba5-69212334ed18 is being set with open permissions: ugo+rw: NotImplementedError
Apr 15 20:10:03 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6a48ddc2-e50e-4cee-ba7c-f26f4aceec8b tempest-GroupsV314Test-2097971262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b9a6939b-9290-43e5-8ba5-69212334ed18 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:03 devstack sudo[87359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b9a6939b-9290-43e5-8ba5-69212334ed18
Apr 15 20:10:03 devstack sudo[87359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:03 devstack sudo[87359]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:03 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6a48ddc2-e50e-4cee-ba7c-f26f4aceec8b tempest-GroupsV314Test-2097971262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b9a6939b-9290-43e5-8ba5-69212334ed18" returned: 0 in 0.401s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:03 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-6a48ddc2-e50e-4cee-ba7c-f26f4aceec8b tempest-GroupsV314Test-2097971262 None] Lock "cinder-quobyte-b9a6939b-9290-43e5-8ba5-69212334ed18" released by "_copy_volume_from_snapshot" :: held 4.364s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:10:03 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-6a48ddc2-e50e-4cee-ba7c-f26f4aceec8b tempest-GroupsV314Test-2097971262 None] Acquiring lock "cinder-quobyte-d137dd4e-5cb3-43cc-b791-ddc8d754274e" by "_delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:10:03 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-6a48ddc2-e50e-4cee-ba7c-f26f4aceec8b tempest-GroupsV314Test-2097971262 None] Lock "cinder-quobyte-d137dd4e-5cb3-43cc-b791-ddc8d754274e" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:10:03 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-6a48ddc2-e50e-4cee-ba7c-f26f4aceec8b tempest-GroupsV314Test-2097971262 None] Deleting offline snapshot d137dd4e-5cb3-43cc-b791-ddc8d754274e of volume a7f17777-0abe-4a87-884c-69d483f407ed {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 20:10:03 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-6a48ddc2-e50e-4cee-ba7c-f26f4aceec8b tempest-GroupsV314Test-2097971262 None] snapshot_file for this snap is: volume-a7f17777-0abe-4a87-884c-69d483f407ed.d137dd4e-5cb3-43cc-b791-ddc8d754274e {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 20:10:03 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2882ea3-bf9f-44f5-8968-96aaaf83199e]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:10:03 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6a48ddc2-e50e-4cee-ba7c-f26f4aceec8b tempest-GroupsV314Test-2097971262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7f17777-0abe-4a87-884c-69d483f407ed.d137dd4e-5cb3-43cc-b791-ddc8d754274e {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:03 devstack sudo[87362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7f17777-0abe-4a87-884c-69d483f407ed.d137dd4e-5cb3-43cc-b791-ddc8d754274e
Apr 15 20:10:03 devstack sudo[87362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:04 devstack sudo[87362]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:04 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6a48ddc2-e50e-4cee-ba7c-f26f4aceec8b tempest-GroupsV314Test-2097971262 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7f17777-0abe-4a87-884c-69d483f407ed.d137dd4e-5cb3-43cc-b791-ddc8d754274e" returned: 0 in 0.450s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:04 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-6a48ddc2-e50e-4cee-ba7c-f26f4aceec8b tempest-GroupsV314Test-2097971262 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7f17777-0abe-4a87-884c-69d483f407ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82646) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 20:10:04 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e862ee-875e-4964-9b6c-2865240f868f]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:10:04 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6a48ddc2-e50e-4cee-ba7c-f26f4aceec8b tempest-GroupsV314Test-2097971262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7f17777-0abe-4a87-884c-69d483f407ed {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:04 devstack sudo[87367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7f17777-0abe-4a87-884c-69d483f407ed
Apr 15 20:10:04 devstack sudo[87367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:04 devstack sudo[87367]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:04 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6a48ddc2-e50e-4cee-ba7c-f26f4aceec8b tempest-GroupsV314Test-2097971262 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7f17777-0abe-4a87-884c-69d483f407ed" returned: 0 in 0.446s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:04 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6a48ddc2-e50e-4cee-ba7c-f26f4aceec8b tempest-GroupsV314Test-2097971262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7f17777-0abe-4a87-884c-69d483f407ed.d137dd4e-5cb3-43cc-b791-ddc8d754274e {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:04 devstack sudo[87372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7f17777-0abe-4a87-884c-69d483f407ed.d137dd4e-5cb3-43cc-b791-ddc8d754274e
Apr 15 20:10:04 devstack sudo[87372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:04 devstack sudo[87372]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:04 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6a48ddc2-e50e-4cee-ba7c-f26f4aceec8b tempest-GroupsV314Test-2097971262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7f17777-0abe-4a87-884c-69d483f407ed.d137dd4e-5cb3-43cc-b791-ddc8d754274e" returned: 0 in 0.441s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:04 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6a48ddc2-e50e-4cee-ba7c-f26f4aceec8b tempest-GroupsV314Test-2097971262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7f17777-0abe-4a87-884c-69d483f407ed.d137dd4e-5cb3-43cc-b791-ddc8d754274e {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:04 devstack sudo[87377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7f17777-0abe-4a87-884c-69d483f407ed.d137dd4e-5cb3-43cc-b791-ddc8d754274e
Apr 15 20:10:04 devstack sudo[87377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:05 devstack sudo[87377]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:05 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6a48ddc2-e50e-4cee-ba7c-f26f4aceec8b tempest-GroupsV314Test-2097971262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7f17777-0abe-4a87-884c-69d483f407ed.d137dd4e-5cb3-43cc-b791-ddc8d754274e" returned: 0 in 0.385s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:05 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-6a48ddc2-e50e-4cee-ba7c-f26f4aceec8b tempest-GroupsV314Test-2097971262 None] Lock "cinder-quobyte-d137dd4e-5cb3-43cc-b791-ddc8d754274e" released by "_delete_snapshot" :: held 1.764s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:10:05 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-6a48ddc2-e50e-4cee-ba7c-f26f4aceec8b tempest-GroupsV314Test-2097971262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.980s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:10:05 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-e3402c5c-fbb2-465c-a161-77b88ae34b9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.020s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:10:05 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-e3402c5c-fbb2-465c-a161-77b88ae34b9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Creating offline snapshot d4bd4bff-16df-40a3-82ac-93997ef69cc7 of volume 95142a00-f940-4dc8-9f7f-432818503ee0 {{(pid=82646) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 20:10:05 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f49fc09-38d0-401b-b07b-f7e750cc2cd1]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:10:05 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e3402c5c-fbb2-465c-a161-77b88ae34b9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95142a00-f940-4dc8-9f7f-432818503ee0 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:05 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-6a48ddc2-e50e-4cee-ba7c-f26f4aceec8b tempest-GroupsV314Test-2097971262 None] Create group from source-group-4962fee6-efd6-498c-ba0c-18cce1d5ff26 completed successfully.
Apr 15 20:10:05 devstack sudo[87380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95142a00-f940-4dc8-9f7f-432818503ee0
Apr 15 20:10:05 devstack sudo[87380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:05 devstack sudo[87380]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:05 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e3402c5c-fbb2-465c-a161-77b88ae34b9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95142a00-f940-4dc8-9f7f-432818503ee0" returned: 0 in 0.464s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:05 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e3402c5c-fbb2-465c-a161-77b88ae34b9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95142a00-f940-4dc8-9f7f-432818503ee0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95142a00-f940-4dc8-9f7f-432818503ee0.d4bd4bff-16df-40a3-82ac-93997ef69cc7 1G {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:05 devstack sudo[87385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95142a00-f940-4dc8-9f7f-432818503ee0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95142a00-f940-4dc8-9f7f-432818503ee0.d4bd4bff-16df-40a3-82ac-93997ef69cc7 1G
Apr 15 20:10:05 devstack sudo[87385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:06 devstack sudo[87385]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:06 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e3402c5c-fbb2-465c-a161-77b88ae34b9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95142a00-f940-4dc8-9f7f-432818503ee0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95142a00-f940-4dc8-9f7f-432818503ee0.d4bd4bff-16df-40a3-82ac-93997ef69cc7 1G" returned: 0 in 0.520s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:06 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e3402c5c-fbb2-465c-a161-77b88ae34b9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95142a00-f940-4dc8-9f7f-432818503ee0 -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95142a00-f940-4dc8-9f7f-432818503ee0.d4bd4bff-16df-40a3-82ac-93997ef69cc7 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:06 devstack sudo[87391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95142a00-f940-4dc8-9f7f-432818503ee0 -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95142a00-f940-4dc8-9f7f-432818503ee0.d4bd4bff-16df-40a3-82ac-93997ef69cc7
Apr 15 20:10:06 devstack sudo[87391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:06 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-ed24dc1e-f1a8-4b1d-9ae5-df17d4b1b588 tempest-GroupsV314Test-2097971262 None] Acquiring lock "cinder-quobyte-b9a6939b-9290-43e5-8ba5-69212334ed18" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:10:06 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-ed24dc1e-f1a8-4b1d-9ae5-df17d4b1b588 tempest-GroupsV314Test-2097971262 None] Lock "cinder-quobyte-b9a6939b-9290-43e5-8ba5-69212334ed18" acquired by "delete_volume" :: waited 0.009s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:10:06 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[6202b98d-3cdf-4a6c-b4db-ff1c76cb2851]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:10:06 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-ed24dc1e-f1a8-4b1d-9ae5-df17d4b1b588 tempest-GroupsV314Test-2097971262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b9a6939b-9290-43e5-8ba5-69212334ed18 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:06 devstack sudo[87393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b9a6939b-9290-43e5-8ba5-69212334ed18
Apr 15 20:10:06 devstack sudo[87393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:06 devstack sudo[87391]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:06 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e3402c5c-fbb2-465c-a161-77b88ae34b9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95142a00-f940-4dc8-9f7f-432818503ee0 -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95142a00-f940-4dc8-9f7f-432818503ee0.d4bd4bff-16df-40a3-82ac-93997ef69cc7" returned: 0 in 0.494s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:06 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-e3402c5c-fbb2-465c-a161-77b88ae34b9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95142a00-f940-4dc8-9f7f-432818503ee0.d4bd4bff-16df-40a3-82ac-93997ef69cc7 is being set with open permissions: ugo+rw
Apr 15 20:10:06 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e3402c5c-fbb2-465c-a161-77b88ae34b9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95142a00-f940-4dc8-9f7f-432818503ee0.d4bd4bff-16df-40a3-82ac-93997ef69cc7 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:06 devstack sudo[87398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95142a00-f940-4dc8-9f7f-432818503ee0.d4bd4bff-16df-40a3-82ac-93997ef69cc7
Apr 15 20:10:06 devstack sudo[87398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:07 devstack sudo[87393]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:07 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-ed24dc1e-f1a8-4b1d-9ae5-df17d4b1b588 tempest-GroupsV314Test-2097971262 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b9a6939b-9290-43e5-8ba5-69212334ed18" returned: 0 in 0.567s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:07 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-ed24dc1e-f1a8-4b1d-9ae5-df17d4b1b588 tempest-GroupsV314Test-2097971262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b9a6939b-9290-43e5-8ba5-69212334ed18 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:07 devstack sudo[87403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b9a6939b-9290-43e5-8ba5-69212334ed18
Apr 15 20:10:07 devstack sudo[87403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:07 devstack sudo[87398]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:07 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e3402c5c-fbb2-465c-a161-77b88ae34b9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95142a00-f940-4dc8-9f7f-432818503ee0.d4bd4bff-16df-40a3-82ac-93997ef69cc7" returned: 0 in 0.426s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:07 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e3402c5c-fbb2-465c-a161-77b88ae34b9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95142a00-f940-4dc8-9f7f-432818503ee0.info {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:07 devstack sudo[87406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95142a00-f940-4dc8-9f7f-432818503ee0.info
Apr 15 20:10:07 devstack sudo[87406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:07 devstack sudo[87403]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:07 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-ed24dc1e-f1a8-4b1d-9ae5-df17d4b1b588 tempest-GroupsV314Test-2097971262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b9a6939b-9290-43e5-8ba5-69212334ed18" returned: 0 in 0.426s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:07 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-ed24dc1e-f1a8-4b1d-9ae5-df17d4b1b588 tempest-GroupsV314Test-2097971262 None] Lock "cinder-quobyte-b9a6939b-9290-43e5-8ba5-69212334ed18" released by "delete_volume" :: held 1.017s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:10:07 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-ed24dc1e-f1a8-4b1d-9ae5-df17d4b1b588 tempest-GroupsV314Test-2097971262 None] Created reservations ['3138419b-1b55-4902-a864-eeb563941555'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:10:07 devstack cinder-volume[82646]: WARNING cinder.quota [None req-ed24dc1e-f1a8-4b1d-9ae5-df17d4b1b588 tempest-GroupsV314Test-2097971262 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-187896306 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-187896306, it is now deprecated. Please use the default quota class for default quota.
Apr 15 20:10:07 devstack cinder-volume[82646]: WARNING cinder.quota [None req-ed24dc1e-f1a8-4b1d-9ae5-df17d4b1b588 tempest-GroupsV314Test-2097971262 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-187896306 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-187896306, it is now deprecated. Please use the default quota class for default quota.
Apr 15 20:10:07 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-ed24dc1e-f1a8-4b1d-9ae5-df17d4b1b588 tempest-GroupsV314Test-2097971262 None] Created reservations ['5e397006-d309-4818-a770-9a45bf96c6fe', 'f2be2129-b7d7-441e-872b-49c85ed6a991', 'd67f623a-4fa8-4e2c-84ed-e13040839c24', '4ff1e909-6ffe-44d7-bb26-db892ec5651f'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:10:07 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-ed24dc1e-f1a8-4b1d-9ae5-df17d4b1b588 tempest-GroupsV314Test-2097971262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:10:07 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-ed24dc1e-f1a8-4b1d-9ae5-df17d4b1b588 tempest-GroupsV314Test-2097971262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:10:07 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-ed24dc1e-f1a8-4b1d-9ae5-df17d4b1b588 tempest-GroupsV314Test-2097971262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:10:07 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-ed24dc1e-f1a8-4b1d-9ae5-df17d4b1b588 tempest-GroupsV314Test-2097971262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:10:07 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-ed24dc1e-f1a8-4b1d-9ae5-df17d4b1b588 tempest-GroupsV314Test-2097971262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:10:07 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-ed24dc1e-f1a8-4b1d-9ae5-df17d4b1b588 tempest-GroupsV314Test-2097971262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:07 devstack sudo[87409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:10:07 devstack sudo[87409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:07 devstack sudo[87406]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:07 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e3402c5c-fbb2-465c-a161-77b88ae34b9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95142a00-f940-4dc8-9f7f-432818503ee0.info" returned: 0 in 0.462s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:07 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-e3402c5c-fbb2-465c-a161-77b88ae34b9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95142a00-f940-4dc8-9f7f-432818503ee0.info is being set with open permissions: ugo+rw
Apr 15 20:10:07 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e3402c5c-fbb2-465c-a161-77b88ae34b9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95142a00-f940-4dc8-9f7f-432818503ee0.info {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:07 devstack sudo[87412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95142a00-f940-4dc8-9f7f-432818503ee0.info
Apr 15 20:10:07 devstack sudo[87412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:08 devstack sudo[87409]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:08 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-ed24dc1e-f1a8-4b1d-9ae5-df17d4b1b588 tempest-GroupsV314Test-2097971262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.415s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:08 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-ed24dc1e-f1a8-4b1d-9ae5-df17d4b1b588 tempest-GroupsV314Test-2097971262 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:10:08 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-ed24dc1e-f1a8-4b1d-9ae5-df17d4b1b588 tempest-GroupsV314Test-2097971262 None] Delete group completed successfully.
Apr 15 20:10:08 devstack sudo[87412]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:08 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e3402c5c-fbb2-465c-a161-77b88ae34b9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95142a00-f940-4dc8-9f7f-432818503ee0.info" returned: 0 in 0.398s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:08 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-e3402c5c-fbb2-465c-a161-77b88ae34b9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.818s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:10:08 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-552ce88e-4778-4792-b123-cef7303ab96c tempest-VolumesExtendTest-1563095803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.469s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:10:08 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-552ce88e-4778-4792-b123-cef7303ab96c tempest-VolumesExtendTest-1563095803 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:09:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-189743868',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e01c1321-f397-494f-9109-a5a2674b9d7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acd6766cf57c4b06915de0f14b3188be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:09:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:09:56Z,use_quota=True,user_id='876149b72a1e46898ab8be6279506c33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:10:08 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-552ce88e-4778-4792-b123-cef7303ab96c tempest-VolumesExtendTest-1563095803 None] Creating volume e01c1321-f397-494f-9109-a5a2674b9d7d {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:10:08 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-552ce88e-4778-4792-b123-cef7303ab96c tempest-VolumesExtendTest-1563095803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:10:08 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-552ce88e-4778-4792-b123-cef7303ab96c tempest-VolumesExtendTest-1563095803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:10:08 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-552ce88e-4778-4792-b123-cef7303ab96c tempest-VolumesExtendTest-1563095803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:10:08 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-552ce88e-4778-4792-b123-cef7303ab96c tempest-VolumesExtendTest-1563095803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:10:08 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-552ce88e-4778-4792-b123-cef7303ab96c tempest-VolumesExtendTest-1563095803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:10:08 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-552ce88e-4778-4792-b123-cef7303ab96c tempest-VolumesExtendTest-1563095803 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:10:08 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-552ce88e-4778-4792-b123-cef7303ab96c tempest-VolumesExtendTest-1563095803 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:10:08 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-552ce88e-4778-4792-b123-cef7303ab96c tempest-VolumesExtendTest-1563095803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e01c1321-f397-494f-9109-a5a2674b9d7d 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:08 devstack sudo[87416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e01c1321-f397-494f-9109-a5a2674b9d7d 1073741824
Apr 15 20:10:08 devstack sudo[87416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:08 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-e3402c5c-fbb2-465c-a161-77b88ae34b9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Create snapshot completed successfully
Apr 15 20:10:08 devstack sudo[87416]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:08 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-552ce88e-4778-4792-b123-cef7303ab96c tempest-VolumesExtendTest-1563095803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e01c1321-f397-494f-9109-a5a2674b9d7d 1073741824" returned: 0 in 0.515s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:08 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-552ce88e-4778-4792-b123-cef7303ab96c tempest-VolumesExtendTest-1563095803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e01c1321-f397-494f-9109-a5a2674b9d7d {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:08 devstack sudo[87421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e01c1321-f397-494f-9109-a5a2674b9d7d
Apr 15 20:10:08 devstack sudo[87421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:08 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-cb8a1efc-abff-4366-ad1d-ebc4e93ce6ae tempest-GroupsV314Test-2097971262 None] Acquiring lock "cinder-quobyte-a7f17777-0abe-4a87-884c-69d483f407ed" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:10:08 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-cb8a1efc-abff-4366-ad1d-ebc4e93ce6ae tempest-GroupsV314Test-2097971262 None] Lock "cinder-quobyte-a7f17777-0abe-4a87-884c-69d483f407ed" acquired by "delete_volume" :: waited 0.011s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:10:08 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc904fe7-18c6-414e-835c-02538abda7c5]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:10:08 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-cb8a1efc-abff-4366-ad1d-ebc4e93ce6ae tempest-GroupsV314Test-2097971262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7f17777-0abe-4a87-884c-69d483f407ed {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:08 devstack sudo[87423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7f17777-0abe-4a87-884c-69d483f407ed
Apr 15 20:10:08 devstack sudo[87423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:09 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-17452b96-0c3d-4205-959f-0c979939a0ef tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Acquiring lock "cinder-d4bd4bff-16df-40a3-82ac-93997ef69cc7-delete_snapshot" by "delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:10:09 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-17452b96-0c3d-4205-959f-0c979939a0ef tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Lock "cinder-d4bd4bff-16df-40a3-82ac-93997ef69cc7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:10:09 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-17452b96-0c3d-4205-959f-0c979939a0ef tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Acquiring lock "cinder-quobyte-95142a00-f940-4dc8-9f7f-432818503ee0" by "delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:10:09 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-17452b96-0c3d-4205-959f-0c979939a0ef tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Lock "cinder-quobyte-95142a00-f940-4dc8-9f7f-432818503ee0" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:10:09 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-17452b96-0c3d-4205-959f-0c979939a0ef tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Acquiring lock "cinder-quobyte-d4bd4bff-16df-40a3-82ac-93997ef69cc7" by "_delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:10:09 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-17452b96-0c3d-4205-959f-0c979939a0ef tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Lock "cinder-quobyte-d4bd4bff-16df-40a3-82ac-93997ef69cc7" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:10:09 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-17452b96-0c3d-4205-959f-0c979939a0ef tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Deleting offline snapshot d4bd4bff-16df-40a3-82ac-93997ef69cc7 of volume 95142a00-f940-4dc8-9f7f-432818503ee0 {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 20:10:09 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-17452b96-0c3d-4205-959f-0c979939a0ef tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] snapshot_file for this snap is: volume-95142a00-f940-4dc8-9f7f-432818503ee0.d4bd4bff-16df-40a3-82ac-93997ef69cc7 {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 20:10:09 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[4228202e-1a97-445f-8241-490a15d0fea6]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:10:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-17452b96-0c3d-4205-959f-0c979939a0ef tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95142a00-f940-4dc8-9f7f-432818503ee0.d4bd4bff-16df-40a3-82ac-93997ef69cc7 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:09 devstack sudo[87425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95142a00-f940-4dc8-9f7f-432818503ee0.d4bd4bff-16df-40a3-82ac-93997ef69cc7
Apr 15 20:10:09 devstack sudo[87425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:09 devstack sudo[87421]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-552ce88e-4778-4792-b123-cef7303ab96c tempest-VolumesExtendTest-1563095803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e01c1321-f397-494f-9109-a5a2674b9d7d" returned: 0 in 0.470s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:09 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-552ce88e-4778-4792-b123-cef7303ab96c tempest-VolumesExtendTest-1563095803 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:10:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-552ce88e-4778-4792-b123-cef7303ab96c tempest-VolumesExtendTest-1563095803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:10:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-51681659-a6a1-40db-95c4-70fbcb68de2a tempest-VolumesNegativeTest-356501862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.385s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:10:09 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-51681659-a6a1-40db-95c4-70fbcb68de2a tempest-VolumesNegativeTest-356501862 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:10:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-760928759',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39b0669a-8718-4d3a-966b-152638f44fb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c37a1b281fd4c7194edd67f0d47ba9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:10:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:10:03Z,use_quota=True,user_id='3309ed0b451249e382c809a7b83dd395',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:10:09 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-51681659-a6a1-40db-95c4-70fbcb68de2a tempest-VolumesNegativeTest-356501862 None] Creating volume 39b0669a-8718-4d3a-966b-152638f44fb9 {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:10:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-51681659-a6a1-40db-95c4-70fbcb68de2a tempest-VolumesNegativeTest-356501862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:10:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-51681659-a6a1-40db-95c4-70fbcb68de2a tempest-VolumesNegativeTest-356501862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:10:09 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-51681659-a6a1-40db-95c4-70fbcb68de2a tempest-VolumesNegativeTest-356501862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:10:09 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-51681659-a6a1-40db-95c4-70fbcb68de2a tempest-VolumesNegativeTest-356501862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:10:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-51681659-a6a1-40db-95c4-70fbcb68de2a tempest-VolumesNegativeTest-356501862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:10:09 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-51681659-a6a1-40db-95c4-70fbcb68de2a tempest-VolumesNegativeTest-356501862 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:10:09 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-51681659-a6a1-40db-95c4-70fbcb68de2a tempest-VolumesNegativeTest-356501862 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:10:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-51681659-a6a1-40db-95c4-70fbcb68de2a tempest-VolumesNegativeTest-356501862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-39b0669a-8718-4d3a-966b-152638f44fb9 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:09 devstack cinder-volume[82646]: DEBUG cinder.volume.volume_utils [None req-552ce88e-4778-4792-b123-cef7303ab96c tempest-VolumesExtendTest-1563095803 None] Attempting download of 565a23e3-dcfa-4a62-b361-219578b0cd92 ((None, [{'url': 'file:///opt/stack/data/glance/images/565a23e3-dcfa-4a62-b361-219578b0cd92', 'metadata': {}}])) to volume e01c1321-f397-494f-9109-a5a2674b9d7d. {{(pid=82646) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 15 20:10:09 devstack sudo[87428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-39b0669a-8718-4d3a-966b-152638f44fb9 1073741824
Apr 15 20:10:09 devstack sudo[87428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:09 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db80c45-2817-4c9e-9f69-1e00525022bf]: (4, 'raw') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:10:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-552ce88e-4778-4792-b123-cef7303ab96c tempest-VolumesExtendTest-1563095803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_565a23e3-dcfa-4a62-b361-219578b0cd92_oic751p8 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:09 devstack sudo[87423]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:09 devstack sudo[87433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_565a23e3-dcfa-4a62-b361-219578b0cd92_oic751p8
Apr 15 20:10:09 devstack sudo[87433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-cb8a1efc-abff-4366-ad1d-ebc4e93ce6ae tempest-GroupsV314Test-2097971262 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7f17777-0abe-4a87-884c-69d483f407ed" returned: 0 in 0.544s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-cb8a1efc-abff-4366-ad1d-ebc4e93ce6ae tempest-GroupsV314Test-2097971262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7f17777-0abe-4a87-884c-69d483f407ed {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:09 devstack sudo[87435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7f17777-0abe-4a87-884c-69d483f407ed
Apr 15 20:10:09 devstack sudo[87435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:09 devstack sudo[87425]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-17452b96-0c3d-4205-959f-0c979939a0ef tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95142a00-f940-4dc8-9f7f-432818503ee0.d4bd4bff-16df-40a3-82ac-93997ef69cc7" returned: 0 in 0.497s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:09 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-17452b96-0c3d-4205-959f-0c979939a0ef tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95142a00-f940-4dc8-9f7f-432818503ee0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82646) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 20:10:09 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[168908ba-c190-48b1-8726-084c6ab0d12a]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:10:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-17452b96-0c3d-4205-959f-0c979939a0ef tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95142a00-f940-4dc8-9f7f-432818503ee0 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:09 devstack sudo[87440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95142a00-f940-4dc8-9f7f-432818503ee0
Apr 15 20:10:09 devstack sudo[87440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:09 devstack sudo[87428]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-51681659-a6a1-40db-95c4-70fbcb68de2a tempest-VolumesNegativeTest-356501862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-39b0669a-8718-4d3a-966b-152638f44fb9 1073741824" returned: 0 in 0.523s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-51681659-a6a1-40db-95c4-70fbcb68de2a tempest-VolumesNegativeTest-356501862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-39b0669a-8718-4d3a-966b-152638f44fb9 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:09 devstack sudo[87448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-39b0669a-8718-4d3a-966b-152638f44fb9
Apr 15 20:10:09 devstack sudo[87448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:09 devstack sudo[87435]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-cb8a1efc-abff-4366-ad1d-ebc4e93ce6ae tempest-GroupsV314Test-2097971262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7f17777-0abe-4a87-884c-69d483f407ed" returned: 0 in 0.455s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:09 devstack sudo[87433]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:09 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-cb8a1efc-abff-4366-ad1d-ebc4e93ce6ae tempest-GroupsV314Test-2097971262 None] Lock "cinder-quobyte-a7f17777-0abe-4a87-884c-69d483f407ed" released by "delete_volume" :: held 1.035s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:10:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-552ce88e-4778-4792-b123-cef7303ab96c tempest-VolumesExtendTest-1563095803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_565a23e3-dcfa-4a62-b361-219578b0cd92_oic751p8" returned: 0 in 0.542s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-552ce88e-4778-4792-b123-cef7303ab96c tempest-VolumesExtendTest-1563095803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_565a23e3-dcfa-4a62-b361-219578b0cd92_oic751p8 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:09 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-cb8a1efc-abff-4366-ad1d-ebc4e93ce6ae tempest-GroupsV314Test-2097971262 None] Created reservations ['5f41aec2-17c4-4029-a875-b90dc92fe47e'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:10:09 devstack sudo[87450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_565a23e3-dcfa-4a62-b361-219578b0cd92_oic751p8
Apr 15 20:10:09 devstack sudo[87450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:09 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-cb8a1efc-abff-4366-ad1d-ebc4e93ce6ae tempest-GroupsV314Test-2097971262 None] Created reservations ['40602ea5-2943-4517-9b78-43310e495d21', '882cf444-65dd-47a3-b513-8316522a850c', '56869a71-84e5-4d46-8ba7-e3415f271410', '52feb8db-4fbd-4e05-9af0-edde685ec5e7'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:10:10 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-cb8a1efc-abff-4366-ad1d-ebc4e93ce6ae tempest-GroupsV314Test-2097971262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:10:10 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-cb8a1efc-abff-4366-ad1d-ebc4e93ce6ae tempest-GroupsV314Test-2097971262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:10:10 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-cb8a1efc-abff-4366-ad1d-ebc4e93ce6ae tempest-GroupsV314Test-2097971262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:10:10 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-cb8a1efc-abff-4366-ad1d-ebc4e93ce6ae tempest-GroupsV314Test-2097971262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:10:10 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-cb8a1efc-abff-4366-ad1d-ebc4e93ce6ae tempest-GroupsV314Test-2097971262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:10:10 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-cb8a1efc-abff-4366-ad1d-ebc4e93ce6ae tempest-GroupsV314Test-2097971262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:10 devstack sudo[87455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:10:10 devstack sudo[87455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:10 devstack sudo[87440]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:10 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-17452b96-0c3d-4205-959f-0c979939a0ef tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95142a00-f940-4dc8-9f7f-432818503ee0" returned: 0 in 0.518s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:10 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-17452b96-0c3d-4205-959f-0c979939a0ef tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95142a00-f940-4dc8-9f7f-432818503ee0.d4bd4bff-16df-40a3-82ac-93997ef69cc7 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:10 devstack sudo[87457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95142a00-f940-4dc8-9f7f-432818503ee0.d4bd4bff-16df-40a3-82ac-93997ef69cc7
Apr 15 20:10:10 devstack sudo[87457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:10 devstack sudo[87448]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:10 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-51681659-a6a1-40db-95c4-70fbcb68de2a tempest-VolumesNegativeTest-356501862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-39b0669a-8718-4d3a-966b-152638f44fb9" returned: 0 in 0.435s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:10 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-51681659-a6a1-40db-95c4-70fbcb68de2a tempest-VolumesNegativeTest-356501862 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:10:10 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-51681659-a6a1-40db-95c4-70fbcb68de2a tempest-VolumesNegativeTest-356501862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:10:10 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-51681659-a6a1-40db-95c4-70fbcb68de2a tempest-VolumesNegativeTest-356501862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74926fd2-a0d8-426f-94a1-6807bf4680f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39b0669a-8718-4d3a-966b-152638f44fb9', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:10 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-51681659-a6a1-40db-95c4-70fbcb68de2a tempest-VolumesNegativeTest-356501862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e276c420-de09-4685-a0a0-17e6e4955cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:10 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-51681659-a6a1-40db-95c4-70fbcb68de2a tempest-VolumesNegativeTest-356501862 None] Volume volume-39b0669a-8718-4d3a-966b-152638f44fb9 (39b0669a-8718-4d3a-966b-152638f44fb9): created successfully
Apr 15 20:10:10 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-51681659-a6a1-40db-95c4-70fbcb68de2a tempest-VolumesNegativeTest-356501862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e276c420-de09-4685-a0a0-17e6e4955cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:10 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-51681659-a6a1-40db-95c4-70fbcb68de2a tempest-VolumesNegativeTest-356501862 None] Flow 'volume_create_manager' (b21e315e-18d9-4e41-b632-48ed34347406) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:10:10 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-51681659-a6a1-40db-95c4-70fbcb68de2a tempest-VolumesNegativeTest-356501862 None] Created volume successfully.
Apr 15 20:10:10 devstack sudo[87450]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:10 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-552ce88e-4778-4792-b123-cef7303ab96c tempest-VolumesExtendTest-1563095803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_565a23e3-dcfa-4a62-b361-219578b0cd92_oic751p8" returned: 1 in 0.578s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:10 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-552ce88e-4778-4792-b123-cef7303ab96c tempest-VolumesExtendTest-1563095803 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_565a23e3-dcfa-4a62-b361-219578b0cd92_oic751p8' failed. Not Retrying. {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 20:10:10 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0fa374-d844-4e79-8806-edc8d59d4128]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:10:10 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-552ce88e-4778-4792-b123-cef7303ab96c tempest-VolumesExtendTest-1563095803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_565a23e3-dcfa-4a62-b361-219578b0cd92_b2xqbn4vdevstack@QuobyteHD {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:10 devstack sudo[87455]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:10 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-cb8a1efc-abff-4366-ad1d-ebc4e93ce6ae tempest-GroupsV314Test-2097971262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.458s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:10 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-cb8a1efc-abff-4366-ad1d-ebc4e93ce6ae tempest-GroupsV314Test-2097971262 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:10:10 devstack sudo[87463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_565a23e3-dcfa-4a62-b361-219578b0cd92_b2xqbn4vdevstack@QuobyteHD
Apr 15 20:10:10 devstack sudo[87463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:10 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-cb8a1efc-abff-4366-ad1d-ebc4e93ce6ae tempest-GroupsV314Test-2097971262 None] Delete group completed successfully.
Apr 15 20:10:10 devstack sudo[87457]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:10 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-17452b96-0c3d-4205-959f-0c979939a0ef tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95142a00-f940-4dc8-9f7f-432818503ee0.d4bd4bff-16df-40a3-82ac-93997ef69cc7" returned: 0 in 0.438s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:10 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-17452b96-0c3d-4205-959f-0c979939a0ef tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95142a00-f940-4dc8-9f7f-432818503ee0.d4bd4bff-16df-40a3-82ac-93997ef69cc7 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:10 devstack sudo[87468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95142a00-f940-4dc8-9f7f-432818503ee0.d4bd4bff-16df-40a3-82ac-93997ef69cc7
Apr 15 20:10:10 devstack sudo[87468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:10 devstack sudo[87463]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:10 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-552ce88e-4778-4792-b123-cef7303ab96c tempest-VolumesExtendTest-1563095803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_565a23e3-dcfa-4a62-b361-219578b0cd92_b2xqbn4vdevstack@QuobyteHD" returned: 0 in 0.463s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:10 devstack cinder-volume[82646]: DEBUG cinder.image.image_utils [None req-552ce88e-4778-4792-b123-cef7303ab96c tempest-VolumesExtendTest-1563095803 None] 565a23e3-dcfa-4a62-b361-219578b0cd92 was qcow2, converting to raw {{(pid=82646) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 15 20:10:10 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-552ce88e-4778-4792-b123-cef7303ab96c tempest-VolumesExtendTest-1563095803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_565a23e3-dcfa-4a62-b361-219578b0cd92_b2xqbn4vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e01c1321-f397-494f-9109-a5a2674b9d7d {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:10 devstack sudo[87474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_565a23e3-dcfa-4a62-b361-219578b0cd92_b2xqbn4vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e01c1321-f397-494f-9109-a5a2674b9d7d
Apr 15 20:10:10 devstack sudo[87474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:10 devstack sudo[87468]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:10 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-17452b96-0c3d-4205-959f-0c979939a0ef tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95142a00-f940-4dc8-9f7f-432818503ee0.d4bd4bff-16df-40a3-82ac-93997ef69cc7" returned: 0 in 0.419s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:11 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-17452b96-0c3d-4205-959f-0c979939a0ef tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Lock "cinder-quobyte-d4bd4bff-16df-40a3-82ac-93997ef69cc7" released by "_delete_snapshot" :: held 1.929s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:10:11 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-17452b96-0c3d-4205-959f-0c979939a0ef tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Lock "cinder-quobyte-95142a00-f940-4dc8-9f7f-432818503ee0" released by "delete_snapshot" :: held 1.941s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:10:11 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-17452b96-0c3d-4205-959f-0c979939a0ef tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Created reservations ['a7070b99-a3fc-4143-835c-236d76ef2a94', '18ccc812-42fc-4ad7-8c83-2aa65f2ce7c6', '22cd7eb4-8a2d-4f6f-8d46-4f01c10f4360', '9cd35324-11d3-4395-ada0-9d14c0d8e1c5'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:10:11 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-17452b96-0c3d-4205-959f-0c979939a0ef tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Delete snapshot completed successfully.
Apr 15 20:10:11 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-17452b96-0c3d-4205-959f-0c979939a0ef tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Lock "cinder-d4bd4bff-16df-40a3-82ac-93997ef69cc7-delete_snapshot" released by "delete_snapshot" :: held 2.052s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:10:11 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-ce043269-e2f1-448c-99ea-6c6b72093765 tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Acquiring lock "cinder-95142a00-f940-4dc8-9f7f-432818503ee0-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:10:11 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-ce043269-e2f1-448c-99ea-6c6b72093765 tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Lock "cinder-95142a00-f940-4dc8-9f7f-432818503ee0-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:10:11 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-ce043269-e2f1-448c-99ea-6c6b72093765 tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Acquiring lock "cinder-quobyte-95142a00-f940-4dc8-9f7f-432818503ee0" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:10:11 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-ce043269-e2f1-448c-99ea-6c6b72093765 tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Lock "cinder-quobyte-95142a00-f940-4dc8-9f7f-432818503ee0" acquired by "delete_volume" :: waited 0.014s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:10:11 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c1d101-dc29-41e8-80a4-7af919da799b]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:10:11 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-ce043269-e2f1-448c-99ea-6c6b72093765 tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95142a00-f940-4dc8-9f7f-432818503ee0 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:11 devstack sudo[87477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95142a00-f940-4dc8-9f7f-432818503ee0
Apr 15 20:10:11 devstack sudo[87477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:12 devstack sudo[87474]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:12 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-552ce88e-4778-4792-b123-cef7303ab96c tempest-VolumesExtendTest-1563095803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_565a23e3-dcfa-4a62-b361-219578b0cd92_b2xqbn4vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e01c1321-f397-494f-9109-a5a2674b9d7d" returned: 0 in 1.288s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:12 devstack cinder-volume[82646]: DEBUG cinder.image.image_utils [None req-552ce88e-4778-4792-b123-cef7303ab96c tempest-VolumesExtendTest-1563095803 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_565a23e3-dcfa-4a62-b361-219578b0cd92_b2xqbn4vdevstack@QuobyteHD, size 112.00 MB, duration 1.29 sec, destination /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e01c1321-f397-494f-9109-a5a2674b9d7d {{(pid=82646) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 20:10:12 devstack cinder-volume[82646]: INFO cinder.image.image_utils [None req-552ce88e-4778-4792-b123-cef7303ab96c tempest-VolumesExtendTest-1563095803 None] Converted 112.00 MB image at 86.85 MB/s
Apr 15 20:10:12 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-552ce88e-4778-4792-b123-cef7303ab96c tempest-VolumesExtendTest-1563095803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e01c1321-f397-494f-9109-a5a2674b9d7d 1G {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:12 devstack sudo[87500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e01c1321-f397-494f-9109-a5a2674b9d7d 1G
Apr 15 20:10:12 devstack sudo[87500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:12 devstack sudo[87477]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:12 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-ce043269-e2f1-448c-99ea-6c6b72093765 tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95142a00-f940-4dc8-9f7f-432818503ee0" returned: 0 in 0.927s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:12 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-ce043269-e2f1-448c-99ea-6c6b72093765 tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95142a00-f940-4dc8-9f7f-432818503ee0 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:12 devstack sudo[87502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95142a00-f940-4dc8-9f7f-432818503ee0
Apr 15 20:10:12 devstack sudo[87502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:12 devstack sudo[87500]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:12 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-552ce88e-4778-4792-b123-cef7303ab96c tempest-VolumesExtendTest-1563095803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e01c1321-f397-494f-9109-a5a2674b9d7d 1G" returned: 0 in 0.577s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:12 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[278b8bc2-1b68-4be3-95d3-28dfdbac28ff]: (4, 'raw') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:10:12 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-552ce88e-4778-4792-b123-cef7303ab96c tempest-VolumesExtendTest-1563095803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e01c1321-f397-494f-9109-a5a2674b9d7d {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:12 devstack sudo[87502]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:12 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-ce043269-e2f1-448c-99ea-6c6b72093765 tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95142a00-f940-4dc8-9f7f-432818503ee0" returned: 0 in 0.580s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:12 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-ce043269-e2f1-448c-99ea-6c6b72093765 tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Lock "cinder-quobyte-95142a00-f940-4dc8-9f7f-432818503ee0" released by "delete_volume" :: held 1.543s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:10:12 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-ce043269-e2f1-448c-99ea-6c6b72093765 tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Created reservations ['f6d47cd1-419f-4a2d-b44f-32a385a23d8f', '9459883c-d6fd-4452-9ef5-f3533b3fd958', 'da8c7cfc-7e97-484b-ac16-93d0645b2bb6', '42c98e4f-1115-47b0-a45e-510165aa2bb8'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:10:12 devstack sudo[87508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e01c1321-f397-494f-9109-a5a2674b9d7d
Apr 15 20:10:12 devstack sudo[87508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:12 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-ce043269-e2f1-448c-99ea-6c6b72093765 tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:10:12 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-ce043269-e2f1-448c-99ea-6c6b72093765 tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:10:12 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-ce043269-e2f1-448c-99ea-6c6b72093765 tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:10:12 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-ce043269-e2f1-448c-99ea-6c6b72093765 tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:10:12 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-ce043269-e2f1-448c-99ea-6c6b72093765 tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:10:12 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-ce043269-e2f1-448c-99ea-6c6b72093765 tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:13 devstack sudo[87510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:10:13 devstack sudo[87510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:13 devstack sudo[87508]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:13 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-552ce88e-4778-4792-b123-cef7303ab96c tempest-VolumesExtendTest-1563095803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e01c1321-f397-494f-9109-a5a2674b9d7d" returned: 0 in 0.565s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:13 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-552ce88e-4778-4792-b123-cef7303ab96c tempest-VolumesExtendTest-1563095803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e01c1321-f397-494f-9109-a5a2674b9d7d {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:13 devstack sudo[87515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e01c1321-f397-494f-9109-a5a2674b9d7d
Apr 15 20:10:13 devstack sudo[87515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:13 devstack sudo[87510]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:13 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-ce043269-e2f1-448c-99ea-6c6b72093765 tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.555s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:13 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-ce043269-e2f1-448c-99ea-6c6b72093765 tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:10:13 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-ce043269-e2f1-448c-99ea-6c6b72093765 tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Deleted volume successfully.
Apr 15 20:10:13 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-ce043269-e2f1-448c-99ea-6c6b72093765 tempest-VolumeSnapshotQuotasNegativeTestJSON-1708713707 None] Lock "cinder-95142a00-f940-4dc8-9f7f-432818503ee0-delete_volume" released by "delete_volume" :: held 2.303s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:10:13 devstack sudo[87515]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:13 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-552ce88e-4778-4792-b123-cef7303ab96c tempest-VolumesExtendTest-1563095803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e01c1321-f397-494f-9109-a5a2674b9d7d" returned: 1 in 0.577s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:13 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-552ce88e-4778-4792-b123-cef7303ab96c tempest-VolumesExtendTest-1563095803 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e01c1321-f397-494f-9109-a5a2674b9d7d' failed. Not Retrying. {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 20:10:13 devstack cinder-volume[82646]: DEBUG cinder.volume.volume_utils [None req-552ce88e-4778-4792-b123-cef7303ab96c tempest-VolumesExtendTest-1563095803 None] Downloaded image 565a23e3-dcfa-4a62-b361-219578b0cd92 ((None, [{'url': 'file:///opt/stack/data/glance/images/565a23e3-dcfa-4a62-b361-219578b0cd92', 'metadata': {}}])) to volume e01c1321-f397-494f-9109-a5a2674b9d7d successfully. {{(pid=82646) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 15 20:10:13 devstack cinder-volume[82646]: DEBUG cinder.image.image_utils [None req-552ce88e-4778-4792-b123-cef7303ab96c tempest-VolumesExtendTest-1563095803 None] Temporary image 565a23e3-dcfa-4a62-b361-219578b0cd92 for user 876149b72a1e46898ab8be6279506c33 is deleted. {{(pid=82646) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 15 20:10:13 devstack cinder-volume[82646]: DEBUG cinder.volume.volume_utils [None req-552ce88e-4778-4792-b123-cef7303ab96c tempest-VolumesExtendTest-1563095803 None] Marking volume e01c1321-f397-494f-9109-a5a2674b9d7d as bootable. {{(pid=82646) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 15 20:10:13 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-552ce88e-4778-4792-b123-cef7303ab96c tempest-VolumesExtendTest-1563095803 None] Copying metadata from image 565a23e3-dcfa-4a62-b361-219578b0cd92 to e01c1321-f397-494f-9109-a5a2674b9d7d. {{(pid=82646) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 15 20:10:13 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-552ce88e-4778-4792-b123-cef7303ab96c tempest-VolumesExtendTest-1563095803 None] Creating volume glance metadata for volume e01c1321-f397-494f-9109-a5a2674b9d7d backed by image 565a23e3-dcfa-4a62-b361-219578b0cd92 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '565a23e3-dcfa-4a62-b361-219578b0cd92', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82646) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 15 20:10:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-552ce88e-4778-4792-b123-cef7303ab96c tempest-VolumesExtendTest-1563095803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bacb59d-ca38-47f0-a9a8-251dd745d56c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e01c1321-f397-494f-9109-a5a2674b9d7d', 'volume_size': 1, 'image_id': '565a23e3-dcfa-4a62-b361-219578b0cd92', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/565a23e3-dcfa-4a62-b361-219578b0cd92', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '27d9c820db6c4abea4324fe8ea0f90e6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '565a23e3-dcfa-4a62-b361-219578b0cd92', 'created_at': datetime.datetime(2026, 4, 15, 18, 0, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 18, 0, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/565a23e3-dcfa-4a62-b361-219578b0cd92/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe15d316680>}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-552ce88e-4778-4792-b123-cef7303ab96c tempest-VolumesExtendTest-1563095803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9207acec-72a2-4018-b270-603547681a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:14 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-552ce88e-4778-4792-b123-cef7303ab96c tempest-VolumesExtendTest-1563095803 None] Volume volume-e01c1321-f397-494f-9109-a5a2674b9d7d (e01c1321-f397-494f-9109-a5a2674b9d7d): created successfully
Apr 15 20:10:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-552ce88e-4778-4792-b123-cef7303ab96c tempest-VolumesExtendTest-1563095803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9207acec-72a2-4018-b270-603547681a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-552ce88e-4778-4792-b123-cef7303ab96c tempest-VolumesExtendTest-1563095803 None] Flow 'volume_create_manager' (1198d510-6757-4eaa-b057-95ca5b089680) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:10:14 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-552ce88e-4778-4792-b123-cef7303ab96c tempest-VolumesExtendTest-1563095803 None] Created volume successfully.
Apr 15 20:10:14 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-01d24f54-b6bd-48f4-9ddb-74ea11ecd791 tempest-VolumesExtendTest-1563095803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:10:14 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-01d24f54-b6bd-48f4-9ddb-74ea11ecd791 tempest-VolumesExtendTest-1563095803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.003s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:10:14 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e6f186-e11a-4acd-9755-910b14bc58a2]: (4, 'raw') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:10:14 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-01d24f54-b6bd-48f4-9ddb-74ea11ecd791 tempest-VolumesExtendTest-1563095803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e01c1321-f397-494f-9109-a5a2674b9d7d {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:14 devstack sudo[87521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e01c1321-f397-494f-9109-a5a2674b9d7d
Apr 15 20:10:14 devstack sudo[87521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:14 devstack sudo[87521]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:14 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-01d24f54-b6bd-48f4-9ddb-74ea11ecd791 tempest-VolumesExtendTest-1563095803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e01c1321-f397-494f-9109-a5a2674b9d7d" returned: 0 in 0.509s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:14 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-01d24f54-b6bd-48f4-9ddb-74ea11ecd791 tempest-VolumesExtendTest-1563095803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e01c1321-f397-494f-9109-a5a2674b9d7d {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:15 devstack sudo[87525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e01c1321-f397-494f-9109-a5a2674b9d7d
Apr 15 20:10:15 devstack sudo[87525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:15 devstack sudo[87525]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:15 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-01d24f54-b6bd-48f4-9ddb-74ea11ecd791 tempest-VolumesExtendTest-1563095803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e01c1321-f397-494f-9109-a5a2674b9d7d" returned: 1 in 0.589s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:15 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-01d24f54-b6bd-48f4-9ddb-74ea11ecd791 tempest-VolumesExtendTest-1563095803 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e01c1321-f397-494f-9109-a5a2674b9d7d' failed. Not Retrying. {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 20:10:15 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-01d24f54-b6bd-48f4-9ddb-74ea11ecd791 tempest-VolumesExtendTest-1563095803 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e01c1321-f397-494f-9109-a5a2674b9d7d 2G {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:15 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-01d24f54-b6bd-48f4-9ddb-74ea11ecd791 tempest-VolumesExtendTest-1563095803 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e01c1321-f397-494f-9109-a5a2674b9d7d 2G" returned: 0 in 0.076s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:15 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-01d24f54-b6bd-48f4-9ddb-74ea11ecd791 tempest-VolumesExtendTest-1563095803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.223s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:10:15 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-01d24f54-b6bd-48f4-9ddb-74ea11ecd791 tempest-VolumesExtendTest-1563095803 None] Extend volume completed successfully.
Apr 15 20:10:16 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-b89546bd-f0ae-41de-9e98-de9a1d46e2b4 tempest-VolumesExtendTest-1563095803 None] Acquiring lock "cinder-e01c1321-f397-494f-9109-a5a2674b9d7d-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:10:16 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-b89546bd-f0ae-41de-9e98-de9a1d46e2b4 tempest-VolumesExtendTest-1563095803 None] Lock "cinder-e01c1321-f397-494f-9109-a5a2674b9d7d-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:10:16 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-b89546bd-f0ae-41de-9e98-de9a1d46e2b4 tempest-VolumesExtendTest-1563095803 None] Acquiring lock "cinder-quobyte-e01c1321-f397-494f-9109-a5a2674b9d7d" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:10:16 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-b89546bd-f0ae-41de-9e98-de9a1d46e2b4 tempest-VolumesExtendTest-1563095803 None] Lock "cinder-quobyte-e01c1321-f397-494f-9109-a5a2674b9d7d" acquired by "delete_volume" :: waited 0.007s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:10:16 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6cfd6b-b026-45ce-8802-3e4267749418]: (4, 'raw') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:10:16 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b89546bd-f0ae-41de-9e98-de9a1d46e2b4 tempest-VolumesExtendTest-1563095803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e01c1321-f397-494f-9109-a5a2674b9d7d {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:16 devstack sudo[87534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e01c1321-f397-494f-9109-a5a2674b9d7d
Apr 15 20:10:16 devstack sudo[87534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:17 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-7416dd78-7adb-4b4a-8777-3c07b5d04c99 tempest-VolumesListAdminTestJSON-416736655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:10:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-7416dd78-7adb-4b4a-8777-3c07b5d04c99 tempest-VolumesListAdminTestJSON-416736655 None] Flow 'volume_create_manager' (f96a32d8-6939-45f7-8bb7-dea1d9f8231f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:10:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-7416dd78-7adb-4b4a-8777-3c07b5d04c99 tempest-VolumesListAdminTestJSON-416736655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (686a939e-5f45-49b0-a771-7557df40f9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-7416dd78-7adb-4b4a-8777-3c07b5d04c99 tempest-VolumesListAdminTestJSON-416736655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (686a939e-5f45-49b0-a771-7557df40f9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:10:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1329520792',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6195829b-5aa3-4e67-b6e0-fd1c144646a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='074be0a4a491495285e8d7d1a69f1878',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:10:17Z,use_quota=True,user_id='121da201094745f48f9443815a0c5d6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-7416dd78-7adb-4b4a-8777-3c07b5d04c99 tempest-VolumesListAdminTestJSON-416736655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b47c9674-7bc0-4cc7-9297-3c6d6935bef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-7416dd78-7adb-4b4a-8777-3c07b5d04c99 tempest-VolumesListAdminTestJSON-416736655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b47c9674-7bc0-4cc7-9297-3c6d6935bef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-7416dd78-7adb-4b4a-8777-3c07b5d04c99 tempest-VolumesListAdminTestJSON-416736655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a85bb74-34bb-4e9f-b9bd-1bef769f6a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-7416dd78-7adb-4b4a-8777-3c07b5d04c99 tempest-VolumesListAdminTestJSON-416736655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a85bb74-34bb-4e9f-b9bd-1bef769f6a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6195829b-5aa3-4e67-b6e0-fd1c144646a0', 'volume_name': 'volume-6195829b-5aa3-4e67-b6e0-fd1c144646a0', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-7416dd78-7adb-4b4a-8777-3c07b5d04c99 tempest-VolumesListAdminTestJSON-416736655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0a5c05f-1608-4a98-aa97-558ea4313146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-7416dd78-7adb-4b4a-8777-3c07b5d04c99 tempest-VolumesListAdminTestJSON-416736655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0a5c05f-1608-4a98-aa97-558ea4313146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-7416dd78-7adb-4b4a-8777-3c07b5d04c99 tempest-VolumesListAdminTestJSON-416736655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd21d489-de72-486d-a4ac-baf14cb683a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:17 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-7416dd78-7adb-4b4a-8777-3c07b5d04c99 tempest-VolumesListAdminTestJSON-416736655 None] Volume 6195829b-5aa3-4e67-b6e0-fd1c144646a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6195829b-5aa3-4e67-b6e0-fd1c144646a0', 'volume_size': 1}
Apr 15 20:10:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-7416dd78-7adb-4b4a-8777-3c07b5d04c99 tempest-VolumesListAdminTestJSON-416736655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:10:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-7416dd78-7adb-4b4a-8777-3c07b5d04c99 tempest-VolumesListAdminTestJSON-416736655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:10:17 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-7416dd78-7adb-4b4a-8777-3c07b5d04c99 tempest-VolumesListAdminTestJSON-416736655 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:10:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1329520792',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6195829b-5aa3-4e67-b6e0-fd1c144646a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='074be0a4a491495285e8d7d1a69f1878',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:10:17Z,use_quota=True,user_id='121da201094745f48f9443815a0c5d6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:10:17 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-7416dd78-7adb-4b4a-8777-3c07b5d04c99 tempest-VolumesListAdminTestJSON-416736655 None] Creating volume 6195829b-5aa3-4e67-b6e0-fd1c144646a0 {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:10:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-7416dd78-7adb-4b4a-8777-3c07b5d04c99 tempest-VolumesListAdminTestJSON-416736655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:10:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-7416dd78-7adb-4b4a-8777-3c07b5d04c99 tempest-VolumesListAdminTestJSON-416736655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:10:17 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-7416dd78-7adb-4b4a-8777-3c07b5d04c99 tempest-VolumesListAdminTestJSON-416736655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:10:17 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-7416dd78-7adb-4b4a-8777-3c07b5d04c99 tempest-VolumesListAdminTestJSON-416736655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:10:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-7416dd78-7adb-4b4a-8777-3c07b5d04c99 tempest-VolumesListAdminTestJSON-416736655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:10:17 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-7416dd78-7adb-4b4a-8777-3c07b5d04c99 tempest-VolumesListAdminTestJSON-416736655 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:10:17 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-7416dd78-7adb-4b4a-8777-3c07b5d04c99 tempest-VolumesListAdminTestJSON-416736655 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:10:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-7416dd78-7adb-4b4a-8777-3c07b5d04c99 tempest-VolumesListAdminTestJSON-416736655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6195829b-5aa3-4e67-b6e0-fd1c144646a0 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:17 devstack sudo[87538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6195829b-5aa3-4e67-b6e0-fd1c144646a0 1073741824
Apr 15 20:10:17 devstack sudo[87538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:17 devstack sudo[87534]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b89546bd-f0ae-41de-9e98-de9a1d46e2b4 tempest-VolumesExtendTest-1563095803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e01c1321-f397-494f-9109-a5a2674b9d7d" returned: 0 in 0.630s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b89546bd-f0ae-41de-9e98-de9a1d46e2b4 tempest-VolumesExtendTest-1563095803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e01c1321-f397-494f-9109-a5a2674b9d7d {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:17 devstack sudo[87540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e01c1321-f397-494f-9109-a5a2674b9d7d
Apr 15 20:10:17 devstack sudo[87540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:18 devstack sudo[87540]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b89546bd-f0ae-41de-9e98-de9a1d46e2b4 tempest-VolumesExtendTest-1563095803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e01c1321-f397-494f-9109-a5a2674b9d7d" returned: 1 in 0.691s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:18 devstack sudo[87538]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b89546bd-f0ae-41de-9e98-de9a1d46e2b4 tempest-VolumesExtendTest-1563095803 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e01c1321-f397-494f-9109-a5a2674b9d7d' failed. Not Retrying. {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 20:10:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b89546bd-f0ae-41de-9e98-de9a1d46e2b4 tempest-VolumesExtendTest-1563095803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e01c1321-f397-494f-9109-a5a2674b9d7d {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-7416dd78-7adb-4b4a-8777-3c07b5d04c99 tempest-VolumesListAdminTestJSON-416736655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6195829b-5aa3-4e67-b6e0-fd1c144646a0 1073741824" returned: 0 in 0.745s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:18 devstack sudo[87548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e01c1321-f397-494f-9109-a5a2674b9d7d
Apr 15 20:10:18 devstack sudo[87548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-7416dd78-7adb-4b4a-8777-3c07b5d04c99 tempest-VolumesListAdminTestJSON-416736655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6195829b-5aa3-4e67-b6e0-fd1c144646a0 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:18 devstack sudo[87550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6195829b-5aa3-4e67-b6e0-fd1c144646a0
Apr 15 20:10:18 devstack sudo[87550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:18 devstack sudo[87548]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b89546bd-f0ae-41de-9e98-de9a1d46e2b4 tempest-VolumesExtendTest-1563095803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e01c1321-f397-494f-9109-a5a2674b9d7d" returned: 0 in 0.504s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:18 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-b89546bd-f0ae-41de-9e98-de9a1d46e2b4 tempest-VolumesExtendTest-1563095803 None] Lock "cinder-quobyte-e01c1321-f397-494f-9109-a5a2674b9d7d" released by "delete_volume" :: held 1.877s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:10:18 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-b89546bd-f0ae-41de-9e98-de9a1d46e2b4 tempest-VolumesExtendTest-1563095803 None] Created reservations ['dc7c50dc-7a8c-472b-827c-ad10e08b06c0', 'cdb54bfb-c243-4958-b3d1-66cfb790e4b2', 'a75932ac-8e40-46f8-b0be-2c4edec7e8bd', '5855e1ca-21de-4adb-b689-6e8fae4fef5a'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:10:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-b89546bd-f0ae-41de-9e98-de9a1d46e2b4 tempest-VolumesExtendTest-1563095803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:10:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-b89546bd-f0ae-41de-9e98-de9a1d46e2b4 tempest-VolumesExtendTest-1563095803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:10:18 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-b89546bd-f0ae-41de-9e98-de9a1d46e2b4 tempest-VolumesExtendTest-1563095803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:10:18 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-b89546bd-f0ae-41de-9e98-de9a1d46e2b4 tempest-VolumesExtendTest-1563095803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:10:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-b89546bd-f0ae-41de-9e98-de9a1d46e2b4 tempest-VolumesExtendTest-1563095803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:10:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b89546bd-f0ae-41de-9e98-de9a1d46e2b4 tempest-VolumesExtendTest-1563095803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:18 devstack sudo[87554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:10:18 devstack sudo[87554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:18 devstack sudo[87550]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-7416dd78-7adb-4b4a-8777-3c07b5d04c99 tempest-VolumesListAdminTestJSON-416736655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6195829b-5aa3-4e67-b6e0-fd1c144646a0" returned: 0 in 0.638s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:18 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-7416dd78-7adb-4b4a-8777-3c07b5d04c99 tempest-VolumesListAdminTestJSON-416736655 None] <== create_volume: return (1414ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:10:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-7416dd78-7adb-4b4a-8777-3c07b5d04c99 tempest-VolumesListAdminTestJSON-416736655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.416s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:10:18 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-7416dd78-7adb-4b4a-8777-3c07b5d04c99 tempest-VolumesListAdminTestJSON-416736655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd21d489-de72-486d-a4ac-baf14cb683a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6195829b-5aa3-4e67-b6e0-fd1c144646a0', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:18 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-7416dd78-7adb-4b4a-8777-3c07b5d04c99 tempest-VolumesListAdminTestJSON-416736655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4abf345-2d5e-4e6a-8c17-d0acfb17a869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:18 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-7416dd78-7adb-4b4a-8777-3c07b5d04c99 tempest-VolumesListAdminTestJSON-416736655 None] Volume volume-6195829b-5aa3-4e67-b6e0-fd1c144646a0 (6195829b-5aa3-4e67-b6e0-fd1c144646a0): created successfully
Apr 15 20:10:18 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-7416dd78-7adb-4b4a-8777-3c07b5d04c99 tempest-VolumesListAdminTestJSON-416736655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4abf345-2d5e-4e6a-8c17-d0acfb17a869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:18 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-7416dd78-7adb-4b4a-8777-3c07b5d04c99 tempest-VolumesListAdminTestJSON-416736655 None] Flow 'volume_create_manager' (f96a32d8-6939-45f7-8bb7-dea1d9f8231f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:10:18 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-7416dd78-7adb-4b4a-8777-3c07b5d04c99 tempest-VolumesListAdminTestJSON-416736655 None] Created volume successfully.
Apr 15 20:10:19 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcb12b2d-b3e1-41c3-8b39-5c54fd3537f1 tempest-VolumesExtendTest-1563095803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:10:19 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-dcb12b2d-b3e1-41c3-8b39-5c54fd3537f1 tempest-VolumesExtendTest-1563095803 None] Flow 'volume_create_manager' (cd670394-c1ac-4e7a-906b-2bd2dab45cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:10:19 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-dcb12b2d-b3e1-41c3-8b39-5c54fd3537f1 tempest-VolumesExtendTest-1563095803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77bee33d-adc8-4963-8f86-e73f2ce92ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:19 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-dcb12b2d-b3e1-41c3-8b39-5c54fd3537f1 tempest-VolumesExtendTest-1563095803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77bee33d-adc8-4963-8f86-e73f2ce92ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:10:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1635849522',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2fd78be-922c-457b-9fb9-965fda4d0afe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acd6766cf57c4b06915de0f14b3188be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:10:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:10:19Z,use_quota=True,user_id='876149b72a1e46898ab8be6279506c33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:19 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-dcb12b2d-b3e1-41c3-8b39-5c54fd3537f1 tempest-VolumesExtendTest-1563095803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67a11f86-6fab-45bf-b31d-be9fe1f06e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:19 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-dcb12b2d-b3e1-41c3-8b39-5c54fd3537f1 tempest-VolumesExtendTest-1563095803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67a11f86-6fab-45bf-b31d-be9fe1f06e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:19 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-dcb12b2d-b3e1-41c3-8b39-5c54fd3537f1 tempest-VolumesExtendTest-1563095803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e90ce07-22e3-450a-aa0f-7049a2b65eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:19 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-dcb12b2d-b3e1-41c3-8b39-5c54fd3537f1 tempest-VolumesExtendTest-1563095803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e90ce07-22e3-450a-aa0f-7049a2b65eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2fd78be-922c-457b-9fb9-965fda4d0afe', 'volume_name': 'volume-c2fd78be-922c-457b-9fb9-965fda4d0afe', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:19 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-dcb12b2d-b3e1-41c3-8b39-5c54fd3537f1 tempest-VolumesExtendTest-1563095803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e61b9f9-3e41-4288-b7d3-24d54082e22e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:19 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-dcb12b2d-b3e1-41c3-8b39-5c54fd3537f1 tempest-VolumesExtendTest-1563095803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e61b9f9-3e41-4288-b7d3-24d54082e22e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:19 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-dcb12b2d-b3e1-41c3-8b39-5c54fd3537f1 tempest-VolumesExtendTest-1563095803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fd50ab1-1c69-457b-9c67-a15a30f843f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:19 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-dcb12b2d-b3e1-41c3-8b39-5c54fd3537f1 tempest-VolumesExtendTest-1563095803 None] Volume c2fd78be-922c-457b-9fb9-965fda4d0afe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2fd78be-922c-457b-9fb9-965fda4d0afe', 'volume_size': 1}
Apr 15 20:10:19 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-dcb12b2d-b3e1-41c3-8b39-5c54fd3537f1 tempest-VolumesExtendTest-1563095803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:10:19 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-dcb12b2d-b3e1-41c3-8b39-5c54fd3537f1 tempest-VolumesExtendTest-1563095803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:10:19 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-dcb12b2d-b3e1-41c3-8b39-5c54fd3537f1 tempest-VolumesExtendTest-1563095803 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:10:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1635849522',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2fd78be-922c-457b-9fb9-965fda4d0afe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acd6766cf57c4b06915de0f14b3188be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:10:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:10:19Z,use_quota=True,user_id='876149b72a1e46898ab8be6279506c33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:10:19 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-dcb12b2d-b3e1-41c3-8b39-5c54fd3537f1 tempest-VolumesExtendTest-1563095803 None] Creating volume c2fd78be-922c-457b-9fb9-965fda4d0afe {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:10:19 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-dcb12b2d-b3e1-41c3-8b39-5c54fd3537f1 tempest-VolumesExtendTest-1563095803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:10:19 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-dcb12b2d-b3e1-41c3-8b39-5c54fd3537f1 tempest-VolumesExtendTest-1563095803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:10:19 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-dcb12b2d-b3e1-41c3-8b39-5c54fd3537f1 tempest-VolumesExtendTest-1563095803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:10:19 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-dcb12b2d-b3e1-41c3-8b39-5c54fd3537f1 tempest-VolumesExtendTest-1563095803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:10:19 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-dcb12b2d-b3e1-41c3-8b39-5c54fd3537f1 tempest-VolumesExtendTest-1563095803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:10:19 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-dcb12b2d-b3e1-41c3-8b39-5c54fd3537f1 tempest-VolumesExtendTest-1563095803 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:10:19 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-dcb12b2d-b3e1-41c3-8b39-5c54fd3537f1 tempest-VolumesExtendTest-1563095803 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:10:19 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-dcb12b2d-b3e1-41c3-8b39-5c54fd3537f1 tempest-VolumesExtendTest-1563095803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2fd78be-922c-457b-9fb9-965fda4d0afe 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:19 devstack sudo[87554]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:19 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b89546bd-f0ae-41de-9e98-de9a1d46e2b4 tempest-VolumesExtendTest-1563095803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.590s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:19 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-b89546bd-f0ae-41de-9e98-de9a1d46e2b4 tempest-VolumesExtendTest-1563095803 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:10:19 devstack sudo[87567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2fd78be-922c-457b-9fb9-965fda4d0afe 1073741824
Apr 15 20:10:19 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-b89546bd-f0ae-41de-9e98-de9a1d46e2b4 tempest-VolumesExtendTest-1563095803 None] Deleted volume successfully.
Apr 15 20:10:19 devstack sudo[87567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:19 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-b89546bd-f0ae-41de-9e98-de9a1d46e2b4 tempest-VolumesExtendTest-1563095803 None] Lock "cinder-e01c1321-f397-494f-9109-a5a2674b9d7d-delete_volume" released by "delete_volume" :: held 2.643s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:10:19 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad8155cc-f0ea-4ac7-bca4-17fa53f70f9d tempest-VolumesListAdminTestJSON-416736655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:10:19 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ad8155cc-f0ea-4ac7-bca4-17fa53f70f9d tempest-VolumesListAdminTestJSON-416736655 None] Flow 'volume_create_manager' (ed819650-f00c-4204-be41-cff67b96d230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:10:19 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ad8155cc-f0ea-4ac7-bca4-17fa53f70f9d tempest-VolumesListAdminTestJSON-416736655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (717f61ce-6d38-4976-9e07-28da89512086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:19 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ad8155cc-f0ea-4ac7-bca4-17fa53f70f9d tempest-VolumesListAdminTestJSON-416736655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (717f61ce-6d38-4976-9e07-28da89512086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1352505980',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02a8189a-e0c9-4ebd-a183-36023631073d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='074be0a4a491495285e8d7d1a69f1878',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:10:20Z,use_quota=True,user_id='121da201094745f48f9443815a0c5d6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:19 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ad8155cc-f0ea-4ac7-bca4-17fa53f70f9d tempest-VolumesListAdminTestJSON-416736655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08aef495-1b80-4abd-9679-c01ab63f64d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:19 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ad8155cc-f0ea-4ac7-bca4-17fa53f70f9d tempest-VolumesListAdminTestJSON-416736655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08aef495-1b80-4abd-9679-c01ab63f64d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:19 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ad8155cc-f0ea-4ac7-bca4-17fa53f70f9d tempest-VolumesListAdminTestJSON-416736655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1383ab61-00a2-4c34-9c54-fcde8d3457c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:19 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ad8155cc-f0ea-4ac7-bca4-17fa53f70f9d tempest-VolumesListAdminTestJSON-416736655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1383ab61-00a2-4c34-9c54-fcde8d3457c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02a8189a-e0c9-4ebd-a183-36023631073d', 'volume_name': 'volume-02a8189a-e0c9-4ebd-a183-36023631073d', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:19 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ad8155cc-f0ea-4ac7-bca4-17fa53f70f9d tempest-VolumesListAdminTestJSON-416736655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (798c89f4-e95b-4dca-873f-aa0281dfd1ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:19 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ad8155cc-f0ea-4ac7-bca4-17fa53f70f9d tempest-VolumesListAdminTestJSON-416736655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (798c89f4-e95b-4dca-873f-aa0281dfd1ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:19 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ad8155cc-f0ea-4ac7-bca4-17fa53f70f9d tempest-VolumesListAdminTestJSON-416736655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66881f2f-ceeb-41d9-bf48-01c04a1d41e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:19 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-ad8155cc-f0ea-4ac7-bca4-17fa53f70f9d tempest-VolumesListAdminTestJSON-416736655 None] Volume 02a8189a-e0c9-4ebd-a183-36023631073d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02a8189a-e0c9-4ebd-a183-36023631073d', 'volume_size': 1}
Apr 15 20:10:19 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-ad8155cc-f0ea-4ac7-bca4-17fa53f70f9d tempest-VolumesListAdminTestJSON-416736655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:10:20 devstack sudo[87567]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-dcb12b2d-b3e1-41c3-8b39-5c54fd3537f1 tempest-VolumesExtendTest-1563095803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2fd78be-922c-457b-9fb9-965fda4d0afe 1073741824" returned: 0 in 0.718s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-dcb12b2d-b3e1-41c3-8b39-5c54fd3537f1 tempest-VolumesExtendTest-1563095803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2fd78be-922c-457b-9fb9-965fda4d0afe {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:20 devstack sudo[87578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2fd78be-922c-457b-9fb9-965fda4d0afe
Apr 15 20:10:20 devstack sudo[87578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:20 devstack sudo[87578]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-dcb12b2d-b3e1-41c3-8b39-5c54fd3537f1 tempest-VolumesExtendTest-1563095803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2fd78be-922c-457b-9fb9-965fda4d0afe" returned: 0 in 0.481s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:20 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-dcb12b2d-b3e1-41c3-8b39-5c54fd3537f1 tempest-VolumesExtendTest-1563095803 None] <== create_volume: return (1225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:10:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-dcb12b2d-b3e1-41c3-8b39-5c54fd3537f1 tempest-VolumesExtendTest-1563095803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:10:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-ad8155cc-f0ea-4ac7-bca4-17fa53f70f9d tempest-VolumesListAdminTestJSON-416736655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.636s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:10:20 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-ad8155cc-f0ea-4ac7-bca4-17fa53f70f9d tempest-VolumesListAdminTestJSON-416736655 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1352505980',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02a8189a-e0c9-4ebd-a183-36023631073d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='074be0a4a491495285e8d7d1a69f1878',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:10:20Z,use_quota=True,user_id='121da201094745f48f9443815a0c5d6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:10:20 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-ad8155cc-f0ea-4ac7-bca4-17fa53f70f9d tempest-VolumesListAdminTestJSON-416736655 None] Creating volume 02a8189a-e0c9-4ebd-a183-36023631073d {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:10:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-ad8155cc-f0ea-4ac7-bca4-17fa53f70f9d tempest-VolumesListAdminTestJSON-416736655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:10:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-ad8155cc-f0ea-4ac7-bca4-17fa53f70f9d tempest-VolumesListAdminTestJSON-416736655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:10:20 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-ad8155cc-f0ea-4ac7-bca4-17fa53f70f9d tempest-VolumesListAdminTestJSON-416736655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:10:20 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-ad8155cc-f0ea-4ac7-bca4-17fa53f70f9d tempest-VolumesListAdminTestJSON-416736655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:10:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-ad8155cc-f0ea-4ac7-bca4-17fa53f70f9d tempest-VolumesListAdminTestJSON-416736655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:10:20 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-ad8155cc-f0ea-4ac7-bca4-17fa53f70f9d tempest-VolumesListAdminTestJSON-416736655 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:10:20 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-ad8155cc-f0ea-4ac7-bca4-17fa53f70f9d tempest-VolumesListAdminTestJSON-416736655 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:10:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-ad8155cc-f0ea-4ac7-bca4-17fa53f70f9d tempest-VolumesListAdminTestJSON-416736655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-02a8189a-e0c9-4ebd-a183-36023631073d 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:20 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-dcb12b2d-b3e1-41c3-8b39-5c54fd3537f1 tempest-VolumesExtendTest-1563095803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fd50ab1-1c69-457b-9c67-a15a30f843f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2fd78be-922c-457b-9fb9-965fda4d0afe', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:20 devstack sudo[87581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-02a8189a-e0c9-4ebd-a183-36023631073d 1073741824
Apr 15 20:10:20 devstack sudo[87581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:20 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-dcb12b2d-b3e1-41c3-8b39-5c54fd3537f1 tempest-VolumesExtendTest-1563095803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db3b4249-9018-4862-8e42-ef3c49af4e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:20 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-dcb12b2d-b3e1-41c3-8b39-5c54fd3537f1 tempest-VolumesExtendTest-1563095803 None] Volume volume-c2fd78be-922c-457b-9fb9-965fda4d0afe (c2fd78be-922c-457b-9fb9-965fda4d0afe): created successfully
Apr 15 20:10:20 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-dcb12b2d-b3e1-41c3-8b39-5c54fd3537f1 tempest-VolumesExtendTest-1563095803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db3b4249-9018-4862-8e42-ef3c49af4e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:20 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-dcb12b2d-b3e1-41c3-8b39-5c54fd3537f1 tempest-VolumesExtendTest-1563095803 None] Flow 'volume_create_manager' (cd670394-c1ac-4e7a-906b-2bd2dab45cdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:10:20 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-dcb12b2d-b3e1-41c3-8b39-5c54fd3537f1 tempest-VolumesExtendTest-1563095803 None] Created volume successfully.
Apr 15 20:10:21 devstack sudo[87581]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-ad8155cc-f0ea-4ac7-bca4-17fa53f70f9d tempest-VolumesListAdminTestJSON-416736655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-02a8189a-e0c9-4ebd-a183-36023631073d 1073741824" returned: 0 in 0.588s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-ad8155cc-f0ea-4ac7-bca4-17fa53f70f9d tempest-VolumesListAdminTestJSON-416736655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-02a8189a-e0c9-4ebd-a183-36023631073d {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:21 devstack sudo[87586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-02a8189a-e0c9-4ebd-a183-36023631073d
Apr 15 20:10:21 devstack sudo[87586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-339a15c2-aa18-4c38-8ead-68ffe93e1c2b tempest-VolumesExtendTest-1563095803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:10:21 devstack sudo[87586]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-ad8155cc-f0ea-4ac7-bca4-17fa53f70f9d tempest-VolumesListAdminTestJSON-416736655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-02a8189a-e0c9-4ebd-a183-36023631073d" returned: 0 in 0.466s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:21 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-ad8155cc-f0ea-4ac7-bca4-17fa53f70f9d tempest-VolumesListAdminTestJSON-416736655 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:10:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-ad8155cc-f0ea-4ac7-bca4-17fa53f70f9d tempest-VolumesListAdminTestJSON-416736655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:10:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-339a15c2-aa18-4c38-8ead-68ffe93e1c2b tempest-VolumesExtendTest-1563095803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.169s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:10:21 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ad8155cc-f0ea-4ac7-bca4-17fa53f70f9d tempest-VolumesListAdminTestJSON-416736655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66881f2f-ceeb-41d9-bf48-01c04a1d41e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02a8189a-e0c9-4ebd-a183-36023631073d', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:21 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ad8155cc-f0ea-4ac7-bca4-17fa53f70f9d tempest-VolumesListAdminTestJSON-416736655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83a6cd97-3266-4667-90d5-d05680a01a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:21 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-339a15c2-aa18-4c38-8ead-68ffe93e1c2b tempest-VolumesExtendTest-1563095803 None] Creating offline snapshot 27195212-b584-4b7a-9340-ae9ea5cf6e1c of volume c2fd78be-922c-457b-9fb9-965fda4d0afe {{(pid=82646) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 20:10:21 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-ad8155cc-f0ea-4ac7-bca4-17fa53f70f9d tempest-VolumesListAdminTestJSON-416736655 None] Volume volume-02a8189a-e0c9-4ebd-a183-36023631073d (02a8189a-e0c9-4ebd-a183-36023631073d): created successfully
Apr 15 20:10:21 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ad8155cc-f0ea-4ac7-bca4-17fa53f70f9d tempest-VolumesListAdminTestJSON-416736655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83a6cd97-3266-4667-90d5-d05680a01a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:21 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ad8155cc-f0ea-4ac7-bca4-17fa53f70f9d tempest-VolumesListAdminTestJSON-416736655 None] Flow 'volume_create_manager' (ed819650-f00c-4204-be41-cff67b96d230) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:10:21 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ab9482-1f1a-46e2-8e1e-7d503769c68b]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:10:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-339a15c2-aa18-4c38-8ead-68ffe93e1c2b tempest-VolumesExtendTest-1563095803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2fd78be-922c-457b-9fb9-965fda4d0afe {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:21 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-ad8155cc-f0ea-4ac7-bca4-17fa53f70f9d tempest-VolumesListAdminTestJSON-416736655 None] Created volume successfully.
Apr 15 20:10:21 devstack sudo[87589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2fd78be-922c-457b-9fb9-965fda4d0afe
Apr 15 20:10:21 devstack sudo[87589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:22 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-45139cc1-fb88-40fe-a461-1dc5036c97fe tempest-VolumesListAdminTestJSON-416736655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:10:22 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-45139cc1-fb88-40fe-a461-1dc5036c97fe tempest-VolumesListAdminTestJSON-416736655 None] Flow 'volume_create_manager' (5924c639-234d-449c-a1cf-d32da62791f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:10:22 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-45139cc1-fb88-40fe-a461-1dc5036c97fe tempest-VolumesListAdminTestJSON-416736655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b048940-bb08-4960-bfbc-36d26d8b1bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:22 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-45139cc1-fb88-40fe-a461-1dc5036c97fe tempest-VolumesListAdminTestJSON-416736655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b048940-bb08-4960-bfbc-36d26d8b1bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:10:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1769570464',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db9a3eaf-5f8c-4ec8-8130-1d1797330a79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='074be0a4a491495285e8d7d1a69f1878',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:10:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:10:22Z,use_quota=True,user_id='121da201094745f48f9443815a0c5d6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:22 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-45139cc1-fb88-40fe-a461-1dc5036c97fe tempest-VolumesListAdminTestJSON-416736655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3001abfe-8e6c-4523-a498-2ba09e279332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:22 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-45139cc1-fb88-40fe-a461-1dc5036c97fe tempest-VolumesListAdminTestJSON-416736655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3001abfe-8e6c-4523-a498-2ba09e279332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:22 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-45139cc1-fb88-40fe-a461-1dc5036c97fe tempest-VolumesListAdminTestJSON-416736655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78d845ad-e70e-4bdb-9fd0-9b0eaaf0905d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:22 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-45139cc1-fb88-40fe-a461-1dc5036c97fe tempest-VolumesListAdminTestJSON-416736655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78d845ad-e70e-4bdb-9fd0-9b0eaaf0905d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db9a3eaf-5f8c-4ec8-8130-1d1797330a79', 'volume_name': 'volume-db9a3eaf-5f8c-4ec8-8130-1d1797330a79', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:22 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-45139cc1-fb88-40fe-a461-1dc5036c97fe tempest-VolumesListAdminTestJSON-416736655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0308d8aa-6f19-4317-99bc-cbebb5651a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:22 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-45139cc1-fb88-40fe-a461-1dc5036c97fe tempest-VolumesListAdminTestJSON-416736655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0308d8aa-6f19-4317-99bc-cbebb5651a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:22 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-45139cc1-fb88-40fe-a461-1dc5036c97fe tempest-VolumesListAdminTestJSON-416736655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c68c0484-0497-498a-958d-9e359d36ff30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:22 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-45139cc1-fb88-40fe-a461-1dc5036c97fe tempest-VolumesListAdminTestJSON-416736655 None] Volume db9a3eaf-5f8c-4ec8-8130-1d1797330a79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db9a3eaf-5f8c-4ec8-8130-1d1797330a79', 'volume_size': 1}
Apr 15 20:10:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-45139cc1-fb88-40fe-a461-1dc5036c97fe tempest-VolumesListAdminTestJSON-416736655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:10:22 devstack sudo[87589]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-339a15c2-aa18-4c38-8ead-68ffe93e1c2b tempest-VolumesExtendTest-1563095803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2fd78be-922c-457b-9fb9-965fda4d0afe" returned: 0 in 0.745s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-339a15c2-aa18-4c38-8ead-68ffe93e1c2b tempest-VolumesExtendTest-1563095803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2fd78be-922c-457b-9fb9-965fda4d0afe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2fd78be-922c-457b-9fb9-965fda4d0afe.27195212-b584-4b7a-9340-ae9ea5cf6e1c 1G {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:22 devstack sudo[87594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2fd78be-922c-457b-9fb9-965fda4d0afe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2fd78be-922c-457b-9fb9-965fda4d0afe.27195212-b584-4b7a-9340-ae9ea5cf6e1c 1G
Apr 15 20:10:22 devstack sudo[87594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:22 devstack sudo[87594]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-339a15c2-aa18-4c38-8ead-68ffe93e1c2b tempest-VolumesExtendTest-1563095803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2fd78be-922c-457b-9fb9-965fda4d0afe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2fd78be-922c-457b-9fb9-965fda4d0afe.27195212-b584-4b7a-9340-ae9ea5cf6e1c 1G" returned: 0 in 0.549s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-339a15c2-aa18-4c38-8ead-68ffe93e1c2b tempest-VolumesExtendTest-1563095803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2fd78be-922c-457b-9fb9-965fda4d0afe -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2fd78be-922c-457b-9fb9-965fda4d0afe.27195212-b584-4b7a-9340-ae9ea5cf6e1c {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:23 devstack sudo[87599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2fd78be-922c-457b-9fb9-965fda4d0afe -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2fd78be-922c-457b-9fb9-965fda4d0afe.27195212-b584-4b7a-9340-ae9ea5cf6e1c
Apr 15 20:10:23 devstack sudo[87599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:23 devstack sudo[87599]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:23 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-339a15c2-aa18-4c38-8ead-68ffe93e1c2b tempest-VolumesExtendTest-1563095803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2fd78be-922c-457b-9fb9-965fda4d0afe -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2fd78be-922c-457b-9fb9-965fda4d0afe.27195212-b584-4b7a-9340-ae9ea5cf6e1c" returned: 0 in 0.546s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:23 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-339a15c2-aa18-4c38-8ead-68ffe93e1c2b tempest-VolumesExtendTest-1563095803 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2fd78be-922c-457b-9fb9-965fda4d0afe.27195212-b584-4b7a-9340-ae9ea5cf6e1c is being set with open permissions: ugo+rw
Apr 15 20:10:23 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-339a15c2-aa18-4c38-8ead-68ffe93e1c2b tempest-VolumesExtendTest-1563095803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2fd78be-922c-457b-9fb9-965fda4d0afe.27195212-b584-4b7a-9340-ae9ea5cf6e1c {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:23 devstack sudo[87607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2fd78be-922c-457b-9fb9-965fda4d0afe.27195212-b584-4b7a-9340-ae9ea5cf6e1c
Apr 15 20:10:23 devstack sudo[87607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:24 devstack sudo[87607]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-339a15c2-aa18-4c38-8ead-68ffe93e1c2b tempest-VolumesExtendTest-1563095803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2fd78be-922c-457b-9fb9-965fda4d0afe.27195212-b584-4b7a-9340-ae9ea5cf6e1c" returned: 0 in 0.465s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-339a15c2-aa18-4c38-8ead-68ffe93e1c2b tempest-VolumesExtendTest-1563095803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2fd78be-922c-457b-9fb9-965fda4d0afe.info {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:24 devstack sudo[87610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2fd78be-922c-457b-9fb9-965fda4d0afe.info
Apr 15 20:10:24 devstack sudo[87610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:24 devstack sudo[87610]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-339a15c2-aa18-4c38-8ead-68ffe93e1c2b tempest-VolumesExtendTest-1563095803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2fd78be-922c-457b-9fb9-965fda4d0afe.info" returned: 0 in 0.439s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:24 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-339a15c2-aa18-4c38-8ead-68ffe93e1c2b tempest-VolumesExtendTest-1563095803 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2fd78be-922c-457b-9fb9-965fda4d0afe.info is being set with open permissions: ugo+rw
Apr 15 20:10:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-339a15c2-aa18-4c38-8ead-68ffe93e1c2b tempest-VolumesExtendTest-1563095803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2fd78be-922c-457b-9fb9-965fda4d0afe.info {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:24 devstack sudo[87613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2fd78be-922c-457b-9fb9-965fda4d0afe.info
Apr 15 20:10:24 devstack sudo[87613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:25 devstack sudo[87613]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:25 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-339a15c2-aa18-4c38-8ead-68ffe93e1c2b tempest-VolumesExtendTest-1563095803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2fd78be-922c-457b-9fb9-965fda4d0afe.info" returned: 0 in 0.567s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:25 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-339a15c2-aa18-4c38-8ead-68ffe93e1c2b tempest-VolumesExtendTest-1563095803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.400s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:10:25 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-45139cc1-fb88-40fe-a461-1dc5036c97fe tempest-VolumesListAdminTestJSON-416736655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.664s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:10:25 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-45139cc1-fb88-40fe-a461-1dc5036c97fe tempest-VolumesListAdminTestJSON-416736655 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:10:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1769570464',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db9a3eaf-5f8c-4ec8-8130-1d1797330a79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='074be0a4a491495285e8d7d1a69f1878',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:10:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:10:22Z,use_quota=True,user_id='121da201094745f48f9443815a0c5d6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:10:25 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-45139cc1-fb88-40fe-a461-1dc5036c97fe tempest-VolumesListAdminTestJSON-416736655 None] Creating volume db9a3eaf-5f8c-4ec8-8130-1d1797330a79 {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:10:25 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-45139cc1-fb88-40fe-a461-1dc5036c97fe tempest-VolumesListAdminTestJSON-416736655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:10:25 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-45139cc1-fb88-40fe-a461-1dc5036c97fe tempest-VolumesListAdminTestJSON-416736655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:10:25 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-45139cc1-fb88-40fe-a461-1dc5036c97fe tempest-VolumesListAdminTestJSON-416736655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:10:25 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-45139cc1-fb88-40fe-a461-1dc5036c97fe tempest-VolumesListAdminTestJSON-416736655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:10:25 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-45139cc1-fb88-40fe-a461-1dc5036c97fe tempest-VolumesListAdminTestJSON-416736655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:10:25 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-45139cc1-fb88-40fe-a461-1dc5036c97fe tempest-VolumesListAdminTestJSON-416736655 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:10:25 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-45139cc1-fb88-40fe-a461-1dc5036c97fe tempest-VolumesListAdminTestJSON-416736655 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:10:25 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-45139cc1-fb88-40fe-a461-1dc5036c97fe tempest-VolumesListAdminTestJSON-416736655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-db9a3eaf-5f8c-4ec8-8130-1d1797330a79 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:25 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-339a15c2-aa18-4c38-8ead-68ffe93e1c2b tempest-VolumesExtendTest-1563095803 None] Create snapshot completed successfully
Apr 15 20:10:25 devstack sudo[87642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-db9a3eaf-5f8c-4ec8-8130-1d1797330a79 1073741824
Apr 15 20:10:25 devstack sudo[87642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:25 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-ec784013-11b1-4261-9fd0-a0dbf70adfde tempest-VolumesExtendTest-1563095803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:10:25 devstack sudo[87642]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:25 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-45139cc1-fb88-40fe-a461-1dc5036c97fe tempest-VolumesListAdminTestJSON-416736655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-db9a3eaf-5f8c-4ec8-8130-1d1797330a79 1073741824" returned: 0 in 0.772s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:25 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-45139cc1-fb88-40fe-a461-1dc5036c97fe tempest-VolumesListAdminTestJSON-416736655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-db9a3eaf-5f8c-4ec8-8130-1d1797330a79 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:25 devstack sudo[87649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-db9a3eaf-5f8c-4ec8-8130-1d1797330a79
Apr 15 20:10:25 devstack sudo[87649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:26 devstack sudo[87649]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:26 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-45139cc1-fb88-40fe-a461-1dc5036c97fe tempest-VolumesListAdminTestJSON-416736655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-db9a3eaf-5f8c-4ec8-8130-1d1797330a79" returned: 0 in 0.697s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:26 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-45139cc1-fb88-40fe-a461-1dc5036c97fe tempest-VolumesListAdminTestJSON-416736655 None] <== create_volume: return (1498ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:10:26 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-45139cc1-fb88-40fe-a461-1dc5036c97fe tempest-VolumesListAdminTestJSON-416736655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.502s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:10:26 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-ec784013-11b1-4261-9fd0-a0dbf70adfde tempest-VolumesExtendTest-1563095803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.825s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:10:26 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-45139cc1-fb88-40fe-a461-1dc5036c97fe tempest-VolumesListAdminTestJSON-416736655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c68c0484-0497-498a-958d-9e359d36ff30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db9a3eaf-5f8c-4ec8-8130-1d1797330a79', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:26 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-45139cc1-fb88-40fe-a461-1dc5036c97fe tempest-VolumesListAdminTestJSON-416736655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a08b1f3-da40-4b74-91c8-3a5428f1cda1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:26 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d8d223a-73a7-4a69-89a5-5cd932cdbe43]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:10:26 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-ec784013-11b1-4261-9fd0-a0dbf70adfde tempest-VolumesExtendTest-1563095803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2fd78be-922c-457b-9fb9-965fda4d0afe {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:26 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-45139cc1-fb88-40fe-a461-1dc5036c97fe tempest-VolumesListAdminTestJSON-416736655 None] Volume volume-db9a3eaf-5f8c-4ec8-8130-1d1797330a79 (db9a3eaf-5f8c-4ec8-8130-1d1797330a79): created successfully
Apr 15 20:10:26 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-45139cc1-fb88-40fe-a461-1dc5036c97fe tempest-VolumesListAdminTestJSON-416736655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a08b1f3-da40-4b74-91c8-3a5428f1cda1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:26 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-45139cc1-fb88-40fe-a461-1dc5036c97fe tempest-VolumesListAdminTestJSON-416736655 None] Flow 'volume_create_manager' (5924c639-234d-449c-a1cf-d32da62791f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:10:26 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-45139cc1-fb88-40fe-a461-1dc5036c97fe tempest-VolumesListAdminTestJSON-416736655 None] Created volume successfully.
Apr 15 20:10:26 devstack sudo[87653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2fd78be-922c-457b-9fb9-965fda4d0afe
Apr 15 20:10:26 devstack sudo[87653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:27 devstack sudo[87653]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:27 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-ec784013-11b1-4261-9fd0-a0dbf70adfde tempest-VolumesExtendTest-1563095803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2fd78be-922c-457b-9fb9-965fda4d0afe" returned: 0 in 0.685s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:27 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-ec784013-11b1-4261-9fd0-a0dbf70adfde tempest-VolumesExtendTest-1563095803 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2fd78be-922c-457b-9fb9-965fda4d0afe.27195212-b584-4b7a-9340-ae9ea5cf6e1c 2G {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:27 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-ec784013-11b1-4261-9fd0-a0dbf70adfde tempest-VolumesExtendTest-1563095803 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2fd78be-922c-457b-9fb9-965fda4d0afe.27195212-b584-4b7a-9340-ae9ea5cf6e1c 2G" returned: 0 in 0.106s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:27 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-ec784013-11b1-4261-9fd0-a0dbf70adfde tempest-VolumesExtendTest-1563095803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.834s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:10:27 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-ec784013-11b1-4261-9fd0-a0dbf70adfde tempest-VolumesExtendTest-1563095803 None] Extend volume completed successfully.
Apr 15 20:10:28 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-cea2af55-5454-4fb0-bb82-ccdefa6ed872 tempest-VolumesExtendTest-1563095803 None] Acquiring lock "cinder-27195212-b584-4b7a-9340-ae9ea5cf6e1c-delete_snapshot" by "delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:10:28 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-cea2af55-5454-4fb0-bb82-ccdefa6ed872 tempest-VolumesExtendTest-1563095803 None] Lock "cinder-27195212-b584-4b7a-9340-ae9ea5cf6e1c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:10:28 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-cea2af55-5454-4fb0-bb82-ccdefa6ed872 tempest-VolumesExtendTest-1563095803 None] Acquiring lock "cinder-quobyte-c2fd78be-922c-457b-9fb9-965fda4d0afe" by "delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:10:28 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-cea2af55-5454-4fb0-bb82-ccdefa6ed872 tempest-VolumesExtendTest-1563095803 None] Lock "cinder-quobyte-c2fd78be-922c-457b-9fb9-965fda4d0afe" acquired by "delete_snapshot" :: waited 0.026s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:10:28 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-cea2af55-5454-4fb0-bb82-ccdefa6ed872 tempest-VolumesExtendTest-1563095803 None] Acquiring lock "cinder-quobyte-27195212-b584-4b7a-9340-ae9ea5cf6e1c" by "_delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:10:28 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-cea2af55-5454-4fb0-bb82-ccdefa6ed872 tempest-VolumesExtendTest-1563095803 None] Lock "cinder-quobyte-27195212-b584-4b7a-9340-ae9ea5cf6e1c" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:10:28 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-cea2af55-5454-4fb0-bb82-ccdefa6ed872 tempest-VolumesExtendTest-1563095803 None] Deleting offline snapshot 27195212-b584-4b7a-9340-ae9ea5cf6e1c of volume c2fd78be-922c-457b-9fb9-965fda4d0afe {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 20:10:28 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-cea2af55-5454-4fb0-bb82-ccdefa6ed872 tempest-VolumesExtendTest-1563095803 None] snapshot_file for this snap is: volume-c2fd78be-922c-457b-9fb9-965fda4d0afe.27195212-b584-4b7a-9340-ae9ea5cf6e1c {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 20:10:28 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8c89b2-935a-404f-8902-3ee2a7390082]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:10:28 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-cea2af55-5454-4fb0-bb82-ccdefa6ed872 tempest-VolumesExtendTest-1563095803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2fd78be-922c-457b-9fb9-965fda4d0afe.27195212-b584-4b7a-9340-ae9ea5cf6e1c {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:28 devstack sudo[87666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2fd78be-922c-457b-9fb9-965fda4d0afe.27195212-b584-4b7a-9340-ae9ea5cf6e1c
Apr 15 20:10:28 devstack sudo[87666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:28 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-24b1a0d3-fd47-4a8b-873b-70cd87235522 tempest-VolumesListAdminTestJSON-1752073717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:10:28 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-24b1a0d3-fd47-4a8b-873b-70cd87235522 tempest-VolumesListAdminTestJSON-1752073717 None] Flow 'volume_create_manager' (07c52ef2-b759-4ad6-84ad-775700cfc301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:10:28 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-24b1a0d3-fd47-4a8b-873b-70cd87235522 tempest-VolumesListAdminTestJSON-1752073717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61dc7fd3-b56f-4813-8e56-71739dffdce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:28 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-24b1a0d3-fd47-4a8b-873b-70cd87235522 tempest-VolumesListAdminTestJSON-1752073717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61dc7fd3-b56f-4813-8e56-71739dffdce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:10:28Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c67b136-b1f1-4e09-86be-d1e57000f5df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5ead82ceb1f45b7a811e51fd8708513',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:10:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:10:28Z,use_quota=True,user_id='3b14851175be4936a1859533fcd17bee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:28 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-24b1a0d3-fd47-4a8b-873b-70cd87235522 tempest-VolumesListAdminTestJSON-1752073717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02215e63-5441-442e-b69a-676557e2da07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:28 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-24b1a0d3-fd47-4a8b-873b-70cd87235522 tempest-VolumesListAdminTestJSON-1752073717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02215e63-5441-442e-b69a-676557e2da07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:28 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-24b1a0d3-fd47-4a8b-873b-70cd87235522 tempest-VolumesListAdminTestJSON-1752073717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5b29030-f4da-488d-acea-b0b8ef6b36c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:28 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-24b1a0d3-fd47-4a8b-873b-70cd87235522 tempest-VolumesListAdminTestJSON-1752073717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5b29030-f4da-488d-acea-b0b8ef6b36c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c67b136-b1f1-4e09-86be-d1e57000f5df', 'volume_name': 'volume-8c67b136-b1f1-4e09-86be-d1e57000f5df', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:28 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-24b1a0d3-fd47-4a8b-873b-70cd87235522 tempest-VolumesListAdminTestJSON-1752073717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddc971fb-bb9e-46bc-8467-76ceeea7c324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:28 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-24b1a0d3-fd47-4a8b-873b-70cd87235522 tempest-VolumesListAdminTestJSON-1752073717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddc971fb-bb9e-46bc-8467-76ceeea7c324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:28 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-24b1a0d3-fd47-4a8b-873b-70cd87235522 tempest-VolumesListAdminTestJSON-1752073717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1acc55a9-e3af-493e-b043-69d15fa8fb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:28 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-24b1a0d3-fd47-4a8b-873b-70cd87235522 tempest-VolumesListAdminTestJSON-1752073717 None] Volume 8c67b136-b1f1-4e09-86be-d1e57000f5df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c67b136-b1f1-4e09-86be-d1e57000f5df', 'volume_size': 1}
Apr 15 20:10:28 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-24b1a0d3-fd47-4a8b-873b-70cd87235522 tempest-VolumesListAdminTestJSON-1752073717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:10:28 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-24b1a0d3-fd47-4a8b-873b-70cd87235522 tempest-VolumesListAdminTestJSON-1752073717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:10:28 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-24b1a0d3-fd47-4a8b-873b-70cd87235522 tempest-VolumesListAdminTestJSON-1752073717 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:10:28Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c67b136-b1f1-4e09-86be-d1e57000f5df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5ead82ceb1f45b7a811e51fd8708513',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:10:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:10:28Z,use_quota=True,user_id='3b14851175be4936a1859533fcd17bee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:10:28 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-24b1a0d3-fd47-4a8b-873b-70cd87235522 tempest-VolumesListAdminTestJSON-1752073717 None] Creating volume 8c67b136-b1f1-4e09-86be-d1e57000f5df {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:10:28 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-24b1a0d3-fd47-4a8b-873b-70cd87235522 tempest-VolumesListAdminTestJSON-1752073717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:10:28 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-24b1a0d3-fd47-4a8b-873b-70cd87235522 tempest-VolumesListAdminTestJSON-1752073717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:10:28 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-24b1a0d3-fd47-4a8b-873b-70cd87235522 tempest-VolumesListAdminTestJSON-1752073717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:10:28 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-24b1a0d3-fd47-4a8b-873b-70cd87235522 tempest-VolumesListAdminTestJSON-1752073717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:10:28 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-24b1a0d3-fd47-4a8b-873b-70cd87235522 tempest-VolumesListAdminTestJSON-1752073717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:10:28 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-24b1a0d3-fd47-4a8b-873b-70cd87235522 tempest-VolumesListAdminTestJSON-1752073717 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:10:28 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-24b1a0d3-fd47-4a8b-873b-70cd87235522 tempest-VolumesListAdminTestJSON-1752073717 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:10:28 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-24b1a0d3-fd47-4a8b-873b-70cd87235522 tempest-VolumesListAdminTestJSON-1752073717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8c67b136-b1f1-4e09-86be-d1e57000f5df 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:28 devstack sudo[87671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8c67b136-b1f1-4e09-86be-d1e57000f5df 1073741824
Apr 15 20:10:28 devstack sudo[87671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:28 devstack sudo[87666]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:28 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-cea2af55-5454-4fb0-bb82-ccdefa6ed872 tempest-VolumesExtendTest-1563095803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2fd78be-922c-457b-9fb9-965fda4d0afe.27195212-b584-4b7a-9340-ae9ea5cf6e1c" returned: 0 in 0.744s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:28 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-cea2af55-5454-4fb0-bb82-ccdefa6ed872 tempest-VolumesExtendTest-1563095803 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2fd78be-922c-457b-9fb9-965fda4d0afe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82646) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 20:10:28 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[e48a3757-b41f-4265-a4bc-95bf759569da]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:10:28 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-cea2af55-5454-4fb0-bb82-ccdefa6ed872 tempest-VolumesExtendTest-1563095803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2fd78be-922c-457b-9fb9-965fda4d0afe {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:28 devstack sudo[87685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2fd78be-922c-457b-9fb9-965fda4d0afe
Apr 15 20:10:28 devstack sudo[87685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:29 devstack sudo[87671]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-24b1a0d3-fd47-4a8b-873b-70cd87235522 tempest-VolumesListAdminTestJSON-1752073717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8c67b136-b1f1-4e09-86be-d1e57000f5df 1073741824" returned: 0 in 0.802s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-24b1a0d3-fd47-4a8b-873b-70cd87235522 tempest-VolumesListAdminTestJSON-1752073717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8c67b136-b1f1-4e09-86be-d1e57000f5df {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:29 devstack sudo[87707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8c67b136-b1f1-4e09-86be-d1e57000f5df
Apr 15 20:10:29 devstack sudo[87707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:29 devstack sudo[87685]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-cea2af55-5454-4fb0-bb82-ccdefa6ed872 tempest-VolumesExtendTest-1563095803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2fd78be-922c-457b-9fb9-965fda4d0afe" returned: 0 in 0.685s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-cea2af55-5454-4fb0-bb82-ccdefa6ed872 tempest-VolumesExtendTest-1563095803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2fd78be-922c-457b-9fb9-965fda4d0afe.27195212-b584-4b7a-9340-ae9ea5cf6e1c {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:29 devstack sudo[87712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2fd78be-922c-457b-9fb9-965fda4d0afe.27195212-b584-4b7a-9340-ae9ea5cf6e1c
Apr 15 20:10:29 devstack sudo[87712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:29 devstack sudo[87707]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-24b1a0d3-fd47-4a8b-873b-70cd87235522 tempest-VolumesListAdminTestJSON-1752073717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8c67b136-b1f1-4e09-86be-d1e57000f5df" returned: 0 in 0.522s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:29 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-24b1a0d3-fd47-4a8b-873b-70cd87235522 tempest-VolumesListAdminTestJSON-1752073717 None] <== create_volume: return (1361ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:10:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-24b1a0d3-fd47-4a8b-873b-70cd87235522 tempest-VolumesListAdminTestJSON-1752073717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.363s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:10:29 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-24b1a0d3-fd47-4a8b-873b-70cd87235522 tempest-VolumesListAdminTestJSON-1752073717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1acc55a9-e3af-493e-b043-69d15fa8fb0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c67b136-b1f1-4e09-86be-d1e57000f5df', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:29 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-24b1a0d3-fd47-4a8b-873b-70cd87235522 tempest-VolumesListAdminTestJSON-1752073717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6e3da1b-722a-4f23-88e1-874a975ad936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:29 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-24b1a0d3-fd47-4a8b-873b-70cd87235522 tempest-VolumesListAdminTestJSON-1752073717 None] Volume volume-8c67b136-b1f1-4e09-86be-d1e57000f5df (8c67b136-b1f1-4e09-86be-d1e57000f5df): created successfully
Apr 15 20:10:29 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-24b1a0d3-fd47-4a8b-873b-70cd87235522 tempest-VolumesListAdminTestJSON-1752073717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6e3da1b-722a-4f23-88e1-874a975ad936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:29 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-24b1a0d3-fd47-4a8b-873b-70cd87235522 tempest-VolumesListAdminTestJSON-1752073717 None] Flow 'volume_create_manager' (07c52ef2-b759-4ad6-84ad-775700cfc301) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:10:29 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-24b1a0d3-fd47-4a8b-873b-70cd87235522 tempest-VolumesListAdminTestJSON-1752073717 None] Created volume successfully.
Apr 15 20:10:30 devstack sudo[87712]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-cea2af55-5454-4fb0-bb82-ccdefa6ed872 tempest-VolumesExtendTest-1563095803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2fd78be-922c-457b-9fb9-965fda4d0afe.27195212-b584-4b7a-9340-ae9ea5cf6e1c" returned: 0 in 0.519s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-cea2af55-5454-4fb0-bb82-ccdefa6ed872 tempest-VolumesExtendTest-1563095803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2fd78be-922c-457b-9fb9-965fda4d0afe.27195212-b584-4b7a-9340-ae9ea5cf6e1c {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:30 devstack sudo[87720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2fd78be-922c-457b-9fb9-965fda4d0afe.27195212-b584-4b7a-9340-ae9ea5cf6e1c
Apr 15 20:10:30 devstack sudo[87720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:30 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-3d680672-1ab7-4819-aa90-09b5b6bf59b9 tempest-VolumesListAdminTestJSON-1752073717 None] Acquiring lock "cinder-8c67b136-b1f1-4e09-86be-d1e57000f5df-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:10:30 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-3d680672-1ab7-4819-aa90-09b5b6bf59b9 tempest-VolumesListAdminTestJSON-1752073717 None] Lock "cinder-8c67b136-b1f1-4e09-86be-d1e57000f5df-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:10:30 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-3d680672-1ab7-4819-aa90-09b5b6bf59b9 tempest-VolumesListAdminTestJSON-1752073717 None] Acquiring lock "cinder-quobyte-8c67b136-b1f1-4e09-86be-d1e57000f5df" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:10:30 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-3d680672-1ab7-4819-aa90-09b5b6bf59b9 tempest-VolumesListAdminTestJSON-1752073717 None] Lock "cinder-quobyte-8c67b136-b1f1-4e09-86be-d1e57000f5df" acquired by "delete_volume" :: waited 0.008s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:10:30 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d3a6b5-79aa-4165-af10-c29cde27be35]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:10:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-3d680672-1ab7-4819-aa90-09b5b6bf59b9 tempest-VolumesListAdminTestJSON-1752073717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8c67b136-b1f1-4e09-86be-d1e57000f5df {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:30 devstack sudo[87720]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-cea2af55-5454-4fb0-bb82-ccdefa6ed872 tempest-VolumesExtendTest-1563095803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2fd78be-922c-457b-9fb9-965fda4d0afe.27195212-b584-4b7a-9340-ae9ea5cf6e1c" returned: 0 in 0.637s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:30 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-e7ff5631-4029-43aa-9aef-a0890035e1ba tempest-VolumesListAdminTestJSON-416736655 None] Acquiring lock "cinder-db9a3eaf-5f8c-4ec8-8130-1d1797330a79-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:10:30 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-cea2af55-5454-4fb0-bb82-ccdefa6ed872 tempest-VolumesExtendTest-1563095803 None] Lock "cinder-quobyte-27195212-b584-4b7a-9340-ae9ea5cf6e1c" released by "_delete_snapshot" :: held 2.674s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:10:30 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-e7ff5631-4029-43aa-9aef-a0890035e1ba tempest-VolumesListAdminTestJSON-416736655 None] Lock "cinder-db9a3eaf-5f8c-4ec8-8130-1d1797330a79-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:10:30 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-cea2af55-5454-4fb0-bb82-ccdefa6ed872 tempest-VolumesExtendTest-1563095803 None] Lock "cinder-quobyte-c2fd78be-922c-457b-9fb9-965fda4d0afe" released by "delete_snapshot" :: held 2.710s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:10:30 devstack sudo[87724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8c67b136-b1f1-4e09-86be-d1e57000f5df
Apr 15 20:10:30 devstack sudo[87724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:30 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-e7ff5631-4029-43aa-9aef-a0890035e1ba tempest-VolumesListAdminTestJSON-416736655 None] Acquiring lock "cinder-quobyte-db9a3eaf-5f8c-4ec8-8130-1d1797330a79" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:10:30 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-cea2af55-5454-4fb0-bb82-ccdefa6ed872 tempest-VolumesExtendTest-1563095803 None] Created reservations ['1dbd8808-da7f-4549-8b9b-26f9e654ad94', '0249e99c-76fa-4d3b-9f2c-5441dbb590bb', '25a392bc-793b-45da-aabf-6e2d231ae486', 'f3ad2654-27fd-463c-8a23-894e711f6227'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:10:30 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-e7ff5631-4029-43aa-9aef-a0890035e1ba tempest-VolumesListAdminTestJSON-416736655 None] Lock "cinder-quobyte-db9a3eaf-5f8c-4ec8-8130-1d1797330a79" acquired by "delete_volume" :: waited 0.034s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:10:30 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad09aa55-f7dd-4795-b1e9-fc0082f3f105]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:10:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e7ff5631-4029-43aa-9aef-a0890035e1ba tempest-VolumesListAdminTestJSON-416736655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-db9a3eaf-5f8c-4ec8-8130-1d1797330a79 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:30 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-cea2af55-5454-4fb0-bb82-ccdefa6ed872 tempest-VolumesExtendTest-1563095803 None] Delete snapshot completed successfully.
Apr 15 20:10:30 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-cea2af55-5454-4fb0-bb82-ccdefa6ed872 tempest-VolumesExtendTest-1563095803 None] Lock "cinder-27195212-b584-4b7a-9340-ae9ea5cf6e1c-delete_snapshot" released by "delete_snapshot" :: held 2.849s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:10:30 devstack sudo[87726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-db9a3eaf-5f8c-4ec8-8130-1d1797330a79
Apr 15 20:10:30 devstack sudo[87726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:31 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-a9e780ca-6307-40b3-bcc5-f3c02a1f3606 tempest-VolumesExtendTest-1563095803 None] Acquiring lock "cinder-c2fd78be-922c-457b-9fb9-965fda4d0afe-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:10:31 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-a9e780ca-6307-40b3-bcc5-f3c02a1f3606 tempest-VolumesExtendTest-1563095803 None] Lock "cinder-c2fd78be-922c-457b-9fb9-965fda4d0afe-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:10:31 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-a9e780ca-6307-40b3-bcc5-f3c02a1f3606 tempest-VolumesExtendTest-1563095803 None] Acquiring lock "cinder-quobyte-c2fd78be-922c-457b-9fb9-965fda4d0afe" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:10:31 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-a9e780ca-6307-40b3-bcc5-f3c02a1f3606 tempest-VolumesExtendTest-1563095803 None] Lock "cinder-quobyte-c2fd78be-922c-457b-9fb9-965fda4d0afe" acquired by "delete_volume" :: waited 0.009s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:10:31 devstack sudo[87724]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-3d680672-1ab7-4819-aa90-09b5b6bf59b9 tempest-VolumesListAdminTestJSON-1752073717 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8c67b136-b1f1-4e09-86be-d1e57000f5df" returned: 0 in 0.644s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-3d680672-1ab7-4819-aa90-09b5b6bf59b9 tempest-VolumesListAdminTestJSON-1752073717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8c67b136-b1f1-4e09-86be-d1e57000f5df {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:31 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[74720b28-e4c9-4adf-961c-893c4f613e2e]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:10:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-a9e780ca-6307-40b3-bcc5-f3c02a1f3606 tempest-VolumesExtendTest-1563095803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2fd78be-922c-457b-9fb9-965fda4d0afe {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:31 devstack sudo[87731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8c67b136-b1f1-4e09-86be-d1e57000f5df
Apr 15 20:10:31 devstack sudo[87731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:31 devstack sudo[87732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2fd78be-922c-457b-9fb9-965fda4d0afe
Apr 15 20:10:31 devstack sudo[87732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:31 devstack sudo[87726]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e7ff5631-4029-43aa-9aef-a0890035e1ba tempest-VolumesListAdminTestJSON-416736655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-db9a3eaf-5f8c-4ec8-8130-1d1797330a79" returned: 0 in 0.686s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e7ff5631-4029-43aa-9aef-a0890035e1ba tempest-VolumesListAdminTestJSON-416736655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-db9a3eaf-5f8c-4ec8-8130-1d1797330a79 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:31 devstack sudo[87738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-db9a3eaf-5f8c-4ec8-8130-1d1797330a79
Apr 15 20:10:31 devstack sudo[87738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:31 devstack sudo[87731]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-3d680672-1ab7-4819-aa90-09b5b6bf59b9 tempest-VolumesListAdminTestJSON-1752073717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8c67b136-b1f1-4e09-86be-d1e57000f5df" returned: 0 in 0.502s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:31 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-3d680672-1ab7-4819-aa90-09b5b6bf59b9 tempest-VolumesListAdminTestJSON-1752073717 None] Lock "cinder-quobyte-8c67b136-b1f1-4e09-86be-d1e57000f5df" released by "delete_volume" :: held 1.178s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:10:31 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-3d680672-1ab7-4819-aa90-09b5b6bf59b9 tempest-VolumesListAdminTestJSON-1752073717 None] Created reservations ['73360e9d-5b52-44bd-914c-fb92b121370a', 'bc1403fd-b584-458e-ab50-430aa9067e74', '8f643eb9-7db3-4699-b97f-020ad820ecfd', '27e0da2e-3c47-4306-b227-37a8c54f5e44'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:10:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-3d680672-1ab7-4819-aa90-09b5b6bf59b9 tempest-VolumesListAdminTestJSON-1752073717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:10:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-3d680672-1ab7-4819-aa90-09b5b6bf59b9 tempest-VolumesListAdminTestJSON-1752073717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:10:31 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-3d680672-1ab7-4819-aa90-09b5b6bf59b9 tempest-VolumesListAdminTestJSON-1752073717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:10:31 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-3d680672-1ab7-4819-aa90-09b5b6bf59b9 tempest-VolumesListAdminTestJSON-1752073717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:10:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-3d680672-1ab7-4819-aa90-09b5b6bf59b9 tempest-VolumesListAdminTestJSON-1752073717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:10:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-3d680672-1ab7-4819-aa90-09b5b6bf59b9 tempest-VolumesListAdminTestJSON-1752073717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:31 devstack sudo[87741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:10:31 devstack sudo[87741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:32 devstack sudo[87732]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-a9e780ca-6307-40b3-bcc5-f3c02a1f3606 tempest-VolumesExtendTest-1563095803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2fd78be-922c-457b-9fb9-965fda4d0afe" returned: 0 in 0.745s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-a9e780ca-6307-40b3-bcc5-f3c02a1f3606 tempest-VolumesExtendTest-1563095803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2fd78be-922c-457b-9fb9-965fda4d0afe {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:32 devstack sudo[87738]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e7ff5631-4029-43aa-9aef-a0890035e1ba tempest-VolumesListAdminTestJSON-416736655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-db9a3eaf-5f8c-4ec8-8130-1d1797330a79" returned: 0 in 0.546s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:32 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-e7ff5631-4029-43aa-9aef-a0890035e1ba tempest-VolumesListAdminTestJSON-416736655 None] Lock "cinder-quobyte-db9a3eaf-5f8c-4ec8-8130-1d1797330a79" released by "delete_volume" :: held 1.275s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:10:32 devstack sudo[87747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2fd78be-922c-457b-9fb9-965fda4d0afe
Apr 15 20:10:32 devstack sudo[87747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:32 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-e7ff5631-4029-43aa-9aef-a0890035e1ba tempest-VolumesListAdminTestJSON-416736655 None] Created reservations ['bad210ed-7ea6-4805-b4c8-95ea8376e57f', 'cf81297a-267a-4e81-af70-8b7f2e4ed878', '09e41313-7114-4873-97f4-9c4210fa5de5', 'fec87ba5-994d-42a4-ba61-ef69ce47c106'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:10:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-e7ff5631-4029-43aa-9aef-a0890035e1ba tempest-VolumesListAdminTestJSON-416736655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:10:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-e7ff5631-4029-43aa-9aef-a0890035e1ba tempest-VolumesListAdminTestJSON-416736655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:10:32 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-e7ff5631-4029-43aa-9aef-a0890035e1ba tempest-VolumesListAdminTestJSON-416736655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:10:32 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-e7ff5631-4029-43aa-9aef-a0890035e1ba tempest-VolumesListAdminTestJSON-416736655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:10:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-e7ff5631-4029-43aa-9aef-a0890035e1ba tempest-VolumesListAdminTestJSON-416736655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:10:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e7ff5631-4029-43aa-9aef-a0890035e1ba tempest-VolumesListAdminTestJSON-416736655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:32 devstack sudo[87749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:10:32 devstack sudo[87749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:32 devstack sudo[87741]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-3d680672-1ab7-4819-aa90-09b5b6bf59b9 tempest-VolumesListAdminTestJSON-1752073717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.613s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:32 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-3d680672-1ab7-4819-aa90-09b5b6bf59b9 tempest-VolumesListAdminTestJSON-1752073717 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:10:32 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-3d680672-1ab7-4819-aa90-09b5b6bf59b9 tempest-VolumesListAdminTestJSON-1752073717 None] Deleted volume successfully.
Apr 15 20:10:32 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-3d680672-1ab7-4819-aa90-09b5b6bf59b9 tempest-VolumesListAdminTestJSON-1752073717 None] Lock "cinder-8c67b136-b1f1-4e09-86be-d1e57000f5df-delete_volume" released by "delete_volume" :: held 1.944s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:10:32 devstack sudo[87747]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-a9e780ca-6307-40b3-bcc5-f3c02a1f3606 tempest-VolumesExtendTest-1563095803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2fd78be-922c-457b-9fb9-965fda4d0afe" returned: 0 in 0.577s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:32 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-a9e780ca-6307-40b3-bcc5-f3c02a1f3606 tempest-VolumesExtendTest-1563095803 None] Lock "cinder-quobyte-c2fd78be-922c-457b-9fb9-965fda4d0afe" released by "delete_volume" :: held 1.361s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:10:32 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-a9e780ca-6307-40b3-bcc5-f3c02a1f3606 tempest-VolumesExtendTest-1563095803 None] Created reservations ['483c2ffd-8ba6-4b62-b807-307cd35ef792', '56edc8f1-e6ec-4bbf-b3bc-e298c1e017ff', 'adb1bfa6-a1e0-434d-909e-98e4f8b17d0c', '05718134-9173-457b-bab3-fe35a68d3ebe'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:10:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-a9e780ca-6307-40b3-bcc5-f3c02a1f3606 tempest-VolumesExtendTest-1563095803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:10:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-a9e780ca-6307-40b3-bcc5-f3c02a1f3606 tempest-VolumesExtendTest-1563095803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:10:32 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-a9e780ca-6307-40b3-bcc5-f3c02a1f3606 tempest-VolumesExtendTest-1563095803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:10:32 devstack sudo[87749]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:32 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-a9e780ca-6307-40b3-bcc5-f3c02a1f3606 tempest-VolumesExtendTest-1563095803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:10:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-a9e780ca-6307-40b3-bcc5-f3c02a1f3606 tempest-VolumesExtendTest-1563095803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:10:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-a9e780ca-6307-40b3-bcc5-f3c02a1f3606 tempest-VolumesExtendTest-1563095803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e7ff5631-4029-43aa-9aef-a0890035e1ba tempest-VolumesListAdminTestJSON-416736655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.630s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:32 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-e7ff5631-4029-43aa-9aef-a0890035e1ba tempest-VolumesListAdminTestJSON-416736655 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:10:32 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-e7ff5631-4029-43aa-9aef-a0890035e1ba tempest-VolumesListAdminTestJSON-416736655 None] Deleted volume successfully.
Apr 15 20:10:32 devstack sudo[87754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:10:32 devstack sudo[87754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:32 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-e7ff5631-4029-43aa-9aef-a0890035e1ba tempest-VolumesListAdminTestJSON-416736655 None] Lock "cinder-db9a3eaf-5f8c-4ec8-8130-1d1797330a79-delete_volume" released by "delete_volume" :: held 2.113s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:10:32 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-a89bcb99-3930-4074-8ebf-c5fbd9a15602 tempest-VolumesListAdminTestJSON-416736655 None] Acquiring lock "cinder-02a8189a-e0c9-4ebd-a183-36023631073d-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:10:32 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-a89bcb99-3930-4074-8ebf-c5fbd9a15602 tempest-VolumesListAdminTestJSON-416736655 None] Lock "cinder-02a8189a-e0c9-4ebd-a183-36023631073d-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:10:33 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-a89bcb99-3930-4074-8ebf-c5fbd9a15602 tempest-VolumesListAdminTestJSON-416736655 None] Acquiring lock "cinder-quobyte-02a8189a-e0c9-4ebd-a183-36023631073d" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:10:33 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-a89bcb99-3930-4074-8ebf-c5fbd9a15602 tempest-VolumesListAdminTestJSON-416736655 None] Lock "cinder-quobyte-02a8189a-e0c9-4ebd-a183-36023631073d" acquired by "delete_volume" :: waited 0.011s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:10:33 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[7880b41d-cf87-4f70-8c09-290f07103496]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:10:33 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-a89bcb99-3930-4074-8ebf-c5fbd9a15602 tempest-VolumesListAdminTestJSON-416736655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-02a8189a-e0c9-4ebd-a183-36023631073d {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:33 devstack sudo[87756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-02a8189a-e0c9-4ebd-a183-36023631073d
Apr 15 20:10:33 devstack sudo[87756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:33 devstack sudo[87754]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:33 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-a9e780ca-6307-40b3-bcc5-f3c02a1f3606 tempest-VolumesExtendTest-1563095803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.510s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:33 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-a9e780ca-6307-40b3-bcc5-f3c02a1f3606 tempest-VolumesExtendTest-1563095803 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:10:33 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-a9e780ca-6307-40b3-bcc5-f3c02a1f3606 tempest-VolumesExtendTest-1563095803 None] Deleted volume successfully.
Apr 15 20:10:33 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-a9e780ca-6307-40b3-bcc5-f3c02a1f3606 tempest-VolumesExtendTest-1563095803 None] Lock "cinder-c2fd78be-922c-457b-9fb9-965fda4d0afe-delete_volume" released by "delete_volume" :: held 2.084s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:10:33 devstack sudo[87756]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:33 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-a89bcb99-3930-4074-8ebf-c5fbd9a15602 tempest-VolumesListAdminTestJSON-416736655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-02a8189a-e0c9-4ebd-a183-36023631073d" returned: 0 in 0.687s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:33 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-a89bcb99-3930-4074-8ebf-c5fbd9a15602 tempest-VolumesListAdminTestJSON-416736655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-02a8189a-e0c9-4ebd-a183-36023631073d {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:33 devstack sudo[87768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-02a8189a-e0c9-4ebd-a183-36023631073d
Apr 15 20:10:33 devstack sudo[87768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:34 devstack sudo[87768]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:34 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-a89bcb99-3930-4074-8ebf-c5fbd9a15602 tempest-VolumesListAdminTestJSON-416736655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-02a8189a-e0c9-4ebd-a183-36023631073d" returned: 0 in 0.504s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:34 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-a89bcb99-3930-4074-8ebf-c5fbd9a15602 tempest-VolumesListAdminTestJSON-416736655 None] Lock "cinder-quobyte-02a8189a-e0c9-4ebd-a183-36023631073d" released by "delete_volume" :: held 1.221s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:10:34 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-a89bcb99-3930-4074-8ebf-c5fbd9a15602 tempest-VolumesListAdminTestJSON-416736655 None] Created reservations ['125a9d7f-b21c-446f-a00c-32bce3cd8712', '86ab15e9-fa23-4cff-9dc5-a2b5ed92cbc2', '0f859964-6a3c-4f11-8f54-26e3cf7cfd8e', '10cfd0b9-4a5d-4248-95f6-b73f0faf8640'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:10:34 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-a89bcb99-3930-4074-8ebf-c5fbd9a15602 tempest-VolumesListAdminTestJSON-416736655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:10:34 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-a89bcb99-3930-4074-8ebf-c5fbd9a15602 tempest-VolumesListAdminTestJSON-416736655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:10:34 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-a89bcb99-3930-4074-8ebf-c5fbd9a15602 tempest-VolumesListAdminTestJSON-416736655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:10:34 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-a89bcb99-3930-4074-8ebf-c5fbd9a15602 tempest-VolumesListAdminTestJSON-416736655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:10:34 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-a89bcb99-3930-4074-8ebf-c5fbd9a15602 tempest-VolumesListAdminTestJSON-416736655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:10:34 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-a89bcb99-3930-4074-8ebf-c5fbd9a15602 tempest-VolumesListAdminTestJSON-416736655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:34 devstack sudo[87771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:10:34 devstack sudo[87771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:35 devstack sudo[87771]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:35 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-a89bcb99-3930-4074-8ebf-c5fbd9a15602 tempest-VolumesListAdminTestJSON-416736655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.695s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:35 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-a89bcb99-3930-4074-8ebf-c5fbd9a15602 tempest-VolumesListAdminTestJSON-416736655 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:10:35 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-a89bcb99-3930-4074-8ebf-c5fbd9a15602 tempest-VolumesListAdminTestJSON-416736655 None] Deleted volume successfully.
Apr 15 20:10:35 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-a89bcb99-3930-4074-8ebf-c5fbd9a15602 tempest-VolumesListAdminTestJSON-416736655 None] Lock "cinder-02a8189a-e0c9-4ebd-a183-36023631073d-delete_volume" released by "delete_volume" :: held 2.091s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:10:35 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-d392add7-3bb3-4276-a87d-279f1b4337a1 tempest-VolumesListAdminTestJSON-416736655 None] Acquiring lock "cinder-6195829b-5aa3-4e67-b6e0-fd1c144646a0-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:10:35 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-d392add7-3bb3-4276-a87d-279f1b4337a1 tempest-VolumesListAdminTestJSON-416736655 None] Lock "cinder-6195829b-5aa3-4e67-b6e0-fd1c144646a0-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:10:35 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-d392add7-3bb3-4276-a87d-279f1b4337a1 tempest-VolumesListAdminTestJSON-416736655 None] Acquiring lock "cinder-quobyte-6195829b-5aa3-4e67-b6e0-fd1c144646a0" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:10:35 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-d392add7-3bb3-4276-a87d-279f1b4337a1 tempest-VolumesListAdminTestJSON-416736655 None] Lock "cinder-quobyte-6195829b-5aa3-4e67-b6e0-fd1c144646a0" acquired by "delete_volume" :: waited 0.012s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:10:35 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dbebfb9-9953-49de-a1df-79b49b170bb6]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:10:35 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d392add7-3bb3-4276-a87d-279f1b4337a1 tempest-VolumesListAdminTestJSON-416736655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6195829b-5aa3-4e67-b6e0-fd1c144646a0 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:35 devstack sudo[87774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6195829b-5aa3-4e67-b6e0-fd1c144646a0
Apr 15 20:10:35 devstack sudo[87774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:36 devstack sudo[87774]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:36 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d392add7-3bb3-4276-a87d-279f1b4337a1 tempest-VolumesListAdminTestJSON-416736655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6195829b-5aa3-4e67-b6e0-fd1c144646a0" returned: 0 in 0.790s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:36 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d392add7-3bb3-4276-a87d-279f1b4337a1 tempest-VolumesListAdminTestJSON-416736655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6195829b-5aa3-4e67-b6e0-fd1c144646a0 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:36 devstack sudo[87780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6195829b-5aa3-4e67-b6e0-fd1c144646a0
Apr 15 20:10:36 devstack sudo[87780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:36 devstack sudo[87780]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:36 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d392add7-3bb3-4276-a87d-279f1b4337a1 tempest-VolumesListAdminTestJSON-416736655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6195829b-5aa3-4e67-b6e0-fd1c144646a0" returned: 0 in 0.685s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:36 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-d392add7-3bb3-4276-a87d-279f1b4337a1 tempest-VolumesListAdminTestJSON-416736655 None] Lock "cinder-quobyte-6195829b-5aa3-4e67-b6e0-fd1c144646a0" released by "delete_volume" :: held 1.511s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:10:36 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-d392add7-3bb3-4276-a87d-279f1b4337a1 tempest-VolumesListAdminTestJSON-416736655 None] Created reservations ['fdc25bef-9b8b-4bdc-82e6-e6298bfac137', '91e9c5c9-3035-4576-ba10-1a862ddbe73b', '085f5743-e85d-4d84-a7a1-91a21529cae1', 'fc0099e6-7222-44da-93a7-7110187be8e7'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:10:36 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-d392add7-3bb3-4276-a87d-279f1b4337a1 tempest-VolumesListAdminTestJSON-416736655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:10:36 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-d392add7-3bb3-4276-a87d-279f1b4337a1 tempest-VolumesListAdminTestJSON-416736655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:10:36 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-d392add7-3bb3-4276-a87d-279f1b4337a1 tempest-VolumesListAdminTestJSON-416736655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:10:36 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-d392add7-3bb3-4276-a87d-279f1b4337a1 tempest-VolumesListAdminTestJSON-416736655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:10:36 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-d392add7-3bb3-4276-a87d-279f1b4337a1 tempest-VolumesListAdminTestJSON-416736655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:10:36 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d392add7-3bb3-4276-a87d-279f1b4337a1 tempest-VolumesListAdminTestJSON-416736655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:36 devstack sudo[87785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:10:36 devstack sudo[87785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:37 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-d11a381a-4ad1-4863-9ba3-730fa185c207 tempest-VolumesGetTest-1188070236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:10:37 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d11a381a-4ad1-4863-9ba3-730fa185c207 tempest-VolumesGetTest-1188070236 None] Flow 'volume_create_manager' (13bfbcd9-3e7e-4fc9-b48d-a43801fdd5ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:10:37 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d11a381a-4ad1-4863-9ba3-730fa185c207 tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc7f8ccf-387d-44ca-932b-af5d2f39ed01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:37 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d11a381a-4ad1-4863-9ba3-730fa185c207 tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc7f8ccf-387d-44ca-932b-af5d2f39ed01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:10:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-611075345',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b52ae8b6-dd94-47ae-8fb7-0bf466effdd5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7fd52c85921a443d92f594a7f2280e9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:10:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:10:37Z,use_quota=True,user_id='d7a23dd5ade7439ca285e5922adb8785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:37 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d11a381a-4ad1-4863-9ba3-730fa185c207 tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb43005e-c18a-468d-b142-94758791226d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:37 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d11a381a-4ad1-4863-9ba3-730fa185c207 tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb43005e-c18a-468d-b142-94758791226d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:37 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d11a381a-4ad1-4863-9ba3-730fa185c207 tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea92b98a-58c7-4676-8016-b5a0cd2eb5b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:37 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d11a381a-4ad1-4863-9ba3-730fa185c207 tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea92b98a-58c7-4676-8016-b5a0cd2eb5b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b52ae8b6-dd94-47ae-8fb7-0bf466effdd5', 'volume_name': 'volume-b52ae8b6-dd94-47ae-8fb7-0bf466effdd5', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:37 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d11a381a-4ad1-4863-9ba3-730fa185c207 tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb1c2e31-59f9-4c0d-b570-25425cda27cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:37 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d11a381a-4ad1-4863-9ba3-730fa185c207 tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb1c2e31-59f9-4c0d-b570-25425cda27cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:37 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d11a381a-4ad1-4863-9ba3-730fa185c207 tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da7d110d-6f1e-4b84-ab0a-8221da5f01c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:37 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-d11a381a-4ad1-4863-9ba3-730fa185c207 tempest-VolumesGetTest-1188070236 None] Volume b52ae8b6-dd94-47ae-8fb7-0bf466effdd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b52ae8b6-dd94-47ae-8fb7-0bf466effdd5', 'volume_size': 1}
Apr 15 20:10:37 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-d11a381a-4ad1-4863-9ba3-730fa185c207 tempest-VolumesGetTest-1188070236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:10:37 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-d11a381a-4ad1-4863-9ba3-730fa185c207 tempest-VolumesGetTest-1188070236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:10:37 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-d11a381a-4ad1-4863-9ba3-730fa185c207 tempest-VolumesGetTest-1188070236 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:10:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-611075345',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b52ae8b6-dd94-47ae-8fb7-0bf466effdd5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7fd52c85921a443d92f594a7f2280e9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:10:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:10:37Z,use_quota=True,user_id='d7a23dd5ade7439ca285e5922adb8785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:10:37 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-d11a381a-4ad1-4863-9ba3-730fa185c207 tempest-VolumesGetTest-1188070236 None] Creating volume b52ae8b6-dd94-47ae-8fb7-0bf466effdd5 {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:10:37 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-d11a381a-4ad1-4863-9ba3-730fa185c207 tempest-VolumesGetTest-1188070236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:10:37 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-d11a381a-4ad1-4863-9ba3-730fa185c207 tempest-VolumesGetTest-1188070236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:10:37 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-d11a381a-4ad1-4863-9ba3-730fa185c207 tempest-VolumesGetTest-1188070236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:10:37 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-d11a381a-4ad1-4863-9ba3-730fa185c207 tempest-VolumesGetTest-1188070236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:10:37 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-d11a381a-4ad1-4863-9ba3-730fa185c207 tempest-VolumesGetTest-1188070236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:10:37 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-d11a381a-4ad1-4863-9ba3-730fa185c207 tempest-VolumesGetTest-1188070236 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:10:37 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-d11a381a-4ad1-4863-9ba3-730fa185c207 tempest-VolumesGetTest-1188070236 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:10:37 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d11a381a-4ad1-4863-9ba3-730fa185c207 tempest-VolumesGetTest-1188070236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b52ae8b6-dd94-47ae-8fb7-0bf466effdd5 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:37 devstack sudo[87787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b52ae8b6-dd94-47ae-8fb7-0bf466effdd5 1073741824
Apr 15 20:10:37 devstack sudo[87787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:37 devstack sudo[87785]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:37 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d392add7-3bb3-4276-a87d-279f1b4337a1 tempest-VolumesListAdminTestJSON-416736655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.589s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:37 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-d392add7-3bb3-4276-a87d-279f1b4337a1 tempest-VolumesListAdminTestJSON-416736655 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:10:37 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-d392add7-3bb3-4276-a87d-279f1b4337a1 tempest-VolumesListAdminTestJSON-416736655 None] Deleted volume successfully.
Apr 15 20:10:37 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-d392add7-3bb3-4276-a87d-279f1b4337a1 tempest-VolumesListAdminTestJSON-416736655 None] Lock "cinder-6195829b-5aa3-4e67-b6e0-fd1c144646a0-delete_volume" released by "delete_volume" :: held 2.268s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:10:38 devstack sudo[87787]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:38 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d11a381a-4ad1-4863-9ba3-730fa185c207 tempest-VolumesGetTest-1188070236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b52ae8b6-dd94-47ae-8fb7-0bf466effdd5 1073741824" returned: 0 in 0.767s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:38 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d11a381a-4ad1-4863-9ba3-730fa185c207 tempest-VolumesGetTest-1188070236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b52ae8b6-dd94-47ae-8fb7-0bf466effdd5 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:38 devstack sudo[87793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b52ae8b6-dd94-47ae-8fb7-0bf466effdd5
Apr 15 20:10:38 devstack sudo[87793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:38 devstack sudo[87793]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:38 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d11a381a-4ad1-4863-9ba3-730fa185c207 tempest-VolumesGetTest-1188070236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b52ae8b6-dd94-47ae-8fb7-0bf466effdd5" returned: 0 in 0.608s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:38 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-d11a381a-4ad1-4863-9ba3-730fa185c207 tempest-VolumesGetTest-1188070236 None] <== create_volume: return (1423ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:10:38 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-d11a381a-4ad1-4863-9ba3-730fa185c207 tempest-VolumesGetTest-1188070236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.426s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:10:38 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d11a381a-4ad1-4863-9ba3-730fa185c207 tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da7d110d-6f1e-4b84-ab0a-8221da5f01c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b52ae8b6-dd94-47ae-8fb7-0bf466effdd5', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:38 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d11a381a-4ad1-4863-9ba3-730fa185c207 tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0081d0cc-a702-4053-9c14-b4daa5a932c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:38 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-d11a381a-4ad1-4863-9ba3-730fa185c207 tempest-VolumesGetTest-1188070236 None] Volume volume-b52ae8b6-dd94-47ae-8fb7-0bf466effdd5 (b52ae8b6-dd94-47ae-8fb7-0bf466effdd5): created successfully
Apr 15 20:10:38 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d11a381a-4ad1-4863-9ba3-730fa185c207 tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0081d0cc-a702-4053-9c14-b4daa5a932c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:38 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d11a381a-4ad1-4863-9ba3-730fa185c207 tempest-VolumesGetTest-1188070236 None] Flow 'volume_create_manager' (13bfbcd9-3e7e-4fc9-b48d-a43801fdd5ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:10:38 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-d11a381a-4ad1-4863-9ba3-730fa185c207 tempest-VolumesGetTest-1188070236 None] Created volume successfully.
Apr 15 20:10:39 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe81d76b-e59a-42af-8447-e833cbedfe38 tempest-VolumesGetTest-1188070236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:10:39 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-fe81d76b-e59a-42af-8447-e833cbedfe38 tempest-VolumesGetTest-1188070236 None] Flow 'volume_create_manager' (1040814a-bc3f-44a0-9d3f-822616a5b167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:10:39 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-fe81d76b-e59a-42af-8447-e833cbedfe38 tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (826728a1-61d4-470d-8edd-00e62b7aeed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:40 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-fe81d76b-e59a-42af-8447-e833cbedfe38 tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (826728a1-61d4-470d-8edd-00e62b7aeed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:10:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1544318187',display_name='tempest-VolumesGetTest-Volume-2000252352',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=438ed8ec-5d5c-43a0-add8-80f9f8736a10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fd52c85921a443d92f594a7f2280e9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:10:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:10:40Z,use_quota=True,user_id='d7a23dd5ade7439ca285e5922adb8785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:40 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-fe81d76b-e59a-42af-8447-e833cbedfe38 tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (615e297f-0cd8-4d00-8cf1-4d5596ecaf9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:40 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-fe81d76b-e59a-42af-8447-e833cbedfe38 tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (615e297f-0cd8-4d00-8cf1-4d5596ecaf9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:40 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-fe81d76b-e59a-42af-8447-e833cbedfe38 tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05cd696c-af57-4378-b917-f1a1a94bef12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:40 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-fe81d76b-e59a-42af-8447-e833cbedfe38 tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05cd696c-af57-4378-b917-f1a1a94bef12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '438ed8ec-5d5c-43a0-add8-80f9f8736a10', 'volume_name': 'volume-438ed8ec-5d5c-43a0-add8-80f9f8736a10', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:40 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-fe81d76b-e59a-42af-8447-e833cbedfe38 tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fb0501e-0bc6-470b-a003-dc2f0d96db1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:40 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-fe81d76b-e59a-42af-8447-e833cbedfe38 tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fb0501e-0bc6-470b-a003-dc2f0d96db1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:40 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-fe81d76b-e59a-42af-8447-e833cbedfe38 tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9690c5cf-887a-4d72-8768-7774fd877610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:40 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-fe81d76b-e59a-42af-8447-e833cbedfe38 tempest-VolumesGetTest-1188070236 None] Volume 438ed8ec-5d5c-43a0-add8-80f9f8736a10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-438ed8ec-5d5c-43a0-add8-80f9f8736a10', 'volume_size': 1}
Apr 15 20:10:40 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-fe81d76b-e59a-42af-8447-e833cbedfe38 tempest-VolumesGetTest-1188070236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:10:40 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-fe81d76b-e59a-42af-8447-e833cbedfe38 tempest-VolumesGetTest-1188070236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:10:40 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-fe81d76b-e59a-42af-8447-e833cbedfe38 tempest-VolumesGetTest-1188070236 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:10:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1544318187',display_name='tempest-VolumesGetTest-Volume-2000252352',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=438ed8ec-5d5c-43a0-add8-80f9f8736a10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fd52c85921a443d92f594a7f2280e9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:10:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:10:40Z,use_quota=True,user_id='d7a23dd5ade7439ca285e5922adb8785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:10:40 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-fe81d76b-e59a-42af-8447-e833cbedfe38 tempest-VolumesGetTest-1188070236 None] Creating volume 438ed8ec-5d5c-43a0-add8-80f9f8736a10 {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:10:40 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-fe81d76b-e59a-42af-8447-e833cbedfe38 tempest-VolumesGetTest-1188070236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:10:40 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-fe81d76b-e59a-42af-8447-e833cbedfe38 tempest-VolumesGetTest-1188070236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:10:40 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-fe81d76b-e59a-42af-8447-e833cbedfe38 tempest-VolumesGetTest-1188070236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:10:40 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-fe81d76b-e59a-42af-8447-e833cbedfe38 tempest-VolumesGetTest-1188070236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:10:40 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-fe81d76b-e59a-42af-8447-e833cbedfe38 tempest-VolumesGetTest-1188070236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:10:40 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-fe81d76b-e59a-42af-8447-e833cbedfe38 tempest-VolumesGetTest-1188070236 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:10:40 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-fe81d76b-e59a-42af-8447-e833cbedfe38 tempest-VolumesGetTest-1188070236 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:10:40 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-fe81d76b-e59a-42af-8447-e833cbedfe38 tempest-VolumesGetTest-1188070236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-438ed8ec-5d5c-43a0-add8-80f9f8736a10 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:40 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-2a6f45d0-7b9d-47fe-b2df-733fc7ac7d8f tempest-VolumesNegativeTest-356501862 None] Acquiring lock "cinder-39b0669a-8718-4d3a-966b-152638f44fb9-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:10:40 devstack sudo[87798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-438ed8ec-5d5c-43a0-add8-80f9f8736a10 1073741824
Apr 15 20:10:40 devstack sudo[87798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:40 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-2a6f45d0-7b9d-47fe-b2df-733fc7ac7d8f tempest-VolumesNegativeTest-356501862 None] Lock "cinder-39b0669a-8718-4d3a-966b-152638f44fb9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:10:40 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-2a6f45d0-7b9d-47fe-b2df-733fc7ac7d8f tempest-VolumesNegativeTest-356501862 None] Acquiring lock "cinder-quobyte-39b0669a-8718-4d3a-966b-152638f44fb9" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:10:40 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-2a6f45d0-7b9d-47fe-b2df-733fc7ac7d8f tempest-VolumesNegativeTest-356501862 None] Lock "cinder-quobyte-39b0669a-8718-4d3a-966b-152638f44fb9" acquired by "delete_volume" :: waited 0.007s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:10:40 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[381450eb-b369-4850-bbf7-c5c7929136ac]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:10:40 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-2a6f45d0-7b9d-47fe-b2df-733fc7ac7d8f tempest-VolumesNegativeTest-356501862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-39b0669a-8718-4d3a-966b-152638f44fb9 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:40 devstack sudo[87800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-39b0669a-8718-4d3a-966b-152638f44fb9
Apr 15 20:10:40 devstack sudo[87800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:40 devstack sudo[87798]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:40 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-fe81d76b-e59a-42af-8447-e833cbedfe38 tempest-VolumesGetTest-1188070236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-438ed8ec-5d5c-43a0-add8-80f9f8736a10 1073741824" returned: 0 in 0.720s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:40 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-fe81d76b-e59a-42af-8447-e833cbedfe38 tempest-VolumesGetTest-1188070236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-438ed8ec-5d5c-43a0-add8-80f9f8736a10 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:40 devstack sudo[87800]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:40 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-2a6f45d0-7b9d-47fe-b2df-733fc7ac7d8f tempest-VolumesNegativeTest-356501862 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-39b0669a-8718-4d3a-966b-152638f44fb9" returned: 0 in 0.666s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:40 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-2a6f45d0-7b9d-47fe-b2df-733fc7ac7d8f tempest-VolumesNegativeTest-356501862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-39b0669a-8718-4d3a-966b-152638f44fb9 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:40 devstack sudo[87808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-438ed8ec-5d5c-43a0-add8-80f9f8736a10
Apr 15 20:10:40 devstack sudo[87808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:40 devstack sudo[87810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-39b0669a-8718-4d3a-966b-152638f44fb9
Apr 15 20:10:40 devstack sudo[87810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:41 devstack sudo[87810]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:41 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-2a6f45d0-7b9d-47fe-b2df-733fc7ac7d8f tempest-VolumesNegativeTest-356501862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-39b0669a-8718-4d3a-966b-152638f44fb9" returned: 0 in 0.539s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:41 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-2a6f45d0-7b9d-47fe-b2df-733fc7ac7d8f tempest-VolumesNegativeTest-356501862 None] Lock "cinder-quobyte-39b0669a-8718-4d3a-966b-152638f44fb9" released by "delete_volume" :: held 1.246s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:10:41 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ae4349c-5871-46d3-ba84-41f7b6b55471 tempest-VolumesImageMetadata-255534905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:10:41 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-1ae4349c-5871-46d3-ba84-41f7b6b55471 tempest-VolumesImageMetadata-255534905 None] Flow 'volume_create_manager' (0bf72fcb-04c4-4258-8207-6bbb7409f7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:10:41 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-1ae4349c-5871-46d3-ba84-41f7b6b55471 tempest-VolumesImageMetadata-255534905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d81406f-8916-49e3-a9b7-d8a681558d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:41 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-1ae4349c-5871-46d3-ba84-41f7b6b55471 tempest-VolumesImageMetadata-255534905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d81406f-8916-49e3-a9b7-d8a681558d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:10:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-459906849',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dcbba4c-010e-4865-9251-46647ccfeeea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16a37e2a56874c20b8012fc7f2b4d7c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:10:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:10:41Z,use_quota=True,user_id='8b2f3509a92343789d59363ffb4754b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:41 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-1ae4349c-5871-46d3-ba84-41f7b6b55471 tempest-VolumesImageMetadata-255534905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b674714e-c673-4fa7-b5dc-b2ffd10fa669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:41 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-1ae4349c-5871-46d3-ba84-41f7b6b55471 tempest-VolumesImageMetadata-255534905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b674714e-c673-4fa7-b5dc-b2ffd10fa669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:41 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-1ae4349c-5871-46d3-ba84-41f7b6b55471 tempest-VolumesImageMetadata-255534905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c953be71-8164-41b9-ac03-37b0cc6fb8c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:41 devstack cinder-volume[82646]: DEBUG cinder.image.glance [None req-1ae4349c-5871-46d3-ba84-41f7b6b55471 tempest-VolumesImageMetadata-255534905 None] Creating Keystone auth plugin from conf {{(pid=82646) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 15 20:10:41 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-2a6f45d0-7b9d-47fe-b2df-733fc7ac7d8f tempest-VolumesNegativeTest-356501862 None] Created reservations ['5ae0ba68-2e4a-4355-a270-a8db55877cd1', '690d2883-a745-4d7f-a8fd-128c56c4b210', '9e4dd1d5-bfa4-4ac3-af53-64c64a8df70a', '246fdda0-e3c3-4b24-b0ce-b98626f15846'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:10:41 devstack sudo[87808]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:41 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-fe81d76b-e59a-42af-8447-e833cbedfe38 tempest-VolumesGetTest-1188070236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-438ed8ec-5d5c-43a0-add8-80f9f8736a10" returned: 0 in 0.673s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:41 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-fe81d76b-e59a-42af-8447-e833cbedfe38 tempest-VolumesGetTest-1188070236 None] <== create_volume: return (1438ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:10:41 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-fe81d76b-e59a-42af-8447-e833cbedfe38 tempest-VolumesGetTest-1188070236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.440s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:10:41 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-fe81d76b-e59a-42af-8447-e833cbedfe38 tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9690c5cf-887a-4d72-8768-7774fd877610) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-438ed8ec-5d5c-43a0-add8-80f9f8736a10', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:41 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-fe81d76b-e59a-42af-8447-e833cbedfe38 tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22fa4c13-c35a-4df5-a9a6-3bcfc7f0497d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:41 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-fe81d76b-e59a-42af-8447-e833cbedfe38 tempest-VolumesGetTest-1188070236 None] Volume volume-438ed8ec-5d5c-43a0-add8-80f9f8736a10 (438ed8ec-5d5c-43a0-add8-80f9f8736a10): created successfully
Apr 15 20:10:41 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-fe81d76b-e59a-42af-8447-e833cbedfe38 tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22fa4c13-c35a-4df5-a9a6-3bcfc7f0497d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:41 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-fe81d76b-e59a-42af-8447-e833cbedfe38 tempest-VolumesGetTest-1188070236 None] Flow 'volume_create_manager' (1040814a-bc3f-44a0-9d3f-822616a5b167) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:10:41 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-fe81d76b-e59a-42af-8447-e833cbedfe38 tempest-VolumesGetTest-1188070236 None] Created volume successfully.
Apr 15 20:10:41 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-2a6f45d0-7b9d-47fe-b2df-733fc7ac7d8f tempest-VolumesNegativeTest-356501862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:10:41 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-2a6f45d0-7b9d-47fe-b2df-733fc7ac7d8f tempest-VolumesNegativeTest-356501862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:10:41 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-2a6f45d0-7b9d-47fe-b2df-733fc7ac7d8f tempest-VolumesNegativeTest-356501862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:10:41 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-2a6f45d0-7b9d-47fe-b2df-733fc7ac7d8f tempest-VolumesNegativeTest-356501862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:10:41 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-2a6f45d0-7b9d-47fe-b2df-733fc7ac7d8f tempest-VolumesNegativeTest-356501862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:10:41 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-2a6f45d0-7b9d-47fe-b2df-733fc7ac7d8f tempest-VolumesNegativeTest-356501862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:41 devstack sudo[87814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:10:41 devstack sudo[87814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:41 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-1ae4349c-5871-46d3-ba84-41f7b6b55471 tempest-VolumesImageMetadata-255534905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c953be71-8164-41b9-ac03-37b0cc6fb8c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3dcbba4c-010e-4865-9251-46647ccfeeea', 'volume_name': 'volume-3dcbba4c-010e-4865-9251-46647ccfeeea', 'volume_size': 1, 'image_id': '565a23e3-dcfa-4a62-b361-219578b0cd92', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/565a23e3-dcfa-4a62-b361-219578b0cd92', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '27d9c820db6c4abea4324fe8ea0f90e6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '565a23e3-dcfa-4a62-b361-219578b0cd92', 'created_at': datetime.datetime(2026, 4, 15, 18, 0, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 18, 0, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/565a23e3-dcfa-4a62-b361-219578b0cd92/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe15d3312d0>}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:41 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-1ae4349c-5871-46d3-ba84-41f7b6b55471 tempest-VolumesImageMetadata-255534905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25ed100d-c3bc-4c84-ae39-8ecc488d813c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:41 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-1ae4349c-5871-46d3-ba84-41f7b6b55471 tempest-VolumesImageMetadata-255534905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25ed100d-c3bc-4c84-ae39-8ecc488d813c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:41 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-1ae4349c-5871-46d3-ba84-41f7b6b55471 tempest-VolumesImageMetadata-255534905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17476957-e09a-4f7f-ab1f-49e131865dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:41 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-1ae4349c-5871-46d3-ba84-41f7b6b55471 tempest-VolumesImageMetadata-255534905 None] Volume 3dcbba4c-010e-4865-9251-46647ccfeeea: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3dcbba4c-010e-4865-9251-46647ccfeeea', 'volume_size': 1, 'image_id': '565a23e3-dcfa-4a62-b361-219578b0cd92', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/565a23e3-dcfa-4a62-b361-219578b0cd92', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '27d9c820db6c4abea4324fe8ea0f90e6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '565a23e3-dcfa-4a62-b361-219578b0cd92', 'created_at': datetime.datetime(2026, 4, 15, 18, 0, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 18, 0, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/565a23e3-dcfa-4a62-b361-219578b0cd92/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe15d3312d0>}
Apr 15 20:10:41 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ae4349c-5871-46d3-ba84-41f7b6b55471 tempest-VolumesImageMetadata-255534905 None] Trying to clone 3dcbba4c-010e-4865-9251-46647ccfeeea from image 565a23e3-dcfa-4a62-b361-219578b0cd92 at location (None, [{'url': 'file:///opt/stack/data/glance/images/565a23e3-dcfa-4a62-b361-219578b0cd92', 'metadata': {}}]). {{(pid=82646) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 15 20:10:41 devstack cinder-volume[82646]: DEBUG cinder.image.image_utils [None req-1ae4349c-5871-46d3-ba84-41f7b6b55471 tempest-VolumesImageMetadata-255534905 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_565a23e3-dcfa-4a62-b361-219578b0cd92_wz43p8l1devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82646) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 15 20:10:41 devstack cinder-volume[82646]: INFO cinder.image.image_utils [None req-1ae4349c-5871-46d3-ba84-41f7b6b55471 tempest-VolumesImageMetadata-255534905 None] Image download 20.69 MB at 20.69 MB/s
Apr 15 20:10:41 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a329c5-3151-4b86-8c90-9bee2f2f7948]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:10:41 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-1ae4349c-5871-46d3-ba84-41f7b6b55471 tempest-VolumesImageMetadata-255534905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_565a23e3-dcfa-4a62-b361-219578b0cd92_wz43p8l1devstack@QuobyteHD {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:41 devstack sudo[87817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_565a23e3-dcfa-4a62-b361-219578b0cd92_wz43p8l1devstack@QuobyteHD
Apr 15 20:10:41 devstack sudo[87817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:42 devstack sudo[87814]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:42 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-2a6f45d0-7b9d-47fe-b2df-733fc7ac7d8f tempest-VolumesNegativeTest-356501862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.589s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:42 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-2a6f45d0-7b9d-47fe-b2df-733fc7ac7d8f tempest-VolumesNegativeTest-356501862 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:10:42 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-2a6f45d0-7b9d-47fe-b2df-733fc7ac7d8f tempest-VolumesNegativeTest-356501862 None] Deleted volume successfully.
Apr 15 20:10:42 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-2a6f45d0-7b9d-47fe-b2df-733fc7ac7d8f tempest-VolumesNegativeTest-356501862 None] Lock "cinder-39b0669a-8718-4d3a-966b-152638f44fb9-delete_volume" released by "delete_volume" :: held 2.062s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:10:42 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-25d83e4a-06d8-43eb-92a1-b8537c2179af tempest-VolumesGetTest-1188070236 None] Acquiring lock "cinder-438ed8ec-5d5c-43a0-add8-80f9f8736a10-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:10:42 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-25d83e4a-06d8-43eb-92a1-b8537c2179af tempest-VolumesGetTest-1188070236 None] Lock "cinder-438ed8ec-5d5c-43a0-add8-80f9f8736a10-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:10:42 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-25d83e4a-06d8-43eb-92a1-b8537c2179af tempest-VolumesGetTest-1188070236 None] Acquiring lock "cinder-quobyte-438ed8ec-5d5c-43a0-add8-80f9f8736a10" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:10:42 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-25d83e4a-06d8-43eb-92a1-b8537c2179af tempest-VolumesGetTest-1188070236 None] Lock "cinder-quobyte-438ed8ec-5d5c-43a0-add8-80f9f8736a10" acquired by "delete_volume" :: waited 0.014s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:10:42 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e0e7af-ec32-4ddd-b1b6-0f5394470a0b]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:10:42 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-25d83e4a-06d8-43eb-92a1-b8537c2179af tempest-VolumesGetTest-1188070236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-438ed8ec-5d5c-43a0-add8-80f9f8736a10 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:42 devstack sudo[87820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-438ed8ec-5d5c-43a0-add8-80f9f8736a10
Apr 15 20:10:42 devstack sudo[87820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:42 devstack sudo[87817]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:42 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-1ae4349c-5871-46d3-ba84-41f7b6b55471 tempest-VolumesImageMetadata-255534905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_565a23e3-dcfa-4a62-b361-219578b0cd92_wz43p8l1devstack@QuobyteHD" returned: 0 in 0.667s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:42 devstack cinder-volume[82646]: DEBUG cinder.image.image_utils [None req-1ae4349c-5871-46d3-ba84-41f7b6b55471 tempest-VolumesImageMetadata-255534905 None] Temporary image 565a23e3-dcfa-4a62-b361-219578b0cd92 is fetched for user 8b2f3509a92343789d59363ffb4754b4. {{(pid=82646) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 15 20:10:42 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[541ee83f-a02b-4627-ae6e-cbc515130649]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:10:42 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-1ae4349c-5871-46d3-ba84-41f7b6b55471 tempest-VolumesImageMetadata-255534905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_565a23e3-dcfa-4a62-b361-219578b0cd92_wz43p8l1devstack@QuobyteHD {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:42 devstack sudo[87825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_565a23e3-dcfa-4a62-b361-219578b0cd92_wz43p8l1devstack@QuobyteHD
Apr 15 20:10:42 devstack sudo[87825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:43 devstack sudo[87820]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:43 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-25d83e4a-06d8-43eb-92a1-b8537c2179af tempest-VolumesGetTest-1188070236 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-438ed8ec-5d5c-43a0-add8-80f9f8736a10" returned: 0 in 0.746s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:43 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-25d83e4a-06d8-43eb-92a1-b8537c2179af tempest-VolumesGetTest-1188070236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-438ed8ec-5d5c-43a0-add8-80f9f8736a10 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:43 devstack sudo[87830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-438ed8ec-5d5c-43a0-add8-80f9f8736a10
Apr 15 20:10:43 devstack sudo[87830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:43 devstack sudo[87825]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:43 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-1ae4349c-5871-46d3-ba84-41f7b6b55471 tempest-VolumesImageMetadata-255534905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_565a23e3-dcfa-4a62-b361-219578b0cd92_wz43p8l1devstack@QuobyteHD" returned: 0 in 0.613s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:43 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-1ae4349c-5871-46d3-ba84-41f7b6b55471 tempest-VolumesImageMetadata-255534905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:10:43 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-1ae4349c-5871-46d3-ba84-41f7b6b55471 tempest-VolumesImageMetadata-255534905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:10:43 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-1ae4349c-5871-46d3-ba84-41f7b6b55471 tempest-VolumesImageMetadata-255534905 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:10:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-459906849',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dcbba4c-010e-4865-9251-46647ccfeeea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16a37e2a56874c20b8012fc7f2b4d7c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:10:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:10:41Z,use_quota=True,user_id='8b2f3509a92343789d59363ffb4754b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:10:43 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-1ae4349c-5871-46d3-ba84-41f7b6b55471 tempest-VolumesImageMetadata-255534905 None] Creating volume 3dcbba4c-010e-4865-9251-46647ccfeeea {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:10:43 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-1ae4349c-5871-46d3-ba84-41f7b6b55471 tempest-VolumesImageMetadata-255534905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:10:43 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-1ae4349c-5871-46d3-ba84-41f7b6b55471 tempest-VolumesImageMetadata-255534905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:10:43 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-1ae4349c-5871-46d3-ba84-41f7b6b55471 tempest-VolumesImageMetadata-255534905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:10:43 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-1ae4349c-5871-46d3-ba84-41f7b6b55471 tempest-VolumesImageMetadata-255534905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:10:43 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-1ae4349c-5871-46d3-ba84-41f7b6b55471 tempest-VolumesImageMetadata-255534905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:10:43 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-1ae4349c-5871-46d3-ba84-41f7b6b55471 tempest-VolumesImageMetadata-255534905 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:10:43 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-1ae4349c-5871-46d3-ba84-41f7b6b55471 tempest-VolumesImageMetadata-255534905 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:10:43 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-1ae4349c-5871-46d3-ba84-41f7b6b55471 tempest-VolumesImageMetadata-255534905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3dcbba4c-010e-4865-9251-46647ccfeeea 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:43 devstack sudo[87847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3dcbba4c-010e-4865-9251-46647ccfeeea 1073741824
Apr 15 20:10:43 devstack sudo[87847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:43 devstack sudo[87830]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:43 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-25d83e4a-06d8-43eb-92a1-b8537c2179af tempest-VolumesGetTest-1188070236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-438ed8ec-5d5c-43a0-add8-80f9f8736a10" returned: 0 in 0.816s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:43 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-25d83e4a-06d8-43eb-92a1-b8537c2179af tempest-VolumesGetTest-1188070236 None] Lock "cinder-quobyte-438ed8ec-5d5c-43a0-add8-80f9f8736a10" released by "delete_volume" :: held 1.597s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:10:43 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-25d83e4a-06d8-43eb-92a1-b8537c2179af tempest-VolumesGetTest-1188070236 None] Created reservations ['d3aaf4a7-af12-4633-8f39-3b3dfef2da4e', '6c0b8b90-a98b-435b-8676-37e3bdb5848d', 'bd0f9a75-d7a5-46a6-9ec5-7bdafa3b2e32', 'f299c578-5aa4-4158-9238-07209130d82b'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:10:44 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-25d83e4a-06d8-43eb-92a1-b8537c2179af tempest-VolumesGetTest-1188070236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:10:44 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-25d83e4a-06d8-43eb-92a1-b8537c2179af tempest-VolumesGetTest-1188070236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:10:44 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-25d83e4a-06d8-43eb-92a1-b8537c2179af tempest-VolumesGetTest-1188070236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:10:44 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-25d83e4a-06d8-43eb-92a1-b8537c2179af tempest-VolumesGetTest-1188070236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:10:44 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-25d83e4a-06d8-43eb-92a1-b8537c2179af tempest-VolumesGetTest-1188070236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:10:44 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-25d83e4a-06d8-43eb-92a1-b8537c2179af tempest-VolumesGetTest-1188070236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:44 devstack sudo[87876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:10:44 devstack sudo[87876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:44 devstack sudo[87847]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:44 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-1ae4349c-5871-46d3-ba84-41f7b6b55471 tempest-VolumesImageMetadata-255534905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3dcbba4c-010e-4865-9251-46647ccfeeea 1073741824" returned: 0 in 0.875s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:44 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-1ae4349c-5871-46d3-ba84-41f7b6b55471 tempest-VolumesImageMetadata-255534905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3dcbba4c-010e-4865-9251-46647ccfeeea {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:44 devstack sudo[87878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3dcbba4c-010e-4865-9251-46647ccfeeea
Apr 15 20:10:44 devstack sudo[87878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:44 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-d705b0fc-a607-497f-b583-02bfad2677bb tempest-VolumesGetTest-1188070236 None] Acquiring lock "cinder-b52ae8b6-dd94-47ae-8fb7-0bf466effdd5-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:10:44 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-d705b0fc-a607-497f-b583-02bfad2677bb tempest-VolumesGetTest-1188070236 None] Lock "cinder-b52ae8b6-dd94-47ae-8fb7-0bf466effdd5-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:10:44 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-d705b0fc-a607-497f-b583-02bfad2677bb tempest-VolumesGetTest-1188070236 None] Acquiring lock "cinder-quobyte-b52ae8b6-dd94-47ae-8fb7-0bf466effdd5" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:10:44 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-d705b0fc-a607-497f-b583-02bfad2677bb tempest-VolumesGetTest-1188070236 None] Lock "cinder-quobyte-b52ae8b6-dd94-47ae-8fb7-0bf466effdd5" acquired by "delete_volume" :: waited 0.014s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:10:44 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[14aa09a8-645d-4f0f-8334-17c8b8ff4f4e]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:10:44 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d705b0fc-a607-497f-b583-02bfad2677bb tempest-VolumesGetTest-1188070236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b52ae8b6-dd94-47ae-8fb7-0bf466effdd5 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:44 devstack sudo[87878]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:44 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-1ae4349c-5871-46d3-ba84-41f7b6b55471 tempest-VolumesImageMetadata-255534905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3dcbba4c-010e-4865-9251-46647ccfeeea" returned: 0 in 0.540s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:44 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-1ae4349c-5871-46d3-ba84-41f7b6b55471 tempest-VolumesImageMetadata-255534905 None] <== create_volume: return (1450ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:10:44 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-1ae4349c-5871-46d3-ba84-41f7b6b55471 tempest-VolumesImageMetadata-255534905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.453s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:10:44 devstack sudo[87876]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:44 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-25d83e4a-06d8-43eb-92a1-b8537c2179af tempest-VolumesGetTest-1188070236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.668s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:44 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-25d83e4a-06d8-43eb-92a1-b8537c2179af tempest-VolumesGetTest-1188070236 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:10:44 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-25d83e4a-06d8-43eb-92a1-b8537c2179af tempest-VolumesGetTest-1188070236 None] Deleted volume successfully.
Apr 15 20:10:44 devstack cinder-volume[82646]: DEBUG cinder.volume.volume_utils [None req-1ae4349c-5871-46d3-ba84-41f7b6b55471 tempest-VolumesImageMetadata-255534905 None] Attempting download of 565a23e3-dcfa-4a62-b361-219578b0cd92 ((None, [{'url': 'file:///opt/stack/data/glance/images/565a23e3-dcfa-4a62-b361-219578b0cd92', 'metadata': {}}])) to volume 3dcbba4c-010e-4865-9251-46647ccfeeea. {{(pid=82646) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 15 20:10:44 devstack sudo[87882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b52ae8b6-dd94-47ae-8fb7-0bf466effdd5
Apr 15 20:10:44 devstack sudo[87882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:44 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-25d83e4a-06d8-43eb-92a1-b8537c2179af tempest-VolumesGetTest-1188070236 None] Lock "cinder-438ed8ec-5d5c-43a0-add8-80f9f8736a10-delete_volume" released by "delete_volume" :: held 2.552s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:10:44 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a4452d-7e82-4ab6-8c11-7ea9880c8c7b]: (4, 'raw') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:10:44 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-1ae4349c-5871-46d3-ba84-41f7b6b55471 tempest-VolumesImageMetadata-255534905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_565a23e3-dcfa-4a62-b361-219578b0cd92_qogaee3f {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:44 devstack sudo[87884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_565a23e3-dcfa-4a62-b361-219578b0cd92_qogaee3f
Apr 15 20:10:44 devstack sudo[87884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:44 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-54a3bc93-9397-4b90-a52a-3d5788be58e3 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:10:44 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-54a3bc93-9397-4b90-a52a-3d5788be58e3 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Flow 'volume_create_manager' (9a4bb78d-8a46-439e-a9d0-f95c8562c373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:10:44 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-54a3bc93-9397-4b90-a52a-3d5788be58e3 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b60cca22-f02d-4bbd-9791-dbdff4cbcca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:44 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-54a3bc93-9397-4b90-a52a-3d5788be58e3 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b60cca22-f02d-4bbd-9791-dbdff4cbcca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:10:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1686920467',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5eeca01-8fe9-4200-a2b9-547cdfc8387f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b1b6ce20a5b41479485cb48828a53fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:10:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:10:45Z,use_quota=True,user_id='69de731202be40c29bd29d0e79256f96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:44 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-54a3bc93-9397-4b90-a52a-3d5788be58e3 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c13d52b4-4e6d-49b2-8b05-283cea6c4ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:44 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-54a3bc93-9397-4b90-a52a-3d5788be58e3 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c13d52b4-4e6d-49b2-8b05-283cea6c4ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:44 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-54a3bc93-9397-4b90-a52a-3d5788be58e3 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24442bbc-2a9c-4c2d-98eb-08b7349f7d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:44 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-54a3bc93-9397-4b90-a52a-3d5788be58e3 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24442bbc-2a9c-4c2d-98eb-08b7349f7d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5eeca01-8fe9-4200-a2b9-547cdfc8387f', 'volume_name': 'volume-e5eeca01-8fe9-4200-a2b9-547cdfc8387f', 'volume_size': 2}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:44 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-54a3bc93-9397-4b90-a52a-3d5788be58e3 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1db5d2a8-31d6-4f6d-8856-1d3f8e873e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:44 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-54a3bc93-9397-4b90-a52a-3d5788be58e3 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1db5d2a8-31d6-4f6d-8856-1d3f8e873e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:44 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-54a3bc93-9397-4b90-a52a-3d5788be58e3 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5564ba8a-26c3-491f-83c6-f287cdcd75b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:44 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-54a3bc93-9397-4b90-a52a-3d5788be58e3 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Volume e5eeca01-8fe9-4200-a2b9-547cdfc8387f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5eeca01-8fe9-4200-a2b9-547cdfc8387f', 'volume_size': 2}
Apr 15 20:10:44 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-54a3bc93-9397-4b90-a52a-3d5788be58e3 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:10:44 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-54a3bc93-9397-4b90-a52a-3d5788be58e3 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:10:44 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-54a3bc93-9397-4b90-a52a-3d5788be58e3 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:10:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1686920467',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5eeca01-8fe9-4200-a2b9-547cdfc8387f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b1b6ce20a5b41479485cb48828a53fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:10:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:10:45Z,use_quota=True,user_id='69de731202be40c29bd29d0e79256f96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:10:44 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-54a3bc93-9397-4b90-a52a-3d5788be58e3 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Creating volume e5eeca01-8fe9-4200-a2b9-547cdfc8387f {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:10:44 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-54a3bc93-9397-4b90-a52a-3d5788be58e3 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:10:44 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-54a3bc93-9397-4b90-a52a-3d5788be58e3 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:10:44 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-54a3bc93-9397-4b90-a52a-3d5788be58e3 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:10:45 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-54a3bc93-9397-4b90-a52a-3d5788be58e3 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:10:45 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-54a3bc93-9397-4b90-a52a-3d5788be58e3 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:10:45 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-54a3bc93-9397-4b90-a52a-3d5788be58e3 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:10:45 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-54a3bc93-9397-4b90-a52a-3d5788be58e3 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:10:45 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-54a3bc93-9397-4b90-a52a-3d5788be58e3 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e5eeca01-8fe9-4200-a2b9-547cdfc8387f 2147483648 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:45 devstack sudo[87886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e5eeca01-8fe9-4200-a2b9-547cdfc8387f 2147483648
Apr 15 20:10:45 devstack sudo[87886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:45 devstack sudo[87882]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:45 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d705b0fc-a607-497f-b583-02bfad2677bb tempest-VolumesGetTest-1188070236 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b52ae8b6-dd94-47ae-8fb7-0bf466effdd5" returned: 0 in 0.691s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:45 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d705b0fc-a607-497f-b583-02bfad2677bb tempest-VolumesGetTest-1188070236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b52ae8b6-dd94-47ae-8fb7-0bf466effdd5 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:45 devstack sudo[87891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b52ae8b6-dd94-47ae-8fb7-0bf466effdd5
Apr 15 20:10:45 devstack sudo[87891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:45 devstack sudo[87884]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:45 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-1ae4349c-5871-46d3-ba84-41f7b6b55471 tempest-VolumesImageMetadata-255534905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_565a23e3-dcfa-4a62-b361-219578b0cd92_qogaee3f" returned: 0 in 0.702s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:45 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-1ae4349c-5871-46d3-ba84-41f7b6b55471 tempest-VolumesImageMetadata-255534905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_565a23e3-dcfa-4a62-b361-219578b0cd92_qogaee3f {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:45 devstack sudo[87898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_565a23e3-dcfa-4a62-b361-219578b0cd92_qogaee3f
Apr 15 20:10:45 devstack sudo[87898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:45 devstack sudo[87886]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:45 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-54a3bc93-9397-4b90-a52a-3d5788be58e3 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e5eeca01-8fe9-4200-a2b9-547cdfc8387f 2147483648" returned: 0 in 0.802s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:45 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-54a3bc93-9397-4b90-a52a-3d5788be58e3 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e5eeca01-8fe9-4200-a2b9-547cdfc8387f {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:45 devstack sudo[87900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e5eeca01-8fe9-4200-a2b9-547cdfc8387f
Apr 15 20:10:45 devstack sudo[87900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:46 devstack sudo[87891]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d705b0fc-a607-497f-b583-02bfad2677bb tempest-VolumesGetTest-1188070236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b52ae8b6-dd94-47ae-8fb7-0bf466effdd5" returned: 0 in 0.800s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:46 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-d705b0fc-a607-497f-b583-02bfad2677bb tempest-VolumesGetTest-1188070236 None] Lock "cinder-quobyte-b52ae8b6-dd94-47ae-8fb7-0bf466effdd5" released by "delete_volume" :: held 1.529s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:10:46 devstack sudo[87898]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-1ae4349c-5871-46d3-ba84-41f7b6b55471 tempest-VolumesImageMetadata-255534905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_565a23e3-dcfa-4a62-b361-219578b0cd92_qogaee3f" returned: 1 in 0.639s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-1ae4349c-5871-46d3-ba84-41f7b6b55471 tempest-VolumesImageMetadata-255534905 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_565a23e3-dcfa-4a62-b361-219578b0cd92_qogaee3f' failed. Not Retrying. {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 20:10:46 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[024681bc-1db2-48d1-95dc-1b97a2cd2752]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:10:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-1ae4349c-5871-46d3-ba84-41f7b6b55471 tempest-VolumesImageMetadata-255534905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_565a23e3-dcfa-4a62-b361-219578b0cd92_wz43p8l1devstack@QuobyteHD {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:46 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-d705b0fc-a607-497f-b583-02bfad2677bb tempest-VolumesGetTest-1188070236 None] Created reservations ['06809083-6bb8-43bf-9aa1-f92e28ea55e0', 'a711297c-41c1-4bc9-a5dd-efff5c6dfa96', 'e674ae2c-3b6f-4239-ab9a-a4b66a84b2c6', '0e3a603c-727a-4bd6-a60d-2dba38c892c8'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:10:46 devstack sudo[87906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_565a23e3-dcfa-4a62-b361-219578b0cd92_wz43p8l1devstack@QuobyteHD
Apr 15 20:10:46 devstack sudo[87906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-d705b0fc-a607-497f-b583-02bfad2677bb tempest-VolumesGetTest-1188070236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:10:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-d705b0fc-a607-497f-b583-02bfad2677bb tempest-VolumesGetTest-1188070236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:10:46 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-d705b0fc-a607-497f-b583-02bfad2677bb tempest-VolumesGetTest-1188070236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:10:46 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-d705b0fc-a607-497f-b583-02bfad2677bb tempest-VolumesGetTest-1188070236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:10:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-d705b0fc-a607-497f-b583-02bfad2677bb tempest-VolumesGetTest-1188070236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:10:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d705b0fc-a607-497f-b583-02bfad2677bb tempest-VolumesGetTest-1188070236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:46 devstack sudo[87908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:10:46 devstack sudo[87908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:46 devstack sudo[87900]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-54a3bc93-9397-4b90-a52a-3d5788be58e3 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e5eeca01-8fe9-4200-a2b9-547cdfc8387f" returned: 0 in 0.554s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:46 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-54a3bc93-9397-4b90-a52a-3d5788be58e3 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] <== create_volume: return (1406ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:10:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-54a3bc93-9397-4b90-a52a-3d5788be58e3 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.408s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:10:46 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-54a3bc93-9397-4b90-a52a-3d5788be58e3 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5564ba8a-26c3-491f-83c6-f287cdcd75b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5eeca01-8fe9-4200-a2b9-547cdfc8387f', 'volume_size': 2}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:46 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-54a3bc93-9397-4b90-a52a-3d5788be58e3 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da028376-21f3-49b6-b0fc-5501f7737dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:46 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-54a3bc93-9397-4b90-a52a-3d5788be58e3 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Volume volume-e5eeca01-8fe9-4200-a2b9-547cdfc8387f (e5eeca01-8fe9-4200-a2b9-547cdfc8387f): created successfully
Apr 15 20:10:46 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-54a3bc93-9397-4b90-a52a-3d5788be58e3 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da028376-21f3-49b6-b0fc-5501f7737dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:46 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-54a3bc93-9397-4b90-a52a-3d5788be58e3 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Flow 'volume_create_manager' (9a4bb78d-8a46-439e-a9d0-f95c8562c373) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:10:46 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-54a3bc93-9397-4b90-a52a-3d5788be58e3 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Created volume successfully.
Apr 15 20:10:46 devstack sudo[87906]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-1ae4349c-5871-46d3-ba84-41f7b6b55471 tempest-VolumesImageMetadata-255534905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_565a23e3-dcfa-4a62-b361-219578b0cd92_wz43p8l1devstack@QuobyteHD" returned: 0 in 0.505s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:46 devstack cinder-volume[82646]: DEBUG cinder.image.image_utils [None req-1ae4349c-5871-46d3-ba84-41f7b6b55471 tempest-VolumesImageMetadata-255534905 None] 565a23e3-dcfa-4a62-b361-219578b0cd92 was qcow2, converting to raw {{(pid=82646) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 15 20:10:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-1ae4349c-5871-46d3-ba84-41f7b6b55471 tempest-VolumesImageMetadata-255534905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_565a23e3-dcfa-4a62-b361-219578b0cd92_wz43p8l1devstack@QuobyteHD /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3dcbba4c-010e-4865-9251-46647ccfeeea {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:46 devstack sudo[87915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_565a23e3-dcfa-4a62-b361-219578b0cd92_wz43p8l1devstack@QuobyteHD /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3dcbba4c-010e-4865-9251-46647ccfeeea
Apr 15 20:10:46 devstack sudo[87915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:46 devstack sudo[87908]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d705b0fc-a607-497f-b583-02bfad2677bb tempest-VolumesGetTest-1188070236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.499s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:46 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-d705b0fc-a607-497f-b583-02bfad2677bb tempest-VolumesGetTest-1188070236 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:10:46 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-d705b0fc-a607-497f-b583-02bfad2677bb tempest-VolumesGetTest-1188070236 None] Deleted volume successfully.
Apr 15 20:10:46 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-d705b0fc-a607-497f-b583-02bfad2677bb tempest-VolumesGetTest-1188070236 None] Lock "cinder-b52ae8b6-dd94-47ae-8fb7-0bf466effdd5-delete_volume" released by "delete_volume" :: held 2.260s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:10:47 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-35685a60-b38c-4156-9faf-0425cd321abb tempest-VolumesGetTest-1188070236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:10:47 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-35685a60-b38c-4156-9faf-0425cd321abb tempest-VolumesGetTest-1188070236 None] Flow 'volume_create_manager' (39736678-e9fd-4929-9f80-e216e3de6f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:10:47 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-35685a60-b38c-4156-9faf-0425cd321abb tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b618c83c-100e-4c71-8610-f16d6e7d006a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:47 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-35685a60-b38c-4156-9faf-0425cd321abb tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b618c83c-100e-4c71-8610-f16d6e7d006a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:10:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-754312918',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5f365c1-ad6d-49b9-9c37-78889ce516a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fd52c85921a443d92f594a7f2280e9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:10:47Z,use_quota=True,user_id='d7a23dd5ade7439ca285e5922adb8785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:47 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-35685a60-b38c-4156-9faf-0425cd321abb tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (020d96b1-4ec1-4e46-b2f9-7a1d5ca7b2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:47 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-35685a60-b38c-4156-9faf-0425cd321abb tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (020d96b1-4ec1-4e46-b2f9-7a1d5ca7b2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:47 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-35685a60-b38c-4156-9faf-0425cd321abb tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18300d72-0305-4e5b-bfe9-3614dd2a302e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:47 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-35685a60-b38c-4156-9faf-0425cd321abb tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18300d72-0305-4e5b-bfe9-3614dd2a302e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5f365c1-ad6d-49b9-9c37-78889ce516a2', 'volume_name': 'volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:47 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-35685a60-b38c-4156-9faf-0425cd321abb tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bc15ed3-3778-4e1a-a9a4-2942460eab0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:47 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-35685a60-b38c-4156-9faf-0425cd321abb tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bc15ed3-3778-4e1a-a9a4-2942460eab0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:47 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-35685a60-b38c-4156-9faf-0425cd321abb tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b69bc4c-5c66-4124-bc8d-ce8e3895de01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:47 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-35685a60-b38c-4156-9faf-0425cd321abb tempest-VolumesGetTest-1188070236 None] Volume b5f365c1-ad6d-49b9-9c37-78889ce516a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2', 'volume_size': 1}
Apr 15 20:10:47 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-35685a60-b38c-4156-9faf-0425cd321abb tempest-VolumesGetTest-1188070236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:10:47 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-35685a60-b38c-4156-9faf-0425cd321abb tempest-VolumesGetTest-1188070236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:10:47 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-35685a60-b38c-4156-9faf-0425cd321abb tempest-VolumesGetTest-1188070236 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:10:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-754312918',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5f365c1-ad6d-49b9-9c37-78889ce516a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fd52c85921a443d92f594a7f2280e9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:10:47Z,use_quota=True,user_id='d7a23dd5ade7439ca285e5922adb8785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:10:47 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-35685a60-b38c-4156-9faf-0425cd321abb tempest-VolumesGetTest-1188070236 None] Creating volume b5f365c1-ad6d-49b9-9c37-78889ce516a2 {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:10:47 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-35685a60-b38c-4156-9faf-0425cd321abb tempest-VolumesGetTest-1188070236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:10:47 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-35685a60-b38c-4156-9faf-0425cd321abb tempest-VolumesGetTest-1188070236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:10:47 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-35685a60-b38c-4156-9faf-0425cd321abb tempest-VolumesGetTest-1188070236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:10:47 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-35685a60-b38c-4156-9faf-0425cd321abb tempest-VolumesGetTest-1188070236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:10:47 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-35685a60-b38c-4156-9faf-0425cd321abb tempest-VolumesGetTest-1188070236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:10:47 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-35685a60-b38c-4156-9faf-0425cd321abb tempest-VolumesGetTest-1188070236 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:10:47 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-35685a60-b38c-4156-9faf-0425cd321abb tempest-VolumesGetTest-1188070236 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:10:47 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-35685a60-b38c-4156-9faf-0425cd321abb tempest-VolumesGetTest-1188070236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:47 devstack sudo[87923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2 1073741824
Apr 15 20:10:47 devstack sudo[87923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:47 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-c0deee47-ebe0-494f-b4f2-b064e5fc4b36 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:10:47 devstack sudo[87915]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:47 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-1ae4349c-5871-46d3-ba84-41f7b6b55471 tempest-VolumesImageMetadata-255534905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_565a23e3-dcfa-4a62-b361-219578b0cd92_wz43p8l1devstack@QuobyteHD /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3dcbba4c-010e-4865-9251-46647ccfeeea" returned: 0 in 1.035s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:47 devstack cinder-volume[82646]: DEBUG cinder.image.image_utils [None req-1ae4349c-5871-46d3-ba84-41f7b6b55471 tempest-VolumesImageMetadata-255534905 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_565a23e3-dcfa-4a62-b361-219578b0cd92_wz43p8l1devstack@QuobyteHD, size 112.00 MB, duration 1.04 sec, destination /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3dcbba4c-010e-4865-9251-46647ccfeeea {{(pid=82646) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 20:10:47 devstack cinder-volume[82646]: INFO cinder.image.image_utils [None req-1ae4349c-5871-46d3-ba84-41f7b6b55471 tempest-VolumesImageMetadata-255534905 None] Converted 112.00 MB image at 108.07 MB/s
Apr 15 20:10:47 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-1ae4349c-5871-46d3-ba84-41f7b6b55471 tempest-VolumesImageMetadata-255534905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3dcbba4c-010e-4865-9251-46647ccfeeea 1G {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:47 devstack sudo[87931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3dcbba4c-010e-4865-9251-46647ccfeeea 1G
Apr 15 20:10:47 devstack sudo[87931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:47 devstack sudo[87923]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:47 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-35685a60-b38c-4156-9faf-0425cd321abb tempest-VolumesGetTest-1188070236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2 1073741824" returned: 0 in 0.574s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:47 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-35685a60-b38c-4156-9faf-0425cd321abb tempest-VolumesGetTest-1188070236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:47 devstack sudo[87933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2
Apr 15 20:10:47 devstack sudo[87933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:48 devstack sudo[87931]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-1ae4349c-5871-46d3-ba84-41f7b6b55471 tempest-VolumesImageMetadata-255534905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3dcbba4c-010e-4865-9251-46647ccfeeea 1G" returned: 0 in 0.464s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:48 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[521fb9e2-cffc-418a-b71e-747be1b877e3]: (4, 'raw') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:10:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-1ae4349c-5871-46d3-ba84-41f7b6b55471 tempest-VolumesImageMetadata-255534905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3dcbba4c-010e-4865-9251-46647ccfeeea {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:48 devstack sudo[87938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3dcbba4c-010e-4865-9251-46647ccfeeea
Apr 15 20:10:48 devstack sudo[87938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:48 devstack sudo[87933]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-35685a60-b38c-4156-9faf-0425cd321abb tempest-VolumesGetTest-1188070236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2" returned: 0 in 0.526s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:48 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-35685a60-b38c-4156-9faf-0425cd321abb tempest-VolumesGetTest-1188070236 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:10:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-35685a60-b38c-4156-9faf-0425cd321abb tempest-VolumesGetTest-1188070236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:10:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-c0deee47-ebe0-494f-b4f2-b064e5fc4b36 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.061s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:10:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-35685a60-b38c-4156-9faf-0425cd321abb tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b69bc4c-5c66-4124-bc8d-ce8e3895de01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-35685a60-b38c-4156-9faf-0425cd321abb tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d4d6e40-78f4-4008-ba97-234e9a220016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:48 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-c0deee47-ebe0-494f-b4f2-b064e5fc4b36 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Creating offline snapshot 56e7b2fe-e8b1-433f-9218-b473be92a1ea of volume e5eeca01-8fe9-4200-a2b9-547cdfc8387f {{(pid=82646) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 20:10:48 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-35685a60-b38c-4156-9faf-0425cd321abb tempest-VolumesGetTest-1188070236 None] Volume volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2 (b5f365c1-ad6d-49b9-9c37-78889ce516a2): created successfully
Apr 15 20:10:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-35685a60-b38c-4156-9faf-0425cd321abb tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d4d6e40-78f4-4008-ba97-234e9a220016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-35685a60-b38c-4156-9faf-0425cd321abb tempest-VolumesGetTest-1188070236 None] Flow 'volume_create_manager' (39736678-e9fd-4929-9f80-e216e3de6f4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:10:48 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc41b116-088b-44a7-822e-8a6fd05f54b4]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:10:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c0deee47-ebe0-494f-b4f2-b064e5fc4b36 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e5eeca01-8fe9-4200-a2b9-547cdfc8387f {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:48 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-35685a60-b38c-4156-9faf-0425cd321abb tempest-VolumesGetTest-1188070236 None] Created volume successfully.
Apr 15 20:10:48 devstack sudo[87941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e5eeca01-8fe9-4200-a2b9-547cdfc8387f
Apr 15 20:10:48 devstack sudo[87941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:48 devstack sudo[87938]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-1ae4349c-5871-46d3-ba84-41f7b6b55471 tempest-VolumesImageMetadata-255534905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3dcbba4c-010e-4865-9251-46647ccfeeea" returned: 0 in 0.501s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-1ae4349c-5871-46d3-ba84-41f7b6b55471 tempest-VolumesImageMetadata-255534905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3dcbba4c-010e-4865-9251-46647ccfeeea {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:48 devstack sudo[87945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3dcbba4c-010e-4865-9251-46647ccfeeea
Apr 15 20:10:48 devstack sudo[87945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:48 devstack cinder-volume[82646]: DEBUG oslo_service.periodic_task [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 15 20:10:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:10:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:10:48 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:10:48 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:10:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:10:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:48 devstack sudo[87941]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c0deee47-ebe0-494f-b4f2-b064e5fc4b36 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e5eeca01-8fe9-4200-a2b9-547cdfc8387f" returned: 0 in 0.566s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c0deee47-ebe0-494f-b4f2-b064e5fc4b36 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e5eeca01-8fe9-4200-a2b9-547cdfc8387f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e5eeca01-8fe9-4200-a2b9-547cdfc8387f.56e7b2fe-e8b1-433f-9218-b473be92a1ea 2G {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:48 devstack sudo[87950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:10:48 devstack sudo[87950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:48 devstack sudo[87951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e5eeca01-8fe9-4200-a2b9-547cdfc8387f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e5eeca01-8fe9-4200-a2b9-547cdfc8387f.56e7b2fe-e8b1-433f-9218-b473be92a1ea 2G
Apr 15 20:10:48 devstack sudo[87951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:49 devstack sudo[87945]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:49 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-1ae4349c-5871-46d3-ba84-41f7b6b55471 tempest-VolumesImageMetadata-255534905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3dcbba4c-010e-4865-9251-46647ccfeeea" returned: 1 in 0.515s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:49 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-1ae4349c-5871-46d3-ba84-41f7b6b55471 tempest-VolumesImageMetadata-255534905 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3dcbba4c-010e-4865-9251-46647ccfeeea' failed. Not Retrying. {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 20:10:49 devstack cinder-volume[82646]: DEBUG cinder.volume.volume_utils [None req-1ae4349c-5871-46d3-ba84-41f7b6b55471 tempest-VolumesImageMetadata-255534905 None] Downloaded image 565a23e3-dcfa-4a62-b361-219578b0cd92 ((None, [{'url': 'file:///opt/stack/data/glance/images/565a23e3-dcfa-4a62-b361-219578b0cd92', 'metadata': {}}])) to volume 3dcbba4c-010e-4865-9251-46647ccfeeea successfully. {{(pid=82646) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 15 20:10:49 devstack cinder-volume[82646]: DEBUG cinder.image.image_utils [None req-1ae4349c-5871-46d3-ba84-41f7b6b55471 tempest-VolumesImageMetadata-255534905 None] Temporary image 565a23e3-dcfa-4a62-b361-219578b0cd92 for user 8b2f3509a92343789d59363ffb4754b4 is deleted. {{(pid=82646) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 15 20:10:49 devstack cinder-volume[82646]: DEBUG cinder.volume.volume_utils [None req-1ae4349c-5871-46d3-ba84-41f7b6b55471 tempest-VolumesImageMetadata-255534905 None] Marking volume 3dcbba4c-010e-4865-9251-46647ccfeeea as bootable. {{(pid=82646) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 15 20:10:49 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ae4349c-5871-46d3-ba84-41f7b6b55471 tempest-VolumesImageMetadata-255534905 None] Copying metadata from image 565a23e3-dcfa-4a62-b361-219578b0cd92 to 3dcbba4c-010e-4865-9251-46647ccfeeea. {{(pid=82646) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 15 20:10:49 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ae4349c-5871-46d3-ba84-41f7b6b55471 tempest-VolumesImageMetadata-255534905 None] Creating volume glance metadata for volume 3dcbba4c-010e-4865-9251-46647ccfeeea backed by image 565a23e3-dcfa-4a62-b361-219578b0cd92 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '565a23e3-dcfa-4a62-b361-219578b0cd92', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82646) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 15 20:10:49 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-1ae4349c-5871-46d3-ba84-41f7b6b55471 tempest-VolumesImageMetadata-255534905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17476957-e09a-4f7f-ab1f-49e131865dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dcbba4c-010e-4865-9251-46647ccfeeea', 'volume_size': 1, 'image_id': '565a23e3-dcfa-4a62-b361-219578b0cd92', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/565a23e3-dcfa-4a62-b361-219578b0cd92', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '27d9c820db6c4abea4324fe8ea0f90e6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '565a23e3-dcfa-4a62-b361-219578b0cd92', 'created_at': datetime.datetime(2026, 4, 15, 18, 0, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 18, 0, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/565a23e3-dcfa-4a62-b361-219578b0cd92/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe15d3312d0>}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:49 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-1ae4349c-5871-46d3-ba84-41f7b6b55471 tempest-VolumesImageMetadata-255534905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c5e35b5-78df-412c-80a3-7814bb782659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:49 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-1ae4349c-5871-46d3-ba84-41f7b6b55471 tempest-VolumesImageMetadata-255534905 None] Volume volume-3dcbba4c-010e-4865-9251-46647ccfeeea (3dcbba4c-010e-4865-9251-46647ccfeeea): created successfully
Apr 15 20:10:49 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-1ae4349c-5871-46d3-ba84-41f7b6b55471 tempest-VolumesImageMetadata-255534905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c5e35b5-78df-412c-80a3-7814bb782659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:49 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-1ae4349c-5871-46d3-ba84-41f7b6b55471 tempest-VolumesImageMetadata-255534905 None] Flow 'volume_create_manager' (0bf72fcb-04c4-4258-8207-6bbb7409f7d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:10:49 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-1ae4349c-5871-46d3-ba84-41f7b6b55471 tempest-VolumesImageMetadata-255534905 None] Created volume successfully.
Apr 15 20:10:49 devstack cinder-volume[82646]: DEBUG dbcounter [-] [82646] Writing DB stats cinder:UPDATE=216,cinder:DELETE=14,cinder:SELECT=164,cinder:INSERT=58 {{(pid=82646) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 20:10:49 devstack sudo[87950]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:49 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.496s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:49 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:10:49 devstack cinder-volume[82646]: DEBUG dbcounter [-] [82646] Writing DB stats cinder:SELECT=166,cinder:INSERT=61,cinder:UPDATE=197,cinder:DELETE=18 {{(pid=82646) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 20:10:49 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:10:49 devstack sudo[87951]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:49 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c0deee47-ebe0-494f-b4f2-b064e5fc4b36 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e5eeca01-8fe9-4200-a2b9-547cdfc8387f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e5eeca01-8fe9-4200-a2b9-547cdfc8387f.56e7b2fe-e8b1-433f-9218-b473be92a1ea 2G" returned: 0 in 0.585s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:49 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c0deee47-ebe0-494f-b4f2-b064e5fc4b36 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5eeca01-8fe9-4200-a2b9-547cdfc8387f -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e5eeca01-8fe9-4200-a2b9-547cdfc8387f.56e7b2fe-e8b1-433f-9218-b473be92a1ea {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:49 devstack sudo[87961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5eeca01-8fe9-4200-a2b9-547cdfc8387f -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e5eeca01-8fe9-4200-a2b9-547cdfc8387f.56e7b2fe-e8b1-433f-9218-b473be92a1ea
Apr 15 20:10:49 devstack sudo[87961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:49 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] Flow 'volume_create_manager' (667e6e93-6860-4432-8ddd-ad15dc314769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:10:49 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6268f49-cfd0-4008-89bb-1dd73ecb02f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:49 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6268f49-cfd0-4008-89bb-1dd73ecb02f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:10:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1791467771',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=832a7e45-a324-4155-bdff-cd6beb63a86b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7fd52c85921a443d92f594a7f2280e9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:10:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=b5f365c1-ad6d-49b9-9c37-78889ce516a2,status='creating',terminated_at=None,updated_at=2026-04-15T18:10:49Z,use_quota=True,user_id='d7a23dd5ade7439ca285e5922adb8785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:49 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ce11ca5-d9c1-4bdb-af4b-0d1aa05b96c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:49 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ce11ca5-d9c1-4bdb-af4b-0d1aa05b96c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:49 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e641d9f-2440-43a5-b7ed-8996392573a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:49 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e641d9f-2440-43a5-b7ed-8996392573a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '832a7e45-a324-4155-bdff-cd6beb63a86b', 'volume_name': 'volume-832a7e45-a324-4155-bdff-cd6beb63a86b', 'volume_size': 1, 'source_volid': 'b5f365c1-ad6d-49b9-9c37-78889ce516a2', 'source_volstatus': 'available'}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:49 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49118668-a266-46cc-9ec0-469f47b0eb45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:49 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49118668-a266-46cc-9ec0-469f47b0eb45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:49 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9ad01ea-b0d1-4471-bda2-6d0fddc60ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:49 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] Volume 832a7e45-a324-4155-bdff-cd6beb63a86b: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-832a7e45-a324-4155-bdff-cd6beb63a86b', 'volume_size': 1, 'source_volid': 'b5f365c1-ad6d-49b9-9c37-78889ce516a2', 'source_volstatus': 'available'}
Apr 15 20:10:49 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:10:49 devstack sudo[87961]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:49 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c0deee47-ebe0-494f-b4f2-b064e5fc4b36 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5eeca01-8fe9-4200-a2b9-547cdfc8387f -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e5eeca01-8fe9-4200-a2b9-547cdfc8387f.56e7b2fe-e8b1-433f-9218-b473be92a1ea" returned: 0 in 0.462s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:49 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-c0deee47-ebe0-494f-b4f2-b064e5fc4b36 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e5eeca01-8fe9-4200-a2b9-547cdfc8387f.56e7b2fe-e8b1-433f-9218-b473be92a1ea is being set with open permissions: ugo+rw
Apr 15 20:10:49 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c0deee47-ebe0-494f-b4f2-b064e5fc4b36 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e5eeca01-8fe9-4200-a2b9-547cdfc8387f.56e7b2fe-e8b1-433f-9218-b473be92a1ea {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:49 devstack sudo[87966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e5eeca01-8fe9-4200-a2b9-547cdfc8387f.56e7b2fe-e8b1-433f-9218-b473be92a1ea
Apr 15 20:10:49 devstack sudo[87966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:50 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-5e86a82a-3504-4104-83ed-3e9a46f48478 tempest-VolumesImageMetadata-255534905 None] Acquiring lock "cinder-3dcbba4c-010e-4865-9251-46647ccfeeea-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:10:50 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-5e86a82a-3504-4104-83ed-3e9a46f48478 tempest-VolumesImageMetadata-255534905 None] Lock "cinder-3dcbba4c-010e-4865-9251-46647ccfeeea-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:10:50 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-5e86a82a-3504-4104-83ed-3e9a46f48478 tempest-VolumesImageMetadata-255534905 None] Acquiring lock "cinder-quobyte-3dcbba4c-010e-4865-9251-46647ccfeeea" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:10:50 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-5e86a82a-3504-4104-83ed-3e9a46f48478 tempest-VolumesImageMetadata-255534905 None] Lock "cinder-quobyte-3dcbba4c-010e-4865-9251-46647ccfeeea" acquired by "delete_volume" :: waited 0.007s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:10:50 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a4d7e7-8f92-4aa4-a938-c3aaa004f28a]: (4, 'raw') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:10:50 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5e86a82a-3504-4104-83ed-3e9a46f48478 tempest-VolumesImageMetadata-255534905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3dcbba4c-010e-4865-9251-46647ccfeeea {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:50 devstack sudo[87966]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:50 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c0deee47-ebe0-494f-b4f2-b064e5fc4b36 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e5eeca01-8fe9-4200-a2b9-547cdfc8387f.56e7b2fe-e8b1-433f-9218-b473be92a1ea" returned: 0 in 0.477s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:50 devstack sudo[87969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3dcbba4c-010e-4865-9251-46647ccfeeea
Apr 15 20:10:50 devstack sudo[87969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:50 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c0deee47-ebe0-494f-b4f2-b064e5fc4b36 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e5eeca01-8fe9-4200-a2b9-547cdfc8387f.info {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:50 devstack sudo[87971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e5eeca01-8fe9-4200-a2b9-547cdfc8387f.info
Apr 15 20:10:50 devstack sudo[87971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:50 devstack sudo[87969]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:50 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5e86a82a-3504-4104-83ed-3e9a46f48478 tempest-VolumesImageMetadata-255534905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3dcbba4c-010e-4865-9251-46647ccfeeea" returned: 0 in 0.546s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:50 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5e86a82a-3504-4104-83ed-3e9a46f48478 tempest-VolumesImageMetadata-255534905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3dcbba4c-010e-4865-9251-46647ccfeeea {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:50 devstack sudo[87971]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:50 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c0deee47-ebe0-494f-b4f2-b064e5fc4b36 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e5eeca01-8fe9-4200-a2b9-547cdfc8387f.info" returned: 0 in 0.500s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:50 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-c0deee47-ebe0-494f-b4f2-b064e5fc4b36 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e5eeca01-8fe9-4200-a2b9-547cdfc8387f.info is being set with open permissions: ugo+rw
Apr 15 20:10:50 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c0deee47-ebe0-494f-b4f2-b064e5fc4b36 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e5eeca01-8fe9-4200-a2b9-547cdfc8387f.info {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:50 devstack sudo[87976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3dcbba4c-010e-4865-9251-46647ccfeeea
Apr 15 20:10:50 devstack sudo[87976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:50 devstack sudo[87977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e5eeca01-8fe9-4200-a2b9-547cdfc8387f.info
Apr 15 20:10:50 devstack sudo[87977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:51 devstack sudo[87977]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:51 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c0deee47-ebe0-494f-b4f2-b064e5fc4b36 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e5eeca01-8fe9-4200-a2b9-547cdfc8387f.info" returned: 0 in 0.453s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:51 devstack sudo[87976]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:51 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-c0deee47-ebe0-494f-b4f2-b064e5fc4b36 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.130s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:10:51 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.808s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:10:51 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] Cloning volume b5f365c1-ad6d-49b9-9c37-78889ce516a2 to volume 832a7e45-a324-4155-bdff-cd6beb63a86b
Apr 15 20:10:51 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5e86a82a-3504-4104-83ed-3e9a46f48478 tempest-VolumesImageMetadata-255534905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3dcbba4c-010e-4865-9251-46647ccfeeea" returned: 1 in 0.518s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:51 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5e86a82a-3504-4104-83ed-3e9a46f48478 tempest-VolumesImageMetadata-255534905 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3dcbba4c-010e-4865-9251-46647ccfeeea' failed. Not Retrying. {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 20:10:51 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5e86a82a-3504-4104-83ed-3e9a46f48478 tempest-VolumesImageMetadata-255534905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3dcbba4c-010e-4865-9251-46647ccfeeea {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:51 devstack sudo[87984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3dcbba4c-010e-4865-9251-46647ccfeeea
Apr 15 20:10:51 devstack sudo[87984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:51 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-c0deee47-ebe0-494f-b4f2-b064e5fc4b36 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Create snapshot completed successfully
Apr 15 20:10:51 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] Creating offline snapshot 5a4af6bf-7ef0-41af-9ee4-6220a9556090 of volume b5f365c1-ad6d-49b9-9c37-78889ce516a2 {{(pid=82646) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 20:10:51 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[934ebcc4-ffbf-4e35-a773-3336f02a15ef]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:10:51 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:51 devstack sudo[87986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2
Apr 15 20:10:51 devstack sudo[87986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:51 devstack sudo[87984]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:51 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5e86a82a-3504-4104-83ed-3e9a46f48478 tempest-VolumesImageMetadata-255534905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3dcbba4c-010e-4865-9251-46647ccfeeea" returned: 0 in 0.520s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:51 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-5e86a82a-3504-4104-83ed-3e9a46f48478 tempest-VolumesImageMetadata-255534905 None] Lock "cinder-quobyte-3dcbba4c-010e-4865-9251-46647ccfeeea" released by "delete_volume" :: held 1.637s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:10:52 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-5e86a82a-3504-4104-83ed-3e9a46f48478 tempest-VolumesImageMetadata-255534905 None] Created reservations ['78aebd5a-f7a6-4a9a-861a-615a4d779dc4', '4494ea70-5828-4907-9082-75ecdcf0798c', 'd53f4c27-9831-4e6b-86a0-71c1c580e96f', '53cacbd5-3d36-4a21-9244-3faeefd29b28'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:10:52 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-5e86a82a-3504-4104-83ed-3e9a46f48478 tempest-VolumesImageMetadata-255534905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:10:52 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-5e86a82a-3504-4104-83ed-3e9a46f48478 tempest-VolumesImageMetadata-255534905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:10:52 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-5e86a82a-3504-4104-83ed-3e9a46f48478 tempest-VolumesImageMetadata-255534905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:10:52 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-5e86a82a-3504-4104-83ed-3e9a46f48478 tempest-VolumesImageMetadata-255534905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:10:52 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-5e86a82a-3504-4104-83ed-3e9a46f48478 tempest-VolumesImageMetadata-255534905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:10:52 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5e86a82a-3504-4104-83ed-3e9a46f48478 tempest-VolumesImageMetadata-255534905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:52 devstack sudo[87986]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:52 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2" returned: 0 in 0.611s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:52 devstack sudo[87993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:10:52 devstack sudo[87993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:52 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2.5a4af6bf-7ef0-41af-9ee4-6220a9556090 1G {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:52 devstack sudo[87995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2.5a4af6bf-7ef0-41af-9ee4-6220a9556090 1G
Apr 15 20:10:52 devstack sudo[87995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:52 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-90842cbb-f423-4559-b191-afd0067496a6 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Acquiring lock "cinder-56e7b2fe-e8b1-433f-9218-b473be92a1ea-delete_snapshot" by "delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:10:52 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-90842cbb-f423-4559-b191-afd0067496a6 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Lock "cinder-56e7b2fe-e8b1-433f-9218-b473be92a1ea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:10:52 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-90842cbb-f423-4559-b191-afd0067496a6 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Acquiring lock "cinder-quobyte-e5eeca01-8fe9-4200-a2b9-547cdfc8387f" by "delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:10:52 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-90842cbb-f423-4559-b191-afd0067496a6 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Lock "cinder-quobyte-e5eeca01-8fe9-4200-a2b9-547cdfc8387f" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:10:52 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-90842cbb-f423-4559-b191-afd0067496a6 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Acquiring lock "cinder-quobyte-56e7b2fe-e8b1-433f-9218-b473be92a1ea" by "_delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:10:52 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-90842cbb-f423-4559-b191-afd0067496a6 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Lock "cinder-quobyte-56e7b2fe-e8b1-433f-9218-b473be92a1ea" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:10:52 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-90842cbb-f423-4559-b191-afd0067496a6 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Deleting offline snapshot 56e7b2fe-e8b1-433f-9218-b473be92a1ea of volume e5eeca01-8fe9-4200-a2b9-547cdfc8387f {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 20:10:52 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-90842cbb-f423-4559-b191-afd0067496a6 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] snapshot_file for this snap is: volume-e5eeca01-8fe9-4200-a2b9-547cdfc8387f.56e7b2fe-e8b1-433f-9218-b473be92a1ea {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 20:10:52 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec92fdb3-e008-4b3c-a155-691d4a1d97ed]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:10:52 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-90842cbb-f423-4559-b191-afd0067496a6 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e5eeca01-8fe9-4200-a2b9-547cdfc8387f.56e7b2fe-e8b1-433f-9218-b473be92a1ea {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:52 devstack sudo[88001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e5eeca01-8fe9-4200-a2b9-547cdfc8387f.56e7b2fe-e8b1-433f-9218-b473be92a1ea
Apr 15 20:10:52 devstack sudo[88001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:52 devstack sudo[87995]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:52 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2.5a4af6bf-7ef0-41af-9ee4-6220a9556090 1G" returned: 0 in 0.722s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:52 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2 -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2.5a4af6bf-7ef0-41af-9ee4-6220a9556090 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:52 devstack sudo[88004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2 -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2.5a4af6bf-7ef0-41af-9ee4-6220a9556090
Apr 15 20:10:52 devstack sudo[88004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:52 devstack sudo[87993]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:52 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5e86a82a-3504-4104-83ed-3e9a46f48478 tempest-VolumesImageMetadata-255534905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.787s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:52 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-5e86a82a-3504-4104-83ed-3e9a46f48478 tempest-VolumesImageMetadata-255534905 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:10:52 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-5e86a82a-3504-4104-83ed-3e9a46f48478 tempest-VolumesImageMetadata-255534905 None] Deleted volume successfully.
Apr 15 20:10:52 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-5e86a82a-3504-4104-83ed-3e9a46f48478 tempest-VolumesImageMetadata-255534905 None] Lock "cinder-3dcbba4c-010e-4865-9251-46647ccfeeea-delete_volume" released by "delete_volume" :: held 2.617s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:10:53 devstack sudo[88004]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:53 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2 -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2.5a4af6bf-7ef0-41af-9ee4-6220a9556090" returned: 0 in 0.457s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:53 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2.5a4af6bf-7ef0-41af-9ee4-6220a9556090 is being set with open permissions: ugo+rw
Apr 15 20:10:53 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2.5a4af6bf-7ef0-41af-9ee4-6220a9556090 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:53 devstack sudo[88016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2.5a4af6bf-7ef0-41af-9ee4-6220a9556090
Apr 15 20:10:53 devstack sudo[88016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:53 devstack sudo[88001]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:53 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-90842cbb-f423-4559-b191-afd0067496a6 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e5eeca01-8fe9-4200-a2b9-547cdfc8387f.56e7b2fe-e8b1-433f-9218-b473be92a1ea" returned: 0 in 0.779s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:53 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-90842cbb-f423-4559-b191-afd0067496a6 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5eeca01-8fe9-4200-a2b9-547cdfc8387f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82646) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 20:10:53 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[301c4b22-7037-4927-b087-87a83fc8bb32]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:10:53 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-90842cbb-f423-4559-b191-afd0067496a6 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e5eeca01-8fe9-4200-a2b9-547cdfc8387f {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:53 devstack sudo[88024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e5eeca01-8fe9-4200-a2b9-547cdfc8387f
Apr 15 20:10:53 devstack sudo[88024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:53 devstack sudo[88016]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:53 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2.5a4af6bf-7ef0-41af-9ee4-6220a9556090" returned: 0 in 0.466s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:53 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2.info {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:53 devstack sudo[88032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2.info
Apr 15 20:10:53 devstack sudo[88032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:54 devstack sudo[88024]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:54 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-90842cbb-f423-4559-b191-afd0067496a6 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e5eeca01-8fe9-4200-a2b9-547cdfc8387f" returned: 0 in 0.627s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:54 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-90842cbb-f423-4559-b191-afd0067496a6 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e5eeca01-8fe9-4200-a2b9-547cdfc8387f.56e7b2fe-e8b1-433f-9218-b473be92a1ea {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:54 devstack sudo[88037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e5eeca01-8fe9-4200-a2b9-547cdfc8387f.56e7b2fe-e8b1-433f-9218-b473be92a1ea
Apr 15 20:10:54 devstack sudo[88037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:54 devstack sudo[88032]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:54 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2.info" returned: 0 in 0.486s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:54 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2.info is being set with open permissions: ugo+rw
Apr 15 20:10:54 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2.info {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:54 devstack sudo[88040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2.info
Apr 15 20:10:54 devstack sudo[88040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:54 devstack sudo[88037]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:54 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-90842cbb-f423-4559-b191-afd0067496a6 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e5eeca01-8fe9-4200-a2b9-547cdfc8387f.56e7b2fe-e8b1-433f-9218-b473be92a1ea" returned: 0 in 0.518s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:54 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-90842cbb-f423-4559-b191-afd0067496a6 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e5eeca01-8fe9-4200-a2b9-547cdfc8387f.56e7b2fe-e8b1-433f-9218-b473be92a1ea {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:54 devstack sudo[88045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e5eeca01-8fe9-4200-a2b9-547cdfc8387f.56e7b2fe-e8b1-433f-9218-b473be92a1ea
Apr 15 20:10:54 devstack sudo[88045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:54 devstack sudo[88040]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:54 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2.info" returned: 0 in 0.531s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:54 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] Acquiring lock "cinder-quobyte-832a7e45-a324-4155-bdff-cd6beb63a86b" by "_copy_volume_from_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:10:54 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] Lock "cinder-quobyte-832a7e45-a324-4155-bdff-cd6beb63a86b" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:10:54 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] snapshot: 5a4af6bf-7ef0-41af-9ee4-6220a9556090, volume: 832a7e45-a324-4155-bdff-cd6beb63a86b,  {{(pid=82646) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 15 20:10:54 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:10:54 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:10:54 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:10:54 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:10:54 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:10:54 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc026c6-d6e4-4307-b201-f01c4303565f]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:10:54 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2.5a4af6bf-7ef0-41af-9ee4-6220a9556090 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:54 devstack sudo[88048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2.5a4af6bf-7ef0-41af-9ee4-6220a9556090
Apr 15 20:10:54 devstack sudo[88048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:55 devstack sudo[88045]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:55 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-90842cbb-f423-4559-b191-afd0067496a6 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e5eeca01-8fe9-4200-a2b9-547cdfc8387f.56e7b2fe-e8b1-433f-9218-b473be92a1ea" returned: 0 in 0.600s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:55 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-a478ff66-f74e-4a5e-b26d-56537408051a tempest-AbsoluteLimitsTests-985592610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:10:55 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-a478ff66-f74e-4a5e-b26d-56537408051a tempest-AbsoluteLimitsTests-985592610 None] Flow 'volume_create_manager' (a5096d86-4a66-41a5-afb0-826eff69c693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:10:55 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-a478ff66-f74e-4a5e-b26d-56537408051a tempest-AbsoluteLimitsTests-985592610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a2997df-842a-414d-bd30-97e0692fa818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:55 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-90842cbb-f423-4559-b191-afd0067496a6 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Lock "cinder-quobyte-56e7b2fe-e8b1-433f-9218-b473be92a1ea" released by "_delete_snapshot" :: held 2.615s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:10:55 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-a478ff66-f74e-4a5e-b26d-56537408051a tempest-AbsoluteLimitsTests-985592610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a2997df-842a-414d-bd30-97e0692fa818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:10:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1109740282',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=793efced-fade-4aeb-8b91-a0dd6250b46c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4d262a5b7fa441284e2a3d876323649',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:10:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:10:55Z,use_quota=True,user_id='1af254bdd0f448c28d8d6e0ea6eac22e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:55 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-a478ff66-f74e-4a5e-b26d-56537408051a tempest-AbsoluteLimitsTests-985592610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a90af8ef-91ad-4602-869f-68f668d9de68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:55 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-a478ff66-f74e-4a5e-b26d-56537408051a tempest-AbsoluteLimitsTests-985592610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a90af8ef-91ad-4602-869f-68f668d9de68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:55 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-a478ff66-f74e-4a5e-b26d-56537408051a tempest-AbsoluteLimitsTests-985592610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae8a055e-37c0-4470-afea-cb020b4c49d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:55 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-a478ff66-f74e-4a5e-b26d-56537408051a tempest-AbsoluteLimitsTests-985592610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae8a055e-37c0-4470-afea-cb020b4c49d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '793efced-fade-4aeb-8b91-a0dd6250b46c', 'volume_name': 'volume-793efced-fade-4aeb-8b91-a0dd6250b46c', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:55 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-a478ff66-f74e-4a5e-b26d-56537408051a tempest-AbsoluteLimitsTests-985592610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b429c76-6a59-45c3-b951-743f19f2057f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:55 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-a478ff66-f74e-4a5e-b26d-56537408051a tempest-AbsoluteLimitsTests-985592610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b429c76-6a59-45c3-b951-743f19f2057f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:10:55 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-a478ff66-f74e-4a5e-b26d-56537408051a tempest-AbsoluteLimitsTests-985592610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c846626-33c9-4ac6-916c-56a75f198f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:10:55 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-a478ff66-f74e-4a5e-b26d-56537408051a tempest-AbsoluteLimitsTests-985592610 None] Volume 793efced-fade-4aeb-8b91-a0dd6250b46c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-793efced-fade-4aeb-8b91-a0dd6250b46c', 'volume_size': 1}
Apr 15 20:10:55 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-a478ff66-f74e-4a5e-b26d-56537408051a tempest-AbsoluteLimitsTests-985592610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:10:55 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-90842cbb-f423-4559-b191-afd0067496a6 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Lock "cinder-quobyte-e5eeca01-8fe9-4200-a2b9-547cdfc8387f" released by "delete_snapshot" :: held 2.662s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:10:55 devstack sudo[88048]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:55 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2.5a4af6bf-7ef0-41af-9ee4-6220a9556090" returned: 0 in 0.487s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:55 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82646) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 20:10:55 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2 {{(pid=82646) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 15 20:10:55 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] Creating direct copy from snapshot {{(pid=82646) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 15 20:10:55 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e00d28-5201-45c6-bd27-db4022c367fb]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:10:55 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:55 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-90842cbb-f423-4559-b191-afd0067496a6 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Created reservations ['237d7f95-c2df-4c4c-8a09-e514c36a2250', '464d899f-a0d0-41c4-b613-017c02e7ff26', '5ad787a6-eb39-47b8-b712-662401e1704d', 'ce7fe997-71a3-4d8d-8cd5-82e654423003'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:10:55 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-90842cbb-f423-4559-b191-afd0067496a6 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Delete snapshot completed successfully.
Apr 15 20:10:55 devstack sudo[88054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2
Apr 15 20:10:55 devstack sudo[88054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:55 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-90842cbb-f423-4559-b191-afd0067496a6 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Lock "cinder-56e7b2fe-e8b1-433f-9218-b473be92a1ea-delete_snapshot" released by "delete_snapshot" :: held 2.771s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:10:55 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-c3c589f8-f9d1-4c08-9b3f-02ce057c5542 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Acquiring lock "cinder-e5eeca01-8fe9-4200-a2b9-547cdfc8387f-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:10:55 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-c3c589f8-f9d1-4c08-9b3f-02ce057c5542 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Lock "cinder-e5eeca01-8fe9-4200-a2b9-547cdfc8387f-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:10:55 devstack sudo[88054]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:55 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2" returned: 0 in 0.567s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:55 devstack cinder-volume[82646]: DEBUG cinder.utils [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] Path /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-832a7e45-a324-4155-bdff-cd6beb63a86b not found in is_blk_device check {{(pid=82646) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 15 20:10:55 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-832a7e45-a324-4155-bdff-cd6beb63a86b {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:55 devstack sudo[88059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-832a7e45-a324-4155-bdff-cd6beb63a86b
Apr 15 20:10:55 devstack sudo[88059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:55 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-c3c589f8-f9d1-4c08-9b3f-02ce057c5542 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Acquiring lock "cinder-quobyte-e5eeca01-8fe9-4200-a2b9-547cdfc8387f" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:10:55 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-c3c589f8-f9d1-4c08-9b3f-02ce057c5542 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Lock "cinder-quobyte-e5eeca01-8fe9-4200-a2b9-547cdfc8387f" acquired by "delete_volume" :: waited 0.009s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:10:55 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2631da5-64fe-4180-ac61-9786c6e0833d]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:10:55 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c3c589f8-f9d1-4c08-9b3f-02ce057c5542 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e5eeca01-8fe9-4200-a2b9-547cdfc8387f {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:56 devstack sudo[88061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e5eeca01-8fe9-4200-a2b9-547cdfc8387f
Apr 15 20:10:56 devstack sudo[88061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:56 devstack sudo[88061]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:56 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c3c589f8-f9d1-4c08-9b3f-02ce057c5542 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e5eeca01-8fe9-4200-a2b9-547cdfc8387f" returned: 0 in 0.842s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:56 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c3c589f8-f9d1-4c08-9b3f-02ce057c5542 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e5eeca01-8fe9-4200-a2b9-547cdfc8387f {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:56 devstack sudo[88080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e5eeca01-8fe9-4200-a2b9-547cdfc8387f
Apr 15 20:10:56 devstack sudo[88080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:58 devstack sudo[88080]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:58 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c3c589f8-f9d1-4c08-9b3f-02ce057c5542 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e5eeca01-8fe9-4200-a2b9-547cdfc8387f" returned: 0 in 1.593s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:58 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-c3c589f8-f9d1-4c08-9b3f-02ce057c5542 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Lock "cinder-quobyte-e5eeca01-8fe9-4200-a2b9-547cdfc8387f" released by "delete_volume" :: held 2.497s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:10:58 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-c3c589f8-f9d1-4c08-9b3f-02ce057c5542 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Created reservations ['bbbebf4d-f7f9-4fd7-816c-577e0ff915ef', 'bb368950-6294-43a2-b6f3-c9fa281db421', 'dcd7f387-5b3a-4b8e-8ca8-42174888d2a4', 'ca71b77b-e1bd-43ad-9566-62cf5da8cdf3'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:10:58 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-c3c589f8-f9d1-4c08-9b3f-02ce057c5542 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:10:58 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-c3c589f8-f9d1-4c08-9b3f-02ce057c5542 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:10:58 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-c3c589f8-f9d1-4c08-9b3f-02ce057c5542 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:10:58 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-c3c589f8-f9d1-4c08-9b3f-02ce057c5542 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:10:58 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-c3c589f8-f9d1-4c08-9b3f-02ce057c5542 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:10:58 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c3c589f8-f9d1-4c08-9b3f-02ce057c5542 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:58 devstack sudo[88059]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:58 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-832a7e45-a324-4155-bdff-cd6beb63a86b" returned: 0 in 2.721s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:58 devstack sudo[88110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:10:58 devstack sudo[88110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:58 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[2723b913-574a-4b57-9eee-d2bae9624a05]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:10:58 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:58 devstack sudo[88112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2
Apr 15 20:10:58 devstack sudo[88112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:59 devstack sudo[88110]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:59 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c3c589f8-f9d1-4c08-9b3f-02ce057c5542 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.478s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:59 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-c3c589f8-f9d1-4c08-9b3f-02ce057c5542 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:10:59 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-c3c589f8-f9d1-4c08-9b3f-02ce057c5542 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Deleted volume successfully.
Apr 15 20:10:59 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-c3c589f8-f9d1-4c08-9b3f-02ce057c5542 tempest-VolumesSnapshotNegativeTestJSON-1798692724 None] Lock "cinder-e5eeca01-8fe9-4200-a2b9-547cdfc8387f-delete_volume" released by "delete_volume" :: held 3.223s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:10:59 devstack sudo[88112]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:59 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2" returned: 0 in 0.670s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:59 devstack cinder-volume[82646]: DEBUG cinder.image.image_utils [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] Image conversion details: src /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2, size 1024.00 MB, duration 2.72 sec, destination /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-832a7e45-a324-4155-bdff-cd6beb63a86b {{(pid=82646) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 20:10:59 devstack cinder-volume[82646]: INFO cinder.image.image_utils [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] Converted 1024.00 MB image at 376.06 MB/s
Apr 15 20:10:59 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-832a7e45-a324-4155-bdff-cd6beb63a86b is being set with open permissions: ugo+rw
Apr 15 20:10:59 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-832a7e45-a324-4155-bdff-cd6beb63a86b {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:10:59 devstack sudo[88119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-832a7e45-a324-4155-bdff-cd6beb63a86b
Apr 15 20:10:59 devstack sudo[88119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:10:59 devstack sudo[88119]: pam_unix(sudo:session): session closed for user root
Apr 15 20:10:59 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-832a7e45-a324-4155-bdff-cd6beb63a86b" returned: 0 in 0.562s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:10:59 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] Lock "cinder-quobyte-832a7e45-a324-4155-bdff-cd6beb63a86b" released by "_copy_volume_from_snapshot" :: held 5.064s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:10:59 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] Acquiring lock "cinder-quobyte-5a4af6bf-7ef0-41af-9ee4-6220a9556090" by "_delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:10:59 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] Lock "cinder-quobyte-5a4af6bf-7ef0-41af-9ee4-6220a9556090" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:10:59 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] Deleting offline snapshot 5a4af6bf-7ef0-41af-9ee4-6220a9556090 of volume b5f365c1-ad6d-49b9-9c37-78889ce516a2 {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 20:10:59 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] snapshot_file for this snap is: volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2.5a4af6bf-7ef0-41af-9ee4-6220a9556090 {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 20:10:59 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0698e75-c8f5-4161-9d7e-3400df460258]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:10:59 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2.5a4af6bf-7ef0-41af-9ee4-6220a9556090 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:00 devstack sudo[88122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2.5a4af6bf-7ef0-41af-9ee4-6220a9556090
Apr 15 20:11:00 devstack sudo[88122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:00 devstack sudo[88122]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:00 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2.5a4af6bf-7ef0-41af-9ee4-6220a9556090" returned: 0 in 0.601s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:00 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82646) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 20:11:00 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7a46d2-844e-4502-8b57-d1b3da0dd96b]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:11:00 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:00 devstack sudo[88127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2
Apr 15 20:11:00 devstack sudo[88127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:01 devstack sudo[88127]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:01 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2" returned: 0 in 0.561s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:01 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2.5a4af6bf-7ef0-41af-9ee4-6220a9556090 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:01 devstack sudo[88132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2.5a4af6bf-7ef0-41af-9ee4-6220a9556090
Apr 15 20:11:01 devstack sudo[88132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:01 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-1216c156-8019-4fa5-a926-16cf9088a4ed tempest-VolumesActionsTest-1438461382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:11:01 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-1216c156-8019-4fa5-a926-16cf9088a4ed tempest-VolumesActionsTest-1438461382 None] Flow 'volume_create_manager' (0c93dab2-9c3d-46fd-a2a4-7a0074550523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:11:01 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-1216c156-8019-4fa5-a926-16cf9088a4ed tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b6224df-f021-461e-9e59-c0d4c5630545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:01 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-1216c156-8019-4fa5-a926-16cf9088a4ed tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b6224df-f021-461e-9e59-c0d4c5630545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1174982250',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54ec3421-3658-4fa0-b60f-8c442007813d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df37bd8c7f7a4cea8e7e0beb744ae494',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:11:01Z,use_quota=True,user_id='51042bd29b7a4a579be7666e3269ba93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:01 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-1216c156-8019-4fa5-a926-16cf9088a4ed tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b82a734f-15b8-4837-a13a-2c462f9916af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:01 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-1216c156-8019-4fa5-a926-16cf9088a4ed tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b82a734f-15b8-4837-a13a-2c462f9916af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:01 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-1216c156-8019-4fa5-a926-16cf9088a4ed tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3d28643-0586-41c4-adf9-76e394bfb9de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:01 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-1216c156-8019-4fa5-a926-16cf9088a4ed tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3d28643-0586-41c4-adf9-76e394bfb9de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54ec3421-3658-4fa0-b60f-8c442007813d', 'volume_name': 'volume-54ec3421-3658-4fa0-b60f-8c442007813d', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:01 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-1216c156-8019-4fa5-a926-16cf9088a4ed tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f70e0dba-1a7e-4527-9fde-88456611425e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:01 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-1216c156-8019-4fa5-a926-16cf9088a4ed tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f70e0dba-1a7e-4527-9fde-88456611425e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:01 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-1216c156-8019-4fa5-a926-16cf9088a4ed tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83a99dd8-4f61-4d29-9587-b4b6d366a7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:01 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-1216c156-8019-4fa5-a926-16cf9088a4ed tempest-VolumesActionsTest-1438461382 None] Volume 54ec3421-3658-4fa0-b60f-8c442007813d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54ec3421-3658-4fa0-b60f-8c442007813d', 'volume_size': 1}
Apr 15 20:11:01 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-1216c156-8019-4fa5-a926-16cf9088a4ed tempest-VolumesActionsTest-1438461382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:01 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-707dcc4e-2f98-4d7f-b3bd-39194721c666 tempest-VolumeDependencyTests-693181165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:11:01 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-707dcc4e-2f98-4d7f-b3bd-39194721c666 tempest-VolumeDependencyTests-693181165 None] Flow 'volume_create_manager' (b9d50f39-a2a1-4f64-8840-3b2103e2ff73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:11:01 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-707dcc4e-2f98-4d7f-b3bd-39194721c666 tempest-VolumeDependencyTests-693181165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0cb608a-e923-4eb8-9389-0cb9b2bdf362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:01 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-707dcc4e-2f98-4d7f-b3bd-39194721c666 tempest-VolumeDependencyTests-693181165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0cb608a-e923-4eb8-9389-0cb9b2bdf362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-100117820',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc1243bb-baf5-4d69-b2a0-d945e1733c58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9003f754c2ca4640a792c44fe89d47cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:11:02Z,use_quota=True,user_id='18ac03d032214d0c8ed2876217eaad94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:01 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-707dcc4e-2f98-4d7f-b3bd-39194721c666 tempest-VolumeDependencyTests-693181165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4dcdaa2-22a4-49e4-9d59-9a8ab200d8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:01 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-707dcc4e-2f98-4d7f-b3bd-39194721c666 tempest-VolumeDependencyTests-693181165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4dcdaa2-22a4-49e4-9d59-9a8ab200d8c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:01 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-707dcc4e-2f98-4d7f-b3bd-39194721c666 tempest-VolumeDependencyTests-693181165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48e42a0c-8bbd-4d81-845f-3b9d3561b876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:01 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-707dcc4e-2f98-4d7f-b3bd-39194721c666 tempest-VolumeDependencyTests-693181165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48e42a0c-8bbd-4d81-845f-3b9d3561b876) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc1243bb-baf5-4d69-b2a0-d945e1733c58', 'volume_name': 'volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:01 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-707dcc4e-2f98-4d7f-b3bd-39194721c666 tempest-VolumeDependencyTests-693181165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17bfc76f-dcd4-482d-a2cf-b8b0f90f7915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:01 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-707dcc4e-2f98-4d7f-b3bd-39194721c666 tempest-VolumeDependencyTests-693181165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17bfc76f-dcd4-482d-a2cf-b8b0f90f7915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:01 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-707dcc4e-2f98-4d7f-b3bd-39194721c666 tempest-VolumeDependencyTests-693181165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3045f95-0e96-4997-b6b2-70a5fd9b1143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:01 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-707dcc4e-2f98-4d7f-b3bd-39194721c666 tempest-VolumeDependencyTests-693181165 None] Volume dc1243bb-baf5-4d69-b2a0-d945e1733c58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58', 'volume_size': 1}
Apr 15 20:11:01 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-707dcc4e-2f98-4d7f-b3bd-39194721c666 tempest-VolumeDependencyTests-693181165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:01 devstack sudo[88132]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:01 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2.5a4af6bf-7ef0-41af-9ee4-6220a9556090" returned: 0 in 0.615s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:01 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2.5a4af6bf-7ef0-41af-9ee4-6220a9556090 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:01 devstack sudo[88138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2.5a4af6bf-7ef0-41af-9ee4-6220a9556090
Apr 15 20:11:01 devstack sudo[88138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:02 devstack sudo[88138]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:02 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2.5a4af6bf-7ef0-41af-9ee4-6220a9556090" returned: 0 in 0.405s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:02 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] Lock "cinder-quobyte-5a4af6bf-7ef0-41af-9ee4-6220a9556090" released by "_delete_snapshot" :: held 2.241s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:11:02 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.753s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:02 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-a478ff66-f74e-4a5e-b26d-56537408051a tempest-AbsoluteLimitsTests-985592610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.861s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:02 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-a478ff66-f74e-4a5e-b26d-56537408051a tempest-AbsoluteLimitsTests-985592610 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:10:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1109740282',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=793efced-fade-4aeb-8b91-a0dd6250b46c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4d262a5b7fa441284e2a3d876323649',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:10:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:10:55Z,use_quota=True,user_id='1af254bdd0f448c28d8d6e0ea6eac22e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:11:02 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-a478ff66-f74e-4a5e-b26d-56537408051a tempest-AbsoluteLimitsTests-985592610 None] Creating volume 793efced-fade-4aeb-8b91-a0dd6250b46c {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:11:02 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-a478ff66-f74e-4a5e-b26d-56537408051a tempest-AbsoluteLimitsTests-985592610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:02 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-a478ff66-f74e-4a5e-b26d-56537408051a tempest-AbsoluteLimitsTests-985592610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:02 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-a478ff66-f74e-4a5e-b26d-56537408051a tempest-AbsoluteLimitsTests-985592610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:11:02 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-a478ff66-f74e-4a5e-b26d-56537408051a tempest-AbsoluteLimitsTests-985592610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:11:02 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-a478ff66-f74e-4a5e-b26d-56537408051a tempest-AbsoluteLimitsTests-985592610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:02 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-a478ff66-f74e-4a5e-b26d-56537408051a tempest-AbsoluteLimitsTests-985592610 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:11:02 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-a478ff66-f74e-4a5e-b26d-56537408051a tempest-AbsoluteLimitsTests-985592610 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:11:02 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-a478ff66-f74e-4a5e-b26d-56537408051a tempest-AbsoluteLimitsTests-985592610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-793efced-fade-4aeb-8b91-a0dd6250b46c 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:02 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9ad01ea-b0d1-4471-bda2-6d0fddc60ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-832a7e45-a324-4155-bdff-cd6beb63a86b', 'volume_size': 1, 'source_volid': 'b5f365c1-ad6d-49b9-9c37-78889ce516a2', 'source_volstatus': 'available'}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:02 devstack sudo[88141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-793efced-fade-4aeb-8b91-a0dd6250b46c 1073741824
Apr 15 20:11:02 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (622a9d40-0b50-4387-837c-377cd462709d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:02 devstack sudo[88141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:02 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] Volume volume-832a7e45-a324-4155-bdff-cd6beb63a86b (832a7e45-a324-4155-bdff-cd6beb63a86b): created successfully
Apr 15 20:11:02 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (622a9d40-0b50-4387-837c-377cd462709d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:02 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] Flow 'volume_create_manager' (667e6e93-6860-4432-8ddd-ad15dc314769) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:11:02 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-bb98bf37-3b42-442f-a25a-6dfbdc7dbaed tempest-VolumesGetTest-1188070236 None] Created volume successfully.
Apr 15 20:11:02 devstack sudo[88141]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:02 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-a478ff66-f74e-4a5e-b26d-56537408051a tempest-AbsoluteLimitsTests-985592610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-793efced-fade-4aeb-8b91-a0dd6250b46c 1073741824" returned: 0 in 0.787s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:03 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-a478ff66-f74e-4a5e-b26d-56537408051a tempest-AbsoluteLimitsTests-985592610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-793efced-fade-4aeb-8b91-a0dd6250b46c {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:03 devstack sudo[88146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-793efced-fade-4aeb-8b91-a0dd6250b46c
Apr 15 20:11:03 devstack sudo[88146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:03 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-edc6b23e-4a62-4a20-b46a-d5673ba04858 tempest-VolumesGetTest-1188070236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:11:03 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-edc6b23e-4a62-4a20-b46a-d5673ba04858 tempest-VolumesGetTest-1188070236 None] Flow 'volume_create_manager' (b79231c4-12f2-4436-9547-f8eabdf8c873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:11:03 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-edc6b23e-4a62-4a20-b46a-d5673ba04858 tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bd07b7f-295f-49a3-8f44-8d3eaaabd38e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:03 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-edc6b23e-4a62-4a20-b46a-d5673ba04858 tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bd07b7f-295f-49a3-8f44-8d3eaaabd38e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:11:03Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-902766986',display_name='tempest-VolumesGetTest-Volume-1216432991',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e85883c-c65b-4607-95cd-e4c85bc340bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fd52c85921a443d92f594a7f2280e9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:11:03Z,use_quota=True,user_id='d7a23dd5ade7439ca285e5922adb8785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:03 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-edc6b23e-4a62-4a20-b46a-d5673ba04858 tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e0b47b0-903c-44e3-a580-88176a85ac78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:03 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-edc6b23e-4a62-4a20-b46a-d5673ba04858 tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e0b47b0-903c-44e3-a580-88176a85ac78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:03 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-edc6b23e-4a62-4a20-b46a-d5673ba04858 tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (129e387d-f499-44fd-837c-c66fab880ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:03 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-edc6b23e-4a62-4a20-b46a-d5673ba04858 tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (129e387d-f499-44fd-837c-c66fab880ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e85883c-c65b-4607-95cd-e4c85bc340bf', 'volume_name': 'volume-9e85883c-c65b-4607-95cd-e4c85bc340bf', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:03 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-edc6b23e-4a62-4a20-b46a-d5673ba04858 tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26e101e5-7601-418f-b842-3cbc956eb5cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:03 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-edc6b23e-4a62-4a20-b46a-d5673ba04858 tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26e101e5-7601-418f-b842-3cbc956eb5cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:03 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-edc6b23e-4a62-4a20-b46a-d5673ba04858 tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41096df0-edd6-4017-b3ad-0e7aef3c8e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:03 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-edc6b23e-4a62-4a20-b46a-d5673ba04858 tempest-VolumesGetTest-1188070236 None] Volume 9e85883c-c65b-4607-95cd-e4c85bc340bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e85883c-c65b-4607-95cd-e4c85bc340bf', 'volume_size': 1}
Apr 15 20:11:03 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-edc6b23e-4a62-4a20-b46a-d5673ba04858 tempest-VolumesGetTest-1188070236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:03 devstack sudo[88146]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:03 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-a478ff66-f74e-4a5e-b26d-56537408051a tempest-AbsoluteLimitsTests-985592610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-793efced-fade-4aeb-8b91-a0dd6250b46c" returned: 0 in 0.482s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:03 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-a478ff66-f74e-4a5e-b26d-56537408051a tempest-AbsoluteLimitsTests-985592610 None] <== create_volume: return (1303ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:11:03 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-a478ff66-f74e-4a5e-b26d-56537408051a tempest-AbsoluteLimitsTests-985592610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.306s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:03 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-1216c156-8019-4fa5-a926-16cf9088a4ed tempest-VolumesActionsTest-1438461382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.892s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:03 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-1216c156-8019-4fa5-a926-16cf9088a4ed tempest-VolumesActionsTest-1438461382 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1174982250',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54ec3421-3658-4fa0-b60f-8c442007813d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df37bd8c7f7a4cea8e7e0beb744ae494',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:11:01Z,use_quota=True,user_id='51042bd29b7a4a579be7666e3269ba93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:11:03 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-1216c156-8019-4fa5-a926-16cf9088a4ed tempest-VolumesActionsTest-1438461382 None] Creating volume 54ec3421-3658-4fa0-b60f-8c442007813d {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:11:03 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-1216c156-8019-4fa5-a926-16cf9088a4ed tempest-VolumesActionsTest-1438461382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:03 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-1216c156-8019-4fa5-a926-16cf9088a4ed tempest-VolumesActionsTest-1438461382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:03 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-1216c156-8019-4fa5-a926-16cf9088a4ed tempest-VolumesActionsTest-1438461382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:11:03 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-1216c156-8019-4fa5-a926-16cf9088a4ed tempest-VolumesActionsTest-1438461382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:11:03 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-1216c156-8019-4fa5-a926-16cf9088a4ed tempest-VolumesActionsTest-1438461382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:03 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-1216c156-8019-4fa5-a926-16cf9088a4ed tempest-VolumesActionsTest-1438461382 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:11:03 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-1216c156-8019-4fa5-a926-16cf9088a4ed tempest-VolumesActionsTest-1438461382 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:11:03 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-1216c156-8019-4fa5-a926-16cf9088a4ed tempest-VolumesActionsTest-1438461382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-54ec3421-3658-4fa0-b60f-8c442007813d 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:03 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-a478ff66-f74e-4a5e-b26d-56537408051a tempest-AbsoluteLimitsTests-985592610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c846626-33c9-4ac6-916c-56a75f198f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-793efced-fade-4aeb-8b91-a0dd6250b46c', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:03 devstack sudo[88149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-54ec3421-3658-4fa0-b60f-8c442007813d 1073741824
Apr 15 20:11:03 devstack sudo[88149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:03 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-a478ff66-f74e-4a5e-b26d-56537408051a tempest-AbsoluteLimitsTests-985592610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b51a78f2-5b49-4a43-9635-33f51cbbf517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:03 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-a478ff66-f74e-4a5e-b26d-56537408051a tempest-AbsoluteLimitsTests-985592610 None] Volume volume-793efced-fade-4aeb-8b91-a0dd6250b46c (793efced-fade-4aeb-8b91-a0dd6250b46c): created successfully
Apr 15 20:11:03 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-a478ff66-f74e-4a5e-b26d-56537408051a tempest-AbsoluteLimitsTests-985592610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b51a78f2-5b49-4a43-9635-33f51cbbf517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:03 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-a478ff66-f74e-4a5e-b26d-56537408051a tempest-AbsoluteLimitsTests-985592610 None] Flow 'volume_create_manager' (a5096d86-4a66-41a5-afb0-826eff69c693) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:11:03 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-a478ff66-f74e-4a5e-b26d-56537408051a tempest-AbsoluteLimitsTests-985592610 None] Created volume successfully.
Apr 15 20:11:03 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-8066dc03-f333-476e-a3b6-12d73ec7f833 tempest-AbsoluteLimitsTests-985592610 None] Acquiring lock "cinder-793efced-fade-4aeb-8b91-a0dd6250b46c-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:11:03 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-8066dc03-f333-476e-a3b6-12d73ec7f833 tempest-AbsoluteLimitsTests-985592610 None] Lock "cinder-793efced-fade-4aeb-8b91-a0dd6250b46c-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:11:03 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-8066dc03-f333-476e-a3b6-12d73ec7f833 tempest-AbsoluteLimitsTests-985592610 None] Acquiring lock "cinder-quobyte-793efced-fade-4aeb-8b91-a0dd6250b46c" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:11:03 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-8066dc03-f333-476e-a3b6-12d73ec7f833 tempest-AbsoluteLimitsTests-985592610 None] Lock "cinder-quobyte-793efced-fade-4aeb-8b91-a0dd6250b46c" acquired by "delete_volume" :: waited 0.014s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:11:04 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[1695d8f6-8d30-41cd-84fd-57f0280f6c3e]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:11:04 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-8066dc03-f333-476e-a3b6-12d73ec7f833 tempest-AbsoluteLimitsTests-985592610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-793efced-fade-4aeb-8b91-a0dd6250b46c {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:04 devstack sudo[88154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-793efced-fade-4aeb-8b91-a0dd6250b46c
Apr 15 20:11:04 devstack sudo[88154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:04 devstack sudo[88149]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:04 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-1216c156-8019-4fa5-a926-16cf9088a4ed tempest-VolumesActionsTest-1438461382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-54ec3421-3658-4fa0-b60f-8c442007813d 1073741824" returned: 0 in 0.621s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:04 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-1216c156-8019-4fa5-a926-16cf9088a4ed tempest-VolumesActionsTest-1438461382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-54ec3421-3658-4fa0-b60f-8c442007813d {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:04 devstack sudo[88156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-54ec3421-3658-4fa0-b60f-8c442007813d
Apr 15 20:11:04 devstack sudo[88156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:04 devstack sudo[88154]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:04 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-8066dc03-f333-476e-a3b6-12d73ec7f833 tempest-AbsoluteLimitsTests-985592610 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-793efced-fade-4aeb-8b91-a0dd6250b46c" returned: 0 in 0.477s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:04 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-8066dc03-f333-476e-a3b6-12d73ec7f833 tempest-AbsoluteLimitsTests-985592610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-793efced-fade-4aeb-8b91-a0dd6250b46c {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:04 devstack sudo[88162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-793efced-fade-4aeb-8b91-a0dd6250b46c
Apr 15 20:11:04 devstack sudo[88162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:04 devstack sudo[88156]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:04 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-1216c156-8019-4fa5-a926-16cf9088a4ed tempest-VolumesActionsTest-1438461382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-54ec3421-3658-4fa0-b60f-8c442007813d" returned: 0 in 0.405s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:04 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-1216c156-8019-4fa5-a926-16cf9088a4ed tempest-VolumesActionsTest-1438461382 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:11:04 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-1216c156-8019-4fa5-a926-16cf9088a4ed tempest-VolumesActionsTest-1438461382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:04 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-707dcc4e-2f98-4d7f-b3bd-39194721c666 tempest-VolumeDependencyTests-693181165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.869s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:04 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-707dcc4e-2f98-4d7f-b3bd-39194721c666 tempest-VolumeDependencyTests-693181165 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-100117820',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc1243bb-baf5-4d69-b2a0-d945e1733c58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9003f754c2ca4640a792c44fe89d47cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:11:02Z,use_quota=True,user_id='18ac03d032214d0c8ed2876217eaad94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:11:04 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-707dcc4e-2f98-4d7f-b3bd-39194721c666 tempest-VolumeDependencyTests-693181165 None] Creating volume dc1243bb-baf5-4d69-b2a0-d945e1733c58 {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:11:04 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-707dcc4e-2f98-4d7f-b3bd-39194721c666 tempest-VolumeDependencyTests-693181165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:04 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-707dcc4e-2f98-4d7f-b3bd-39194721c666 tempest-VolumeDependencyTests-693181165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:04 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-707dcc4e-2f98-4d7f-b3bd-39194721c666 tempest-VolumeDependencyTests-693181165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:11:04 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-707dcc4e-2f98-4d7f-b3bd-39194721c666 tempest-VolumeDependencyTests-693181165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:11:04 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-707dcc4e-2f98-4d7f-b3bd-39194721c666 tempest-VolumeDependencyTests-693181165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:04 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-707dcc4e-2f98-4d7f-b3bd-39194721c666 tempest-VolumeDependencyTests-693181165 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:11:04 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-707dcc4e-2f98-4d7f-b3bd-39194721c666 tempest-VolumeDependencyTests-693181165 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:11:04 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-707dcc4e-2f98-4d7f-b3bd-39194721c666 tempest-VolumeDependencyTests-693181165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:04 devstack sudo[88164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58 1073741824
Apr 15 20:11:04 devstack sudo[88164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:04 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-1216c156-8019-4fa5-a926-16cf9088a4ed tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83a99dd8-4f61-4d29-9587-b4b6d366a7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54ec3421-3658-4fa0-b60f-8c442007813d', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:04 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-1216c156-8019-4fa5-a926-16cf9088a4ed tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5860ccd-22ff-49c4-80e4-7df8756dbeea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:04 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-1216c156-8019-4fa5-a926-16cf9088a4ed tempest-VolumesActionsTest-1438461382 None] Volume volume-54ec3421-3658-4fa0-b60f-8c442007813d (54ec3421-3658-4fa0-b60f-8c442007813d): created successfully
Apr 15 20:11:04 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-1216c156-8019-4fa5-a926-16cf9088a4ed tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5860ccd-22ff-49c4-80e4-7df8756dbeea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:04 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-1216c156-8019-4fa5-a926-16cf9088a4ed tempest-VolumesActionsTest-1438461382 None] Flow 'volume_create_manager' (0c93dab2-9c3d-46fd-a2a4-7a0074550523) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:11:04 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-1216c156-8019-4fa5-a926-16cf9088a4ed tempest-VolumesActionsTest-1438461382 None] Created volume successfully.
Apr 15 20:11:04 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-f8ec22f1-364b-4b6f-8018-364df8c51b53 tempest-VolumesActionsTest-1438461382 None] Acquiring lock "cinder-54ec3421-3658-4fa0-b60f-8c442007813d" by "attach_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:11:04 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-f8ec22f1-364b-4b6f-8018-364df8c51b53 tempest-VolumesActionsTest-1438461382 None] Lock "cinder-54ec3421-3658-4fa0-b60f-8c442007813d" acquired by "attach_volume" :: waited 0.022s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:11:04 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-f8ec22f1-364b-4b6f-8018-364df8c51b53 tempest-VolumesActionsTest-1438461382 None] Attaching volume 54ec3421-3658-4fa0-b60f-8c442007813d to instance 2e0cc1d0-fc9f-442d-ae25-743310f061c7 at mountpoint /dev/vdb on host None.
Apr 15 20:11:04 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-f8ec22f1-364b-4b6f-8018-364df8c51b53 tempest-VolumesActionsTest-1438461382 None] Attach volume completed successfully.
Apr 15 20:11:04 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-f8ec22f1-364b-4b6f-8018-364df8c51b53 tempest-VolumesActionsTest-1438461382 None] Lock "cinder-54ec3421-3658-4fa0-b60f-8c442007813d" released by "attach_volume" :: held 0.055s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:11:05 devstack sudo[88162]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:05 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-8066dc03-f333-476e-a3b6-12d73ec7f833 tempest-AbsoluteLimitsTests-985592610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-793efced-fade-4aeb-8b91-a0dd6250b46c" returned: 0 in 0.507s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:05 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-8066dc03-f333-476e-a3b6-12d73ec7f833 tempest-AbsoluteLimitsTests-985592610 None] Lock "cinder-quobyte-793efced-fade-4aeb-8b91-a0dd6250b46c" released by "delete_volume" :: held 1.017s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:11:05 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-8066dc03-f333-476e-a3b6-12d73ec7f833 tempest-AbsoluteLimitsTests-985592610 None] Created reservations ['01cfb3bf-f906-49a8-bc8c-c1a827647b54', '94acc2f9-2d8f-40df-8d65-0915c4611735', 'b12e4a9e-d092-4ebc-a8de-145e3b0dbcc4', 'f0ca4b9d-b780-4bc0-9eb8-811c7e898cb5'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:11:05 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-8066dc03-f333-476e-a3b6-12d73ec7f833 tempest-AbsoluteLimitsTests-985592610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:05 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-8066dc03-f333-476e-a3b6-12d73ec7f833 tempest-AbsoluteLimitsTests-985592610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:05 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-8066dc03-f333-476e-a3b6-12d73ec7f833 tempest-AbsoluteLimitsTests-985592610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:11:05 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-8066dc03-f333-476e-a3b6-12d73ec7f833 tempest-AbsoluteLimitsTests-985592610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:11:05 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-8066dc03-f333-476e-a3b6-12d73ec7f833 tempest-AbsoluteLimitsTests-985592610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:05 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-8066dc03-f333-476e-a3b6-12d73ec7f833 tempest-AbsoluteLimitsTests-985592610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:05 devstack sudo[88164]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:05 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-707dcc4e-2f98-4d7f-b3bd-39194721c666 tempest-VolumeDependencyTests-693181165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58 1073741824" returned: 0 in 0.545s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:05 devstack sudo[88170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:11:05 devstack sudo[88170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:05 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-707dcc4e-2f98-4d7f-b3bd-39194721c666 tempest-VolumeDependencyTests-693181165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:05 devstack sudo[88172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58
Apr 15 20:11:05 devstack sudo[88172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:05 devstack sudo[88170]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:05 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-8066dc03-f333-476e-a3b6-12d73ec7f833 tempest-AbsoluteLimitsTests-985592610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.447s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:05 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-8066dc03-f333-476e-a3b6-12d73ec7f833 tempest-AbsoluteLimitsTests-985592610 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:11:05 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-8066dc03-f333-476e-a3b6-12d73ec7f833 tempest-AbsoluteLimitsTests-985592610 None] Deleted volume successfully.
Apr 15 20:11:05 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-8066dc03-f333-476e-a3b6-12d73ec7f833 tempest-AbsoluteLimitsTests-985592610 None] Lock "cinder-793efced-fade-4aeb-8b91-a0dd6250b46c-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:11:05 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-2c7ca09f-20e9-46e3-910f-973868515129 tempest-VolumesActionsTest-2098528605 None] Terminate volume connection completed successfully.
Apr 15 20:11:05 devstack sudo[88172]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:05 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-707dcc4e-2f98-4d7f-b3bd-39194721c666 tempest-VolumeDependencyTests-693181165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58" returned: 0 in 0.515s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:05 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-707dcc4e-2f98-4d7f-b3bd-39194721c666 tempest-VolumeDependencyTests-693181165 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:11:05 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-707dcc4e-2f98-4d7f-b3bd-39194721c666 tempest-VolumeDependencyTests-693181165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:05 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-edc6b23e-4a62-4a20-b46a-d5673ba04858 tempest-VolumesGetTest-1188070236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.437s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:05 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-edc6b23e-4a62-4a20-b46a-d5673ba04858 tempest-VolumesGetTest-1188070236 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:11:03Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-902766986',display_name='tempest-VolumesGetTest-Volume-1216432991',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e85883c-c65b-4607-95cd-e4c85bc340bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fd52c85921a443d92f594a7f2280e9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:11:03Z,use_quota=True,user_id='d7a23dd5ade7439ca285e5922adb8785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:11:05 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-edc6b23e-4a62-4a20-b46a-d5673ba04858 tempest-VolumesGetTest-1188070236 None] Creating volume 9e85883c-c65b-4607-95cd-e4c85bc340bf {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:11:05 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-edc6b23e-4a62-4a20-b46a-d5673ba04858 tempest-VolumesGetTest-1188070236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:05 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-edc6b23e-4a62-4a20-b46a-d5673ba04858 tempest-VolumesGetTest-1188070236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:05 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-edc6b23e-4a62-4a20-b46a-d5673ba04858 tempest-VolumesGetTest-1188070236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:11:05 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-edc6b23e-4a62-4a20-b46a-d5673ba04858 tempest-VolumesGetTest-1188070236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:11:05 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-edc6b23e-4a62-4a20-b46a-d5673ba04858 tempest-VolumesGetTest-1188070236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:05 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-edc6b23e-4a62-4a20-b46a-d5673ba04858 tempest-VolumesGetTest-1188070236 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:11:05 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-edc6b23e-4a62-4a20-b46a-d5673ba04858 tempest-VolumesGetTest-1188070236 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:11:05 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-edc6b23e-4a62-4a20-b46a-d5673ba04858 tempest-VolumesGetTest-1188070236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9e85883c-c65b-4607-95cd-e4c85bc340bf 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:05 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-707dcc4e-2f98-4d7f-b3bd-39194721c666 tempest-VolumeDependencyTests-693181165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3045f95-0e96-4997-b6b2-70a5fd9b1143) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:05 devstack sudo[88176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9e85883c-c65b-4607-95cd-e4c85bc340bf 1073741824
Apr 15 20:11:05 devstack sudo[88176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:05 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-707dcc4e-2f98-4d7f-b3bd-39194721c666 tempest-VolumeDependencyTests-693181165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2212c8ce-62ae-4862-a9f3-0e1015757c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:05 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-707dcc4e-2f98-4d7f-b3bd-39194721c666 tempest-VolumeDependencyTests-693181165 None] Volume volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58 (dc1243bb-baf5-4d69-b2a0-d945e1733c58): created successfully
Apr 15 20:11:05 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-707dcc4e-2f98-4d7f-b3bd-39194721c666 tempest-VolumeDependencyTests-693181165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2212c8ce-62ae-4862-a9f3-0e1015757c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:05 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-707dcc4e-2f98-4d7f-b3bd-39194721c666 tempest-VolumeDependencyTests-693181165 None] Flow 'volume_create_manager' (b9d50f39-a2a1-4f64-8840-3b2103e2ff73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:11:05 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-707dcc4e-2f98-4d7f-b3bd-39194721c666 tempest-VolumeDependencyTests-693181165 None] Created volume successfully.
Apr 15 20:11:05 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-81cd494f-9296-4c5d-85da-5d8d674d569f tempest-VolumeDependencyTests-693181165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:06 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-2c7ca09f-20e9-46e3-910f-973868515129 tempest-VolumesActionsTest-2098528605 None] Acquiring lock "cinder-54ec3421-3658-4fa0-b60f-8c442007813d-detach_volume" by "detach_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:11:06 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-2c7ca09f-20e9-46e3-910f-973868515129 tempest-VolumesActionsTest-2098528605 None] Lock "cinder-54ec3421-3658-4fa0-b60f-8c442007813d-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:11:06 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-2c7ca09f-20e9-46e3-910f-973868515129 tempest-VolumesActionsTest-2098528605 None] Detaching volume 54ec3421-3658-4fa0-b60f-8c442007813d from instance 2e0cc1d0-fc9f-442d-ae25-743310f061c7.
Apr 15 20:11:06 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-2c7ca09f-20e9-46e3-910f-973868515129 tempest-VolumesActionsTest-2098528605 None] Detach volume completed successfully.
Apr 15 20:11:06 devstack sudo[88176]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:06 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-2c7ca09f-20e9-46e3-910f-973868515129 tempest-VolumesActionsTest-2098528605 None] Lock "cinder-54ec3421-3658-4fa0-b60f-8c442007813d-detach_volume" released by "detach_volume" :: held 0.065s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:11:06 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-edc6b23e-4a62-4a20-b46a-d5673ba04858 tempest-VolumesGetTest-1188070236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9e85883c-c65b-4607-95cd-e4c85bc340bf 1073741824" returned: 0 in 0.531s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:06 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-edc6b23e-4a62-4a20-b46a-d5673ba04858 tempest-VolumesGetTest-1188070236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9e85883c-c65b-4607-95cd-e4c85bc340bf {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:06 devstack sudo[88182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9e85883c-c65b-4607-95cd-e4c85bc340bf
Apr 15 20:11:06 devstack sudo[88182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:06 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-c8eaed14-f2bf-40c0-8260-71bbb3bdf479 tempest-VolumesActionsTest-1438461382 None] Acquiring lock "cinder-54ec3421-3658-4fa0-b60f-8c442007813d-detach_volume" by "detach_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:11:06 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-c8eaed14-f2bf-40c0-8260-71bbb3bdf479 tempest-VolumesActionsTest-1438461382 None] Lock "cinder-54ec3421-3658-4fa0-b60f-8c442007813d-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:11:06 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-c8eaed14-f2bf-40c0-8260-71bbb3bdf479 tempest-VolumesActionsTest-1438461382 None] Volume detach called, but volume not attached.
Apr 15 20:11:06 devstack sudo[88182]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:06 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-c8eaed14-f2bf-40c0-8260-71bbb3bdf479 tempest-VolumesActionsTest-1438461382 None] Lock "cinder-54ec3421-3658-4fa0-b60f-8c442007813d-detach_volume" released by "detach_volume" :: held 0.021s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:11:06 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-edc6b23e-4a62-4a20-b46a-d5673ba04858 tempest-VolumesGetTest-1188070236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9e85883c-c65b-4607-95cd-e4c85bc340bf" returned: 0 in 0.560s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:06 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-edc6b23e-4a62-4a20-b46a-d5673ba04858 tempest-VolumesGetTest-1188070236 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:11:06 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-edc6b23e-4a62-4a20-b46a-d5673ba04858 tempest-VolumesGetTest-1188070236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:06 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-81cd494f-9296-4c5d-85da-5d8d674d569f tempest-VolumeDependencyTests-693181165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.878s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:06 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-edc6b23e-4a62-4a20-b46a-d5673ba04858 tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41096df0-edd6-4017-b3ad-0e7aef3c8e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e85883c-c65b-4607-95cd-e4c85bc340bf', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:06 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-edc6b23e-4a62-4a20-b46a-d5673ba04858 tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59617a81-cab3-4239-bc67-5e8dba13b4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:06 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-81cd494f-9296-4c5d-85da-5d8d674d569f tempest-VolumeDependencyTests-693181165 None] Creating offline snapshot f08a2594-bca8-44ac-aa07-2fee36c04603 of volume dc1243bb-baf5-4d69-b2a0-d945e1733c58 {{(pid=82646) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 20:11:06 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-edc6b23e-4a62-4a20-b46a-d5673ba04858 tempest-VolumesGetTest-1188070236 None] Volume volume-9e85883c-c65b-4607-95cd-e4c85bc340bf (9e85883c-c65b-4607-95cd-e4c85bc340bf): created successfully
Apr 15 20:11:06 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-edc6b23e-4a62-4a20-b46a-d5673ba04858 tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59617a81-cab3-4239-bc67-5e8dba13b4f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:06 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-edc6b23e-4a62-4a20-b46a-d5673ba04858 tempest-VolumesGetTest-1188070236 None] Flow 'volume_create_manager' (b79231c4-12f2-4436-9547-f8eabdf8c873) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:11:06 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3cc7d89-2057-4dfa-b17e-101317b841e6]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:11:06 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-81cd494f-9296-4c5d-85da-5d8d674d569f tempest-VolumeDependencyTests-693181165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:06 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-edc6b23e-4a62-4a20-b46a-d5673ba04858 tempest-VolumesGetTest-1188070236 None] Created volume successfully.
Apr 15 20:11:06 devstack sudo[88185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58
Apr 15 20:11:06 devstack sudo[88185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:07 devstack sudo[88185]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:07 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-81cd494f-9296-4c5d-85da-5d8d674d569f tempest-VolumeDependencyTests-693181165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58" returned: 0 in 0.604s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:07 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-81cd494f-9296-4c5d-85da-5d8d674d569f tempest-VolumeDependencyTests-693181165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58.f08a2594-bca8-44ac-aa07-2fee36c04603 1G {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:07 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-7d9ced4b-af2e-4957-94fb-08baed476536 tempest-VolumesActionsTest-1438461382 None] Acquiring lock "cinder-54ec3421-3658-4fa0-b60f-8c442007813d-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:11:07 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-7d9ced4b-af2e-4957-94fb-08baed476536 tempest-VolumesActionsTest-1438461382 None] Lock "cinder-54ec3421-3658-4fa0-b60f-8c442007813d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:11:07 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-985a40d2-60d2-4fe6-8141-9de13fc6e2f3 tempest-VolumesGetTest-1188070236 None] Acquiring lock "cinder-9e85883c-c65b-4607-95cd-e4c85bc340bf-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:11:07 devstack sudo[88190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58.f08a2594-bca8-44ac-aa07-2fee36c04603 1G
Apr 15 20:11:07 devstack sudo[88190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:07 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-7d9ced4b-af2e-4957-94fb-08baed476536 tempest-VolumesActionsTest-1438461382 None] Acquiring lock "cinder-quobyte-54ec3421-3658-4fa0-b60f-8c442007813d" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:11:07 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-985a40d2-60d2-4fe6-8141-9de13fc6e2f3 tempest-VolumesGetTest-1188070236 None] Lock "cinder-9e85883c-c65b-4607-95cd-e4c85bc340bf-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:11:07 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-7d9ced4b-af2e-4957-94fb-08baed476536 tempest-VolumesActionsTest-1438461382 None] Lock "cinder-quobyte-54ec3421-3658-4fa0-b60f-8c442007813d" acquired by "delete_volume" :: waited 0.030s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:11:07 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[30daeea0-c746-44ca-a505-351c6166dd03]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:11:07 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-7d9ced4b-af2e-4957-94fb-08baed476536 tempest-VolumesActionsTest-1438461382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-54ec3421-3658-4fa0-b60f-8c442007813d {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:07 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-985a40d2-60d2-4fe6-8141-9de13fc6e2f3 tempest-VolumesGetTest-1188070236 None] Acquiring lock "cinder-quobyte-9e85883c-c65b-4607-95cd-e4c85bc340bf" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:11:07 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-985a40d2-60d2-4fe6-8141-9de13fc6e2f3 tempest-VolumesGetTest-1188070236 None] Lock "cinder-quobyte-9e85883c-c65b-4607-95cd-e4c85bc340bf" acquired by "delete_volume" :: waited 0.014s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:11:07 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[f651fb84-a724-4218-a5b0-143ef2b481e7]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:11:07 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-985a40d2-60d2-4fe6-8141-9de13fc6e2f3 tempest-VolumesGetTest-1188070236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9e85883c-c65b-4607-95cd-e4c85bc340bf {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:07 devstack sudo[88193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9e85883c-c65b-4607-95cd-e4c85bc340bf
Apr 15 20:11:07 devstack sudo[88193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:07 devstack sudo[88192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-54ec3421-3658-4fa0-b60f-8c442007813d
Apr 15 20:11:07 devstack sudo[88192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:08 devstack sudo[88190]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:08 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-81cd494f-9296-4c5d-85da-5d8d674d569f tempest-VolumeDependencyTests-693181165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58.f08a2594-bca8-44ac-aa07-2fee36c04603 1G" returned: 0 in 0.795s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:08 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-81cd494f-9296-4c5d-85da-5d8d674d569f tempest-VolumeDependencyTests-693181165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58 -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58.f08a2594-bca8-44ac-aa07-2fee36c04603 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:08 devstack sudo[88202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58 -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58.f08a2594-bca8-44ac-aa07-2fee36c04603
Apr 15 20:11:08 devstack sudo[88202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:08 devstack sudo[88193]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:08 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-985a40d2-60d2-4fe6-8141-9de13fc6e2f3 tempest-VolumesGetTest-1188070236 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9e85883c-c65b-4607-95cd-e4c85bc340bf" returned: 0 in 0.598s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:08 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-985a40d2-60d2-4fe6-8141-9de13fc6e2f3 tempest-VolumesGetTest-1188070236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9e85883c-c65b-4607-95cd-e4c85bc340bf {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:08 devstack sudo[88204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9e85883c-c65b-4607-95cd-e4c85bc340bf
Apr 15 20:11:08 devstack sudo[88204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:08 devstack sudo[88192]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:08 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-7d9ced4b-af2e-4957-94fb-08baed476536 tempest-VolumesActionsTest-1438461382 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-54ec3421-3658-4fa0-b60f-8c442007813d" returned: 0 in 0.789s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:08 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-7d9ced4b-af2e-4957-94fb-08baed476536 tempest-VolumesActionsTest-1438461382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-54ec3421-3658-4fa0-b60f-8c442007813d {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:08 devstack sudo[88209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-54ec3421-3658-4fa0-b60f-8c442007813d
Apr 15 20:11:08 devstack sudo[88209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:08 devstack sudo[88202]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:08 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-81cd494f-9296-4c5d-85da-5d8d674d569f tempest-VolumeDependencyTests-693181165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58 -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58.f08a2594-bca8-44ac-aa07-2fee36c04603" returned: 0 in 0.575s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:08 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-81cd494f-9296-4c5d-85da-5d8d674d569f tempest-VolumeDependencyTests-693181165 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58.f08a2594-bca8-44ac-aa07-2fee36c04603 is being set with open permissions: ugo+rw
Apr 15 20:11:08 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-81cd494f-9296-4c5d-85da-5d8d674d569f tempest-VolumeDependencyTests-693181165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58.f08a2594-bca8-44ac-aa07-2fee36c04603 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:08 devstack sudo[88214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58.f08a2594-bca8-44ac-aa07-2fee36c04603
Apr 15 20:11:08 devstack sudo[88214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:08 devstack sudo[88209]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:08 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-7d9ced4b-af2e-4957-94fb-08baed476536 tempest-VolumesActionsTest-1438461382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-54ec3421-3658-4fa0-b60f-8c442007813d" returned: 0 in 0.586s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:08 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-7d9ced4b-af2e-4957-94fb-08baed476536 tempest-VolumesActionsTest-1438461382 None] Lock "cinder-quobyte-54ec3421-3658-4fa0-b60f-8c442007813d" released by "delete_volume" :: held 1.412s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:11:09 devstack sudo[88204]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-985a40d2-60d2-4fe6-8141-9de13fc6e2f3 tempest-VolumesGetTest-1188070236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9e85883c-c65b-4607-95cd-e4c85bc340bf" returned: 0 in 0.768s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:09 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-985a40d2-60d2-4fe6-8141-9de13fc6e2f3 tempest-VolumesGetTest-1188070236 None] Lock "cinder-quobyte-9e85883c-c65b-4607-95cd-e4c85bc340bf" released by "delete_volume" :: held 1.395s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:11:09 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-7d9ced4b-af2e-4957-94fb-08baed476536 tempest-VolumesActionsTest-1438461382 None] Created reservations ['1c235e29-74b8-4e26-b713-ab35fe21ac29', 'fa514657-7df9-4782-8ad7-8a51ddcd5a43', '9f27e54a-cdc6-45f3-b6fa-0cf3f96e718f', '56a4bb9e-ba2e-4381-a463-a9bc8f114ce3'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:11:09 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-985a40d2-60d2-4fe6-8141-9de13fc6e2f3 tempest-VolumesGetTest-1188070236 None] Created reservations ['dea6eb90-afe9-4a22-882c-0b9078836a54', '96118ced-531a-4e8a-a39f-f901512eaef6', '5a58ca8f-cedf-4c0e-a404-81547da845b4', '4ed4cea3-23d4-4ab7-8960-f04df7090ce0'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:11:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-985a40d2-60d2-4fe6-8141-9de13fc6e2f3 tempest-VolumesGetTest-1188070236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-985a40d2-60d2-4fe6-8141-9de13fc6e2f3 tempest-VolumesGetTest-1188070236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:09 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-985a40d2-60d2-4fe6-8141-9de13fc6e2f3 tempest-VolumesGetTest-1188070236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:11:09 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-985a40d2-60d2-4fe6-8141-9de13fc6e2f3 tempest-VolumesGetTest-1188070236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:11:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-985a40d2-60d2-4fe6-8141-9de13fc6e2f3 tempest-VolumesGetTest-1188070236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-985a40d2-60d2-4fe6-8141-9de13fc6e2f3 tempest-VolumesGetTest-1188070236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:09 devstack sudo[88218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:11:09 devstack sudo[88218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-7d9ced4b-af2e-4957-94fb-08baed476536 tempest-VolumesActionsTest-1438461382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-7d9ced4b-af2e-4957-94fb-08baed476536 tempest-VolumesActionsTest-1438461382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:09 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-7d9ced4b-af2e-4957-94fb-08baed476536 tempest-VolumesActionsTest-1438461382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:11:09 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-7d9ced4b-af2e-4957-94fb-08baed476536 tempest-VolumesActionsTest-1438461382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:11:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-7d9ced4b-af2e-4957-94fb-08baed476536 tempest-VolumesActionsTest-1438461382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-7d9ced4b-af2e-4957-94fb-08baed476536 tempest-VolumesActionsTest-1438461382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:09 devstack sudo[88220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:11:09 devstack sudo[88220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:09 devstack sudo[88214]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-81cd494f-9296-4c5d-85da-5d8d674d569f tempest-VolumeDependencyTests-693181165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58.f08a2594-bca8-44ac-aa07-2fee36c04603" returned: 0 in 0.626s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-81cd494f-9296-4c5d-85da-5d8d674d569f tempest-VolumeDependencyTests-693181165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58.info {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:09 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-555d8e0f-8320-4cc6-8245-c40b47d60f20 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:11:09 devstack sudo[88223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58.info
Apr 15 20:11:09 devstack sudo[88223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:09 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-555d8e0f-8320-4cc6-8245-c40b47d60f20 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Flow 'volume_create_manager' (ea035622-cff1-4f72-83be-0c4c7b94dae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:11:09 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-555d8e0f-8320-4cc6-8245-c40b47d60f20 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca74e1be-7467-44cc-98ec-aab19642bd40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:09 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-555d8e0f-8320-4cc6-8245-c40b47d60f20 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca74e1be-7467-44cc-98ec-aab19642bd40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:11:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1098971160',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11f29364-3b0f-4e2a-be26-53a43b66e9e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eebe9fc76d38432d93ee1792de21d1d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:11:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:11:09Z,use_quota=True,user_id='d6eb8d03b80141129e3905dedb67c44d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:09 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-555d8e0f-8320-4cc6-8245-c40b47d60f20 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24e9c163-8e6a-46bf-a343-1455850baf88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:09 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-555d8e0f-8320-4cc6-8245-c40b47d60f20 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24e9c163-8e6a-46bf-a343-1455850baf88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:09 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-555d8e0f-8320-4cc6-8245-c40b47d60f20 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d8b2d7b-41a1-403f-9f1b-9131e1f1de1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:09 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-555d8e0f-8320-4cc6-8245-c40b47d60f20 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d8b2d7b-41a1-403f-9f1b-9131e1f1de1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11f29364-3b0f-4e2a-be26-53a43b66e9e7', 'volume_name': 'volume-11f29364-3b0f-4e2a-be26-53a43b66e9e7', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:09 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-555d8e0f-8320-4cc6-8245-c40b47d60f20 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (199b91e9-e618-418b-9a36-5ec0a819be41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:09 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-555d8e0f-8320-4cc6-8245-c40b47d60f20 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (199b91e9-e618-418b-9a36-5ec0a819be41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:09 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-555d8e0f-8320-4cc6-8245-c40b47d60f20 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37af72f6-b9c8-4d7f-842b-a0c33d4a6210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:09 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-555d8e0f-8320-4cc6-8245-c40b47d60f20 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Volume 11f29364-3b0f-4e2a-be26-53a43b66e9e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11f29364-3b0f-4e2a-be26-53a43b66e9e7', 'volume_size': 1}
Apr 15 20:11:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-555d8e0f-8320-4cc6-8245-c40b47d60f20 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:09 devstack sudo[88220]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-7d9ced4b-af2e-4957-94fb-08baed476536 tempest-VolumesActionsTest-1438461382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.535s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:09 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-7d9ced4b-af2e-4957-94fb-08baed476536 tempest-VolumesActionsTest-1438461382 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:11:09 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-7d9ced4b-af2e-4957-94fb-08baed476536 tempest-VolumesActionsTest-1438461382 None] Deleted volume successfully.
Apr 15 20:11:09 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-7d9ced4b-af2e-4957-94fb-08baed476536 tempest-VolumesActionsTest-1438461382 None] Lock "cinder-54ec3421-3658-4fa0-b60f-8c442007813d-delete_volume" released by "delete_volume" :: held 2.255s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:11:09 devstack sudo[88218]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-985a40d2-60d2-4fe6-8141-9de13fc6e2f3 tempest-VolumesGetTest-1188070236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.703s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:09 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-985a40d2-60d2-4fe6-8141-9de13fc6e2f3 tempest-VolumesGetTest-1188070236 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:11:09 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-985a40d2-60d2-4fe6-8141-9de13fc6e2f3 tempest-VolumesGetTest-1188070236 None] Deleted volume successfully.
Apr 15 20:11:09 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-985a40d2-60d2-4fe6-8141-9de13fc6e2f3 tempest-VolumesGetTest-1188070236 None] Lock "cinder-9e85883c-c65b-4607-95cd-e4c85bc340bf-delete_volume" released by "delete_volume" :: held 2.282s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:11:09 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-f4b39c0c-9a05-4d74-b7e9-d080ad096aa2 tempest-VolumesGetTest-1188070236 None] Acquiring lock "cinder-832a7e45-a324-4155-bdff-cd6beb63a86b-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:11:09 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-f4b39c0c-9a05-4d74-b7e9-d080ad096aa2 tempest-VolumesGetTest-1188070236 None] Lock "cinder-832a7e45-a324-4155-bdff-cd6beb63a86b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:11:09 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-f4b39c0c-9a05-4d74-b7e9-d080ad096aa2 tempest-VolumesGetTest-1188070236 None] Acquiring lock "cinder-quobyte-832a7e45-a324-4155-bdff-cd6beb63a86b" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:11:09 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-f4b39c0c-9a05-4d74-b7e9-d080ad096aa2 tempest-VolumesGetTest-1188070236 None] Lock "cinder-quobyte-832a7e45-a324-4155-bdff-cd6beb63a86b" acquired by "delete_volume" :: waited 0.019s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:11:09 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee0d156-7cfc-4d0d-9f3b-7b85aa9dc3e5]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:11:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-f4b39c0c-9a05-4d74-b7e9-d080ad096aa2 tempest-VolumesGetTest-1188070236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-832a7e45-a324-4155-bdff-cd6beb63a86b {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:10 devstack sudo[88228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-832a7e45-a324-4155-bdff-cd6beb63a86b
Apr 15 20:11:10 devstack sudo[88228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:10 devstack sudo[88223]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:10 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-81cd494f-9296-4c5d-85da-5d8d674d569f tempest-VolumeDependencyTests-693181165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58.info" returned: 0 in 0.721s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:10 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-81cd494f-9296-4c5d-85da-5d8d674d569f tempest-VolumeDependencyTests-693181165 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58.info is being set with open permissions: ugo+rw
Apr 15 20:11:10 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-81cd494f-9296-4c5d-85da-5d8d674d569f tempest-VolumeDependencyTests-693181165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58.info {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:10 devstack sudo[88231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58.info
Apr 15 20:11:10 devstack sudo[88231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:10 devstack sudo[88228]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:10 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-f4b39c0c-9a05-4d74-b7e9-d080ad096aa2 tempest-VolumesGetTest-1188070236 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-832a7e45-a324-4155-bdff-cd6beb63a86b" returned: 0 in 0.540s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:10 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-f4b39c0c-9a05-4d74-b7e9-d080ad096aa2 tempest-VolumesGetTest-1188070236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-832a7e45-a324-4155-bdff-cd6beb63a86b {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:10 devstack sudo[88236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-832a7e45-a324-4155-bdff-cd6beb63a86b
Apr 15 20:11:10 devstack sudo[88236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:10 devstack sudo[88231]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:10 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-81cd494f-9296-4c5d-85da-5d8d674d569f tempest-VolumeDependencyTests-693181165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58.info" returned: 0 in 0.431s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:10 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-81cd494f-9296-4c5d-85da-5d8d674d569f tempest-VolumeDependencyTests-693181165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.845s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:10 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-555d8e0f-8320-4cc6-8245-c40b47d60f20 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.012s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:10 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-555d8e0f-8320-4cc6-8245-c40b47d60f20 tempest-CreateVolumesFromSnapshotTest-2121410921 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:11:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1098971160',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11f29364-3b0f-4e2a-be26-53a43b66e9e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eebe9fc76d38432d93ee1792de21d1d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:11:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:11:09Z,use_quota=True,user_id='d6eb8d03b80141129e3905dedb67c44d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:11:10 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-555d8e0f-8320-4cc6-8245-c40b47d60f20 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Creating volume 11f29364-3b0f-4e2a-be26-53a43b66e9e7 {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:11:10 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-555d8e0f-8320-4cc6-8245-c40b47d60f20 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:10 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-555d8e0f-8320-4cc6-8245-c40b47d60f20 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:10 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-555d8e0f-8320-4cc6-8245-c40b47d60f20 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:11:10 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-555d8e0f-8320-4cc6-8245-c40b47d60f20 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:11:10 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-555d8e0f-8320-4cc6-8245-c40b47d60f20 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:10 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-555d8e0f-8320-4cc6-8245-c40b47d60f20 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:11:10 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-555d8e0f-8320-4cc6-8245-c40b47d60f20 tempest-CreateVolumesFromSnapshotTest-2121410921 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:11:10 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-555d8e0f-8320-4cc6-8245-c40b47d60f20 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-11f29364-3b0f-4e2a-be26-53a43b66e9e7 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:10 devstack sudo[88239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-11f29364-3b0f-4e2a-be26-53a43b66e9e7 1073741824
Apr 15 20:11:10 devstack sudo[88239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:10 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-81cd494f-9296-4c5d-85da-5d8d674d569f tempest-VolumeDependencyTests-693181165 None] Create snapshot completed successfully
Apr 15 20:11:10 devstack sudo[88236]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:10 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-f4b39c0c-9a05-4d74-b7e9-d080ad096aa2 tempest-VolumesGetTest-1188070236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-832a7e45-a324-4155-bdff-cd6beb63a86b" returned: 0 in 0.497s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:10 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-f4b39c0c-9a05-4d74-b7e9-d080ad096aa2 tempest-VolumesGetTest-1188070236 None] Lock "cinder-quobyte-832a7e45-a324-4155-bdff-cd6beb63a86b" released by "delete_volume" :: held 1.059s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:11:11 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-f4b39c0c-9a05-4d74-b7e9-d080ad096aa2 tempest-VolumesGetTest-1188070236 None] Created reservations ['3fb683f2-de86-40b7-8cb9-20e115fab224', '98601df7-3702-4438-b951-3a4a5d7cb0e7', '27b0f7f4-f22a-45fb-a9ed-4410519824a1', 'd1ab9512-71d9-4d15-859f-112caad4e778'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:11:11 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-f4b39c0c-9a05-4d74-b7e9-d080ad096aa2 tempest-VolumesGetTest-1188070236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:11 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-f4b39c0c-9a05-4d74-b7e9-d080ad096aa2 tempest-VolumesGetTest-1188070236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:11 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-f4b39c0c-9a05-4d74-b7e9-d080ad096aa2 tempest-VolumesGetTest-1188070236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:11:11 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-f4b39c0c-9a05-4d74-b7e9-d080ad096aa2 tempest-VolumesGetTest-1188070236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:11:11 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-f4b39c0c-9a05-4d74-b7e9-d080ad096aa2 tempest-VolumesGetTest-1188070236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:11 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-f4b39c0c-9a05-4d74-b7e9-d080ad096aa2 tempest-VolumesGetTest-1188070236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:11 devstack sudo[88239]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:11 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-555d8e0f-8320-4cc6-8245-c40b47d60f20 tempest-CreateVolumesFromSnapshotTest-2121410921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-11f29364-3b0f-4e2a-be26-53a43b66e9e7 1073741824" returned: 0 in 0.603s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:11 devstack sudo[88267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:11:11 devstack sudo[88267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:11 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-555d8e0f-8320-4cc6-8245-c40b47d60f20 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-11f29364-3b0f-4e2a-be26-53a43b66e9e7 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:11 devstack sudo[88269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-11f29364-3b0f-4e2a-be26-53a43b66e9e7
Apr 15 20:11:11 devstack sudo[88269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:11 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9441dcd-c1cb-43f1-9da5-0e2ccafa3f6d tempest-VolumeDependencyTests-693181165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:11:11 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-c9441dcd-c1cb-43f1-9da5-0e2ccafa3f6d tempest-VolumeDependencyTests-693181165 None] Flow 'volume_create_manager' (3ebba0a4-6110-4c43-9b4a-13689b1573f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:11:11 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-c9441dcd-c1cb-43f1-9da5-0e2ccafa3f6d tempest-VolumeDependencyTests-693181165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1388de4c-9fe1-47d3-a72e-d652eac56f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:11 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-c9441dcd-c1cb-43f1-9da5-0e2ccafa3f6d tempest-VolumeDependencyTests-693181165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1388de4c-9fe1-47d3-a72e-d652eac56f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:11:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-953373322',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cfcd7b4-057b-4951-a963-6aac4ee2eaac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9003f754c2ca4640a792c44fe89d47cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:11:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f08a2594-bca8-44ac-aa07-2fee36c04603,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:11:12Z,use_quota=True,user_id='18ac03d032214d0c8ed2876217eaad94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:11 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-c9441dcd-c1cb-43f1-9da5-0e2ccafa3f6d tempest-VolumeDependencyTests-693181165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c1c6498-931c-4089-9590-159e05ada605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:11 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-c9441dcd-c1cb-43f1-9da5-0e2ccafa3f6d tempest-VolumeDependencyTests-693181165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c1c6498-931c-4089-9590-159e05ada605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:11 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-c9441dcd-c1cb-43f1-9da5-0e2ccafa3f6d tempest-VolumeDependencyTests-693181165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f20b9c9-f728-4dbe-8dd2-a42c89c05ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:11 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-c9441dcd-c1cb-43f1-9da5-0e2ccafa3f6d tempest-VolumeDependencyTests-693181165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f20b9c9-f728-4dbe-8dd2-a42c89c05ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2cfcd7b4-057b-4951-a963-6aac4ee2eaac', 'volume_name': 'volume-2cfcd7b4-057b-4951-a963-6aac4ee2eaac', 'volume_size': 1, 'snapshot_id': 'f08a2594-bca8-44ac-aa07-2fee36c04603'}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:11 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-c9441dcd-c1cb-43f1-9da5-0e2ccafa3f6d tempest-VolumeDependencyTests-693181165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2114285a-504c-4b99-b8f0-dfbc5d7a0ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:11 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-c9441dcd-c1cb-43f1-9da5-0e2ccafa3f6d tempest-VolumeDependencyTests-693181165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2114285a-504c-4b99-b8f0-dfbc5d7a0ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:11 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-c9441dcd-c1cb-43f1-9da5-0e2ccafa3f6d tempest-VolumeDependencyTests-693181165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a22904b-bdfa-4656-9a11-792fac4c1724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:11 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-c9441dcd-c1cb-43f1-9da5-0e2ccafa3f6d tempest-VolumeDependencyTests-693181165 None] Volume 2cfcd7b4-057b-4951-a963-6aac4ee2eaac: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2cfcd7b4-057b-4951-a963-6aac4ee2eaac', 'volume_size': 1, 'snapshot_id': 'f08a2594-bca8-44ac-aa07-2fee36c04603'}
Apr 15 20:11:11 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-c9441dcd-c1cb-43f1-9da5-0e2ccafa3f6d tempest-VolumeDependencyTests-693181165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:11 devstack sudo[88269]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:11 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-555d8e0f-8320-4cc6-8245-c40b47d60f20 tempest-CreateVolumesFromSnapshotTest-2121410921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-11f29364-3b0f-4e2a-be26-53a43b66e9e7" returned: 0 in 0.486s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:11 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-555d8e0f-8320-4cc6-8245-c40b47d60f20 tempest-CreateVolumesFromSnapshotTest-2121410921 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:11:11 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-555d8e0f-8320-4cc6-8245-c40b47d60f20 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:11 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-c9441dcd-c1cb-43f1-9da5-0e2ccafa3f6d tempest-VolumeDependencyTests-693181165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.052s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:11 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-c9441dcd-c1cb-43f1-9da5-0e2ccafa3f6d tempest-VolumeDependencyTests-693181165 None] Acquiring lock "cinder-quobyte-f08a2594-bca8-44ac-aa07-2fee36c04603-2cfcd7b4-057b-4951-a963-6aac4ee2eaac" by "_create_volume_from_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:11:11 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-555d8e0f-8320-4cc6-8245-c40b47d60f20 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37af72f6-b9c8-4d7f-842b-a0c33d4a6210) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11f29364-3b0f-4e2a-be26-53a43b66e9e7', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:11 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-555d8e0f-8320-4cc6-8245-c40b47d60f20 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2839d762-f4be-4c7d-95fd-00e6a4015e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:11 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-c9441dcd-c1cb-43f1-9da5-0e2ccafa3f6d tempest-VolumeDependencyTests-693181165 None] Lock "cinder-quobyte-f08a2594-bca8-44ac-aa07-2fee36c04603-2cfcd7b4-057b-4951-a963-6aac4ee2eaac" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:11:11 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-c9441dcd-c1cb-43f1-9da5-0e2ccafa3f6d tempest-VolumeDependencyTests-693181165 None] Creating volume 2cfcd7b4-057b-4951-a963-6aac4ee2eaac from snapshot f08a2594-bca8-44ac-aa07-2fee36c04603 {{(pid=82646) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 15 20:11:11 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-c9441dcd-c1cb-43f1-9da5-0e2ccafa3f6d tempest-VolumeDependencyTests-693181165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:11 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-c9441dcd-c1cb-43f1-9da5-0e2ccafa3f6d tempest-VolumeDependencyTests-693181165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:11 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-c9441dcd-c1cb-43f1-9da5-0e2ccafa3f6d tempest-VolumeDependencyTests-693181165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:11:11 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-c9441dcd-c1cb-43f1-9da5-0e2ccafa3f6d tempest-VolumeDependencyTests-693181165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:11:11 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-c9441dcd-c1cb-43f1-9da5-0e2ccafa3f6d tempest-VolumeDependencyTests-693181165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:11 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-c9441dcd-c1cb-43f1-9da5-0e2ccafa3f6d tempest-VolumeDependencyTests-693181165 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:11:11 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-c9441dcd-c1cb-43f1-9da5-0e2ccafa3f6d tempest-VolumeDependencyTests-693181165 None] Acquiring lock "cinder-quobyte-2cfcd7b4-057b-4951-a963-6aac4ee2eaac" by "_copy_volume_from_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:11:11 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-555d8e0f-8320-4cc6-8245-c40b47d60f20 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Volume volume-11f29364-3b0f-4e2a-be26-53a43b66e9e7 (11f29364-3b0f-4e2a-be26-53a43b66e9e7): created successfully
Apr 15 20:11:11 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-555d8e0f-8320-4cc6-8245-c40b47d60f20 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2839d762-f4be-4c7d-95fd-00e6a4015e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:11 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-555d8e0f-8320-4cc6-8245-c40b47d60f20 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Flow 'volume_create_manager' (ea035622-cff1-4f72-83be-0c4c7b94dae7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:11:11 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-c9441dcd-c1cb-43f1-9da5-0e2ccafa3f6d tempest-VolumeDependencyTests-693181165 None] Lock "cinder-quobyte-2cfcd7b4-057b-4951-a963-6aac4ee2eaac" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:11:11 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-c9441dcd-c1cb-43f1-9da5-0e2ccafa3f6d tempest-VolumeDependencyTests-693181165 None] snapshot: f08a2594-bca8-44ac-aa07-2fee36c04603, volume: 2cfcd7b4-057b-4951-a963-6aac4ee2eaac,  {{(pid=82646) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 15 20:11:11 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-555d8e0f-8320-4cc6-8245-c40b47d60f20 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Created volume successfully.
Apr 15 20:11:11 devstack sudo[88267]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:11 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-c9441dcd-c1cb-43f1-9da5-0e2ccafa3f6d tempest-VolumeDependencyTests-693181165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:11 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-c9441dcd-c1cb-43f1-9da5-0e2ccafa3f6d tempest-VolumeDependencyTests-693181165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:11 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-c9441dcd-c1cb-43f1-9da5-0e2ccafa3f6d tempest-VolumeDependencyTests-693181165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:11:11 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-c9441dcd-c1cb-43f1-9da5-0e2ccafa3f6d tempest-VolumeDependencyTests-693181165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:11:11 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-c9441dcd-c1cb-43f1-9da5-0e2ccafa3f6d tempest-VolumeDependencyTests-693181165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:11 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-f4b39c0c-9a05-4d74-b7e9-d080ad096aa2 tempest-VolumesGetTest-1188070236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.623s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:11 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-f4b39c0c-9a05-4d74-b7e9-d080ad096aa2 tempest-VolumesGetTest-1188070236 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:11:11 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ac06a2-aec6-4b48-b889-7e62668aedfe]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:11:11 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c9441dcd-c1cb-43f1-9da5-0e2ccafa3f6d tempest-VolumeDependencyTests-693181165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58.f08a2594-bca8-44ac-aa07-2fee36c04603 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:11 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-f4b39c0c-9a05-4d74-b7e9-d080ad096aa2 tempest-VolumesGetTest-1188070236 None] Deleted volume successfully.
Apr 15 20:11:11 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-f4b39c0c-9a05-4d74-b7e9-d080ad096aa2 tempest-VolumesGetTest-1188070236 None] Lock "cinder-832a7e45-a324-4155-bdff-cd6beb63a86b-delete_volume" released by "delete_volume" :: held 2.003s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:11:11 devstack sudo[88277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58.f08a2594-bca8-44ac-aa07-2fee36c04603
Apr 15 20:11:11 devstack sudo[88277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:12 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-56b33b40-aed9-4ffe-a78f-d22e561c0e93 tempest-VolumesGetTest-1188070236 None] Acquiring lock "cinder-b5f365c1-ad6d-49b9-9c37-78889ce516a2-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:11:12 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-56b33b40-aed9-4ffe-a78f-d22e561c0e93 tempest-VolumesGetTest-1188070236 None] Lock "cinder-b5f365c1-ad6d-49b9-9c37-78889ce516a2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:11:12 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-56b33b40-aed9-4ffe-a78f-d22e561c0e93 tempest-VolumesGetTest-1188070236 None] Acquiring lock "cinder-quobyte-b5f365c1-ad6d-49b9-9c37-78889ce516a2" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:11:12 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-56b33b40-aed9-4ffe-a78f-d22e561c0e93 tempest-VolumesGetTest-1188070236 None] Lock "cinder-quobyte-b5f365c1-ad6d-49b9-9c37-78889ce516a2" acquired by "delete_volume" :: waited 0.018s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:11:12 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ac85f0-ab84-4d7f-8dc5-16507035b44e]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:11:12 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-56b33b40-aed9-4ffe-a78f-d22e561c0e93 tempest-VolumesGetTest-1188070236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:12 devstack sudo[88282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2
Apr 15 20:11:12 devstack sudo[88282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:12 devstack sudo[88277]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:12 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c9441dcd-c1cb-43f1-9da5-0e2ccafa3f6d tempest-VolumeDependencyTests-693181165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58.f08a2594-bca8-44ac-aa07-2fee36c04603" returned: 0 in 0.528s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:12 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-c9441dcd-c1cb-43f1-9da5-0e2ccafa3f6d tempest-VolumeDependencyTests-693181165 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82646) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 20:11:12 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-c9441dcd-c1cb-43f1-9da5-0e2ccafa3f6d tempest-VolumeDependencyTests-693181165 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58 {{(pid=82646) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 15 20:11:12 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-c9441dcd-c1cb-43f1-9da5-0e2ccafa3f6d tempest-VolumeDependencyTests-693181165 None] Creating direct copy from snapshot {{(pid=82646) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 15 20:11:12 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[5666e3d8-1b93-4347-a6d1-1a78fda4743a]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:11:12 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c9441dcd-c1cb-43f1-9da5-0e2ccafa3f6d tempest-VolumeDependencyTests-693181165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:12 devstack sudo[88288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58
Apr 15 20:11:12 devstack sudo[88288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:12 devstack sudo[88282]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:12 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-41a8331c-800f-4fbb-bdbe-39110528c0a1 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:12 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-56b33b40-aed9-4ffe-a78f-d22e561c0e93 tempest-VolumesGetTest-1188070236 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2" returned: 0 in 0.624s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:12 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-56b33b40-aed9-4ffe-a78f-d22e561c0e93 tempest-VolumesGetTest-1188070236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:12 devstack sudo[88294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2
Apr 15 20:11:12 devstack sudo[88294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:12 devstack sudo[88288]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:12 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c9441dcd-c1cb-43f1-9da5-0e2ccafa3f6d tempest-VolumeDependencyTests-693181165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58" returned: 0 in 0.532s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:12 devstack cinder-volume[82646]: DEBUG cinder.utils [None req-c9441dcd-c1cb-43f1-9da5-0e2ccafa3f6d tempest-VolumeDependencyTests-693181165 None] Path /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-2cfcd7b4-057b-4951-a963-6aac4ee2eaac not found in is_blk_device check {{(pid=82646) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 15 20:11:12 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c9441dcd-c1cb-43f1-9da5-0e2ccafa3f6d tempest-VolumeDependencyTests-693181165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-2cfcd7b4-057b-4951-a963-6aac4ee2eaac {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:12 devstack sudo[88299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-2cfcd7b4-057b-4951-a963-6aac4ee2eaac
Apr 15 20:11:12 devstack sudo[88299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:13 devstack sudo[88294]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:13 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-56b33b40-aed9-4ffe-a78f-d22e561c0e93 tempest-VolumesGetTest-1188070236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b5f365c1-ad6d-49b9-9c37-78889ce516a2" returned: 0 in 0.408s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:13 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-56b33b40-aed9-4ffe-a78f-d22e561c0e93 tempest-VolumesGetTest-1188070236 None] Lock "cinder-quobyte-b5f365c1-ad6d-49b9-9c37-78889ce516a2" released by "delete_volume" :: held 1.086s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:11:13 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-56b33b40-aed9-4ffe-a78f-d22e561c0e93 tempest-VolumesGetTest-1188070236 None] Created reservations ['abd321a3-7fa8-41e6-ada3-269d0e0720af', 'e4da4d37-67c5-4749-adbe-3b2e4a11b626', '6bdfbd19-a9c7-4237-9b21-32c3ee2467f9', 'f492e118-eb08-4ecb-a9f3-d4a56326f44b'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:11:13 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-56b33b40-aed9-4ffe-a78f-d22e561c0e93 tempest-VolumesGetTest-1188070236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:13 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-56b33b40-aed9-4ffe-a78f-d22e561c0e93 tempest-VolumesGetTest-1188070236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:13 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-56b33b40-aed9-4ffe-a78f-d22e561c0e93 tempest-VolumesGetTest-1188070236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:11:13 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-56b33b40-aed9-4ffe-a78f-d22e561c0e93 tempest-VolumesGetTest-1188070236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:11:13 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-56b33b40-aed9-4ffe-a78f-d22e561c0e93 tempest-VolumesGetTest-1188070236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:13 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-56b33b40-aed9-4ffe-a78f-d22e561c0e93 tempest-VolumesGetTest-1188070236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:13 devstack sudo[88305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:11:13 devstack sudo[88305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:15 devstack sudo[88305]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:15 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-56b33b40-aed9-4ffe-a78f-d22e561c0e93 tempest-VolumesGetTest-1188070236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 1.810s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:15 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-56b33b40-aed9-4ffe-a78f-d22e561c0e93 tempest-VolumesGetTest-1188070236 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:11:15 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-56b33b40-aed9-4ffe-a78f-d22e561c0e93 tempest-VolumesGetTest-1188070236 None] Deleted volume successfully.
Apr 15 20:11:15 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-56b33b40-aed9-4ffe-a78f-d22e561c0e93 tempest-VolumesGetTest-1188070236 None] Lock "cinder-b5f365c1-ad6d-49b9-9c37-78889ce516a2-delete_volume" released by "delete_volume" :: held 3.044s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:11:15 devstack sudo[88299]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:15 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c9441dcd-c1cb-43f1-9da5-0e2ccafa3f6d tempest-VolumeDependencyTests-693181165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-2cfcd7b4-057b-4951-a963-6aac4ee2eaac" returned: 0 in 2.361s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:15 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b447e9-12c0-4eb3-93ab-58616928d9c6]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:11:15 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c9441dcd-c1cb-43f1-9da5-0e2ccafa3f6d tempest-VolumeDependencyTests-693181165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:15 devstack sudo[88315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58
Apr 15 20:11:15 devstack sudo[88315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:15 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c3b800d-959d-4dbd-8340-3e2fa56c71d3 tempest-VolumesGetTest-1188070236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:11:15 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-5c3b800d-959d-4dbd-8340-3e2fa56c71d3 tempest-VolumesGetTest-1188070236 None] Flow 'volume_create_manager' (c3732ef7-8db4-4259-b75d-102fd5fe90eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:11:15 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-5c3b800d-959d-4dbd-8340-3e2fa56c71d3 tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e131b5c-d0a4-4ee2-ad73-4417d410622d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:15 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-5c3b800d-959d-4dbd-8340-3e2fa56c71d3 tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e131b5c-d0a4-4ee2-ad73-4417d410622d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:11:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-254638342',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b06ce6c-11d7-41ab-aaa8-51bbe1b82058,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7fd52c85921a443d92f594a7f2280e9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:11:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:11:15Z,use_quota=True,user_id='d7a23dd5ade7439ca285e5922adb8785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:15 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-5c3b800d-959d-4dbd-8340-3e2fa56c71d3 tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feb223cd-fc38-464b-9803-a0dee6774f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:15 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-5c3b800d-959d-4dbd-8340-3e2fa56c71d3 tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feb223cd-fc38-464b-9803-a0dee6774f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:15 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-5c3b800d-959d-4dbd-8340-3e2fa56c71d3 tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ad35357-1e44-4460-88aa-07a5f649770e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:15 devstack cinder-volume[82646]: DEBUG cinder.image.glance [None req-5c3b800d-959d-4dbd-8340-3e2fa56c71d3 tempest-VolumesGetTest-1188070236 None] Creating Keystone auth plugin from conf {{(pid=82646) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 15 20:11:15 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-5c3b800d-959d-4dbd-8340-3e2fa56c71d3 tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ad35357-1e44-4460-88aa-07a5f649770e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2b06ce6c-11d7-41ab-aaa8-51bbe1b82058', 'volume_name': 'volume-2b06ce6c-11d7-41ab-aaa8-51bbe1b82058', 'volume_size': 1, 'image_id': '565a23e3-dcfa-4a62-b361-219578b0cd92', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/565a23e3-dcfa-4a62-b361-219578b0cd92', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '27d9c820db6c4abea4324fe8ea0f90e6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '565a23e3-dcfa-4a62-b361-219578b0cd92', 'created_at': datetime.datetime(2026, 4, 15, 18, 0, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 18, 0, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/565a23e3-dcfa-4a62-b361-219578b0cd92/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe167eaba60>}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:15 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-5c3b800d-959d-4dbd-8340-3e2fa56c71d3 tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4a33316-ae0a-437b-8810-3ee125ef6b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:15 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-5c3b800d-959d-4dbd-8340-3e2fa56c71d3 tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4a33316-ae0a-437b-8810-3ee125ef6b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:15 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-5c3b800d-959d-4dbd-8340-3e2fa56c71d3 tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8acde680-abe4-4e0a-9366-eb54543c54d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:15 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-5c3b800d-959d-4dbd-8340-3e2fa56c71d3 tempest-VolumesGetTest-1188070236 None] Volume 2b06ce6c-11d7-41ab-aaa8-51bbe1b82058: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2b06ce6c-11d7-41ab-aaa8-51bbe1b82058', 'volume_size': 1, 'image_id': '565a23e3-dcfa-4a62-b361-219578b0cd92', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/565a23e3-dcfa-4a62-b361-219578b0cd92', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '27d9c820db6c4abea4324fe8ea0f90e6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '565a23e3-dcfa-4a62-b361-219578b0cd92', 'created_at': datetime.datetime(2026, 4, 15, 18, 0, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 18, 0, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/565a23e3-dcfa-4a62-b361-219578b0cd92/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe167eaba60>}
Apr 15 20:11:15 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c3b800d-959d-4dbd-8340-3e2fa56c71d3 tempest-VolumesGetTest-1188070236 None] Trying to clone 2b06ce6c-11d7-41ab-aaa8-51bbe1b82058 from image 565a23e3-dcfa-4a62-b361-219578b0cd92 at location (None, [{'url': 'file:///opt/stack/data/glance/images/565a23e3-dcfa-4a62-b361-219578b0cd92', 'metadata': {}}]). {{(pid=82646) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 15 20:11:15 devstack cinder-volume[82646]: DEBUG cinder.image.image_utils [None req-5c3b800d-959d-4dbd-8340-3e2fa56c71d3 tempest-VolumesGetTest-1188070236 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_565a23e3-dcfa-4a62-b361-219578b0cd92_zxgu5f4adevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82646) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 15 20:11:15 devstack cinder-volume[82646]: INFO cinder.image.image_utils [None req-5c3b800d-959d-4dbd-8340-3e2fa56c71d3 tempest-VolumesGetTest-1188070236 None] Image download 20.69 MB at 20.69 MB/s
Apr 15 20:11:15 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[691a86d3-caa8-4dfb-aed1-e6c7ed0942c1]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:11:15 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5c3b800d-959d-4dbd-8340-3e2fa56c71d3 tempest-VolumesGetTest-1188070236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_565a23e3-dcfa-4a62-b361-219578b0cd92_zxgu5f4adevstack@QuobyteHD {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:15 devstack sudo[88315]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:15 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c9441dcd-c1cb-43f1-9da5-0e2ccafa3f6d tempest-VolumeDependencyTests-693181165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58" returned: 0 in 0.660s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:15 devstack cinder-volume[82646]: DEBUG cinder.image.image_utils [None req-c9441dcd-c1cb-43f1-9da5-0e2ccafa3f6d tempest-VolumeDependencyTests-693181165 None] Image conversion details: src /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58, size 1024.00 MB, duration 2.36 sec, destination /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-2cfcd7b4-057b-4951-a963-6aac4ee2eaac {{(pid=82646) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 20:11:15 devstack cinder-volume[82646]: INFO cinder.image.image_utils [None req-c9441dcd-c1cb-43f1-9da5-0e2ccafa3f6d tempest-VolumeDependencyTests-693181165 None] Converted 1024.00 MB image at 433.52 MB/s
Apr 15 20:11:15 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-c9441dcd-c1cb-43f1-9da5-0e2ccafa3f6d tempest-VolumeDependencyTests-693181165 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-2cfcd7b4-057b-4951-a963-6aac4ee2eaac is being set with open permissions: ugo+rw
Apr 15 20:11:15 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c9441dcd-c1cb-43f1-9da5-0e2ccafa3f6d tempest-VolumeDependencyTests-693181165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-2cfcd7b4-057b-4951-a963-6aac4ee2eaac {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:15 devstack sudo[88321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_565a23e3-dcfa-4a62-b361-219578b0cd92_zxgu5f4adevstack@QuobyteHD
Apr 15 20:11:15 devstack sudo[88321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:15 devstack sudo[88322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-2cfcd7b4-057b-4951-a963-6aac4ee2eaac
Apr 15 20:11:15 devstack sudo[88322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:16 devstack sudo[88321]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:16 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5c3b800d-959d-4dbd-8340-3e2fa56c71d3 tempest-VolumesGetTest-1188070236 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_565a23e3-dcfa-4a62-b361-219578b0cd92_zxgu5f4adevstack@QuobyteHD" returned: 0 in 0.468s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:16 devstack cinder-volume[82646]: DEBUG cinder.image.image_utils [None req-5c3b800d-959d-4dbd-8340-3e2fa56c71d3 tempest-VolumesGetTest-1188070236 None] Temporary image 565a23e3-dcfa-4a62-b361-219578b0cd92 is fetched for user d7a23dd5ade7439ca285e5922adb8785. {{(pid=82646) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 15 20:11:16 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f27a8e-f80d-4ded-940a-eda9eed8d2fd]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:11:16 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5c3b800d-959d-4dbd-8340-3e2fa56c71d3 tempest-VolumesGetTest-1188070236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_565a23e3-dcfa-4a62-b361-219578b0cd92_zxgu5f4adevstack@QuobyteHD {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:16 devstack sudo[88322]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:16 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c9441dcd-c1cb-43f1-9da5-0e2ccafa3f6d tempest-VolumeDependencyTests-693181165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-2cfcd7b4-057b-4951-a963-6aac4ee2eaac" returned: 0 in 0.500s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:16 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-c9441dcd-c1cb-43f1-9da5-0e2ccafa3f6d tempest-VolumeDependencyTests-693181165 None] Lock "cinder-quobyte-2cfcd7b4-057b-4951-a963-6aac4ee2eaac" released by "_copy_volume_from_snapshot" :: held 4.647s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:11:16 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-c9441dcd-c1cb-43f1-9da5-0e2ccafa3f6d tempest-VolumeDependencyTests-693181165 None] Lock "cinder-quobyte-f08a2594-bca8-44ac-aa07-2fee36c04603-2cfcd7b4-057b-4951-a963-6aac4ee2eaac" released by "_create_volume_from_snapshot" :: held 4.696s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:11:16 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-c9441dcd-c1cb-43f1-9da5-0e2ccafa3f6d tempest-VolumeDependencyTests-693181165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.721s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:16 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-41a8331c-800f-4fbb-bdbe-39110528c0a1 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.670s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:16 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-41a8331c-800f-4fbb-bdbe-39110528c0a1 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Creating offline snapshot cde5f8dc-3352-4f28-8fb3-e00a464f17a9 of volume 11f29364-3b0f-4e2a-be26-53a43b66e9e7 {{(pid=82646) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 20:11:16 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64e07f3-6eb4-4c19-ad50-7f72a113ce15]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:11:16 devstack sudo[88330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_565a23e3-dcfa-4a62-b361-219578b0cd92_zxgu5f4adevstack@QuobyteHD
Apr 15 20:11:16 devstack sudo[88330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:16 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-41a8331c-800f-4fbb-bdbe-39110528c0a1 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-11f29364-3b0f-4e2a-be26-53a43b66e9e7 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:16 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-c9441dcd-c1cb-43f1-9da5-0e2ccafa3f6d tempest-VolumeDependencyTests-693181165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a22904b-bdfa-4656-9a11-792fac4c1724) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cfcd7b4-057b-4951-a963-6aac4ee2eaac', 'volume_size': 1, 'snapshot_id': 'f08a2594-bca8-44ac-aa07-2fee36c04603'}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:16 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-c9441dcd-c1cb-43f1-9da5-0e2ccafa3f6d tempest-VolumeDependencyTests-693181165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f8902cb-f4f5-4799-8d24-376c8f3545f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:16 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-c9441dcd-c1cb-43f1-9da5-0e2ccafa3f6d tempest-VolumeDependencyTests-693181165 None] Volume volume-2cfcd7b4-057b-4951-a963-6aac4ee2eaac (2cfcd7b4-057b-4951-a963-6aac4ee2eaac): created successfully
Apr 15 20:11:16 devstack sudo[88332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-11f29364-3b0f-4e2a-be26-53a43b66e9e7
Apr 15 20:11:16 devstack sudo[88332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:16 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-c9441dcd-c1cb-43f1-9da5-0e2ccafa3f6d tempest-VolumeDependencyTests-693181165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f8902cb-f4f5-4799-8d24-376c8f3545f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:16 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-c9441dcd-c1cb-43f1-9da5-0e2ccafa3f6d tempest-VolumeDependencyTests-693181165 None] Flow 'volume_create_manager' (3ebba0a4-6110-4c43-9b4a-13689b1573f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:11:16 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-d80cd95a-c98f-4ffe-831e-12927493ba20 tempest-VolumesActionsTest-1438461382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:11:16 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d80cd95a-c98f-4ffe-831e-12927493ba20 tempest-VolumesActionsTest-1438461382 None] Flow 'volume_create_manager' (6e90dbda-8f0f-4a77-8d34-0b10eb4a3c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:11:16 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d80cd95a-c98f-4ffe-831e-12927493ba20 tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a468fe2c-e804-42d0-ac54-13073de01e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:16 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d80cd95a-c98f-4ffe-831e-12927493ba20 tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a468fe2c-e804-42d0-ac54-13073de01e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:11:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-677569532',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0662c53b-499b-4bbe-81f5-f0f0c75c1217,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df37bd8c7f7a4cea8e7e0beb744ae494',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:11:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:11:17Z,use_quota=True,user_id='51042bd29b7a4a579be7666e3269ba93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:16 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d80cd95a-c98f-4ffe-831e-12927493ba20 tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e8cdab9-3ed7-48f2-8a36-8ffc6f887b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:16 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d80cd95a-c98f-4ffe-831e-12927493ba20 tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e8cdab9-3ed7-48f2-8a36-8ffc6f887b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:16 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d80cd95a-c98f-4ffe-831e-12927493ba20 tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d97cef86-913e-4a54-acc4-ecff49d9b293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:16 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d80cd95a-c98f-4ffe-831e-12927493ba20 tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d97cef86-913e-4a54-acc4-ecff49d9b293) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0662c53b-499b-4bbe-81f5-f0f0c75c1217', 'volume_name': 'volume-0662c53b-499b-4bbe-81f5-f0f0c75c1217', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:16 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d80cd95a-c98f-4ffe-831e-12927493ba20 tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10d56890-f0db-4252-b510-16adfa932a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:16 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d80cd95a-c98f-4ffe-831e-12927493ba20 tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10d56890-f0db-4252-b510-16adfa932a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:16 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d80cd95a-c98f-4ffe-831e-12927493ba20 tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed7955bc-be52-4c90-acb4-1f2c64abdd8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:16 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-d80cd95a-c98f-4ffe-831e-12927493ba20 tempest-VolumesActionsTest-1438461382 None] Volume 0662c53b-499b-4bbe-81f5-f0f0c75c1217: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0662c53b-499b-4bbe-81f5-f0f0c75c1217', 'volume_size': 1}
Apr 15 20:11:16 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-d80cd95a-c98f-4ffe-831e-12927493ba20 tempest-VolumesActionsTest-1438461382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:16 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-c9441dcd-c1cb-43f1-9da5-0e2ccafa3f6d tempest-VolumeDependencyTests-693181165 None] Created volume successfully.
Apr 15 20:11:16 devstack sudo[88330]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:16 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5c3b800d-959d-4dbd-8340-3e2fa56c71d3 tempest-VolumesGetTest-1188070236 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_565a23e3-dcfa-4a62-b361-219578b0cd92_zxgu5f4adevstack@QuobyteHD" returned: 0 in 0.513s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:16 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-5c3b800d-959d-4dbd-8340-3e2fa56c71d3 tempest-VolumesGetTest-1188070236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:17 devstack sudo[88332]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-41a8331c-800f-4fbb-bdbe-39110528c0a1 tempest-CreateVolumesFromSnapshotTest-2121410921 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-11f29364-3b0f-4e2a-be26-53a43b66e9e7" returned: 0 in 0.484s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-41a8331c-800f-4fbb-bdbe-39110528c0a1 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-11f29364-3b0f-4e2a-be26-53a43b66e9e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-11f29364-3b0f-4e2a-be26-53a43b66e9e7.cde5f8dc-3352-4f28-8fb3-e00a464f17a9 1G {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:17 devstack sudo[88340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-11f29364-3b0f-4e2a-be26-53a43b66e9e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-11f29364-3b0f-4e2a-be26-53a43b66e9e7.cde5f8dc-3352-4f28-8fb3-e00a464f17a9 1G
Apr 15 20:11:17 devstack sudo[88340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:17 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-c07d5544-0d20-4501-852c-8d9062745cbd tempest-VolumeDependencyTests-693181165 None] Acquiring lock "cinder-f08a2594-bca8-44ac-aa07-2fee36c04603-delete_snapshot" by "delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:11:17 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-c07d5544-0d20-4501-852c-8d9062745cbd tempest-VolumeDependencyTests-693181165 None] Lock "cinder-f08a2594-bca8-44ac-aa07-2fee36c04603-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:11:17 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-c07d5544-0d20-4501-852c-8d9062745cbd tempest-VolumeDependencyTests-693181165 None] Acquiring lock "cinder-quobyte-dc1243bb-baf5-4d69-b2a0-d945e1733c58" by "delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:11:17 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-c07d5544-0d20-4501-852c-8d9062745cbd tempest-VolumeDependencyTests-693181165 None] Lock "cinder-quobyte-dc1243bb-baf5-4d69-b2a0-d945e1733c58" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:11:17 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-c07d5544-0d20-4501-852c-8d9062745cbd tempest-VolumeDependencyTests-693181165 None] Acquiring lock "cinder-quobyte-f08a2594-bca8-44ac-aa07-2fee36c04603" by "_delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:11:17 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-c07d5544-0d20-4501-852c-8d9062745cbd tempest-VolumeDependencyTests-693181165 None] Lock "cinder-quobyte-f08a2594-bca8-44ac-aa07-2fee36c04603" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:11:17 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-c07d5544-0d20-4501-852c-8d9062745cbd tempest-VolumeDependencyTests-693181165 None] Deleting offline snapshot f08a2594-bca8-44ac-aa07-2fee36c04603 of volume dc1243bb-baf5-4d69-b2a0-d945e1733c58 {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 20:11:17 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-c07d5544-0d20-4501-852c-8d9062745cbd tempest-VolumeDependencyTests-693181165 None] snapshot_file for this snap is: volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58.f08a2594-bca8-44ac-aa07-2fee36c04603 {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 20:11:17 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2a8497-ef3e-49d4-847c-23dae24315f4]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:11:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c07d5544-0d20-4501-852c-8d9062745cbd tempest-VolumeDependencyTests-693181165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58.f08a2594-bca8-44ac-aa07-2fee36c04603 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:17 devstack sudo[88342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58.f08a2594-bca8-44ac-aa07-2fee36c04603
Apr 15 20:11:17 devstack sudo[88342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:17 devstack sudo[88340]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-41a8331c-800f-4fbb-bdbe-39110528c0a1 tempest-CreateVolumesFromSnapshotTest-2121410921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-11f29364-3b0f-4e2a-be26-53a43b66e9e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-11f29364-3b0f-4e2a-be26-53a43b66e9e7.cde5f8dc-3352-4f28-8fb3-e00a464f17a9 1G" returned: 0 in 0.542s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-41a8331c-800f-4fbb-bdbe-39110528c0a1 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11f29364-3b0f-4e2a-be26-53a43b66e9e7 -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-11f29364-3b0f-4e2a-be26-53a43b66e9e7.cde5f8dc-3352-4f28-8fb3-e00a464f17a9 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:17 devstack sudo[88347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11f29364-3b0f-4e2a-be26-53a43b66e9e7 -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-11f29364-3b0f-4e2a-be26-53a43b66e9e7.cde5f8dc-3352-4f28-8fb3-e00a464f17a9
Apr 15 20:11:17 devstack sudo[88347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:17 devstack sudo[88342]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c07d5544-0d20-4501-852c-8d9062745cbd tempest-VolumeDependencyTests-693181165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58.f08a2594-bca8-44ac-aa07-2fee36c04603" returned: 0 in 0.559s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:17 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-c07d5544-0d20-4501-852c-8d9062745cbd tempest-VolumeDependencyTests-693181165 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82646) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 20:11:17 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a6b97d-7913-4005-b195-02bce74d01b1]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:11:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c07d5544-0d20-4501-852c-8d9062745cbd tempest-VolumeDependencyTests-693181165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:17 devstack sudo[88355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58
Apr 15 20:11:17 devstack sudo[88347]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:17 devstack sudo[88355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-41a8331c-800f-4fbb-bdbe-39110528c0a1 tempest-CreateVolumesFromSnapshotTest-2121410921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11f29364-3b0f-4e2a-be26-53a43b66e9e7 -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-11f29364-3b0f-4e2a-be26-53a43b66e9e7.cde5f8dc-3352-4f28-8fb3-e00a464f17a9" returned: 0 in 0.434s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:17 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-41a8331c-800f-4fbb-bdbe-39110528c0a1 tempest-CreateVolumesFromSnapshotTest-2121410921 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-11f29364-3b0f-4e2a-be26-53a43b66e9e7.cde5f8dc-3352-4f28-8fb3-e00a464f17a9 is being set with open permissions: ugo+rw
Apr 15 20:11:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-41a8331c-800f-4fbb-bdbe-39110528c0a1 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-11f29364-3b0f-4e2a-be26-53a43b66e9e7.cde5f8dc-3352-4f28-8fb3-e00a464f17a9 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:18 devstack sudo[88357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-11f29364-3b0f-4e2a-be26-53a43b66e9e7.cde5f8dc-3352-4f28-8fb3-e00a464f17a9
Apr 15 20:11:18 devstack sudo[88357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:18 devstack sudo[88355]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c07d5544-0d20-4501-852c-8d9062745cbd tempest-VolumeDependencyTests-693181165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58" returned: 0 in 0.503s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c07d5544-0d20-4501-852c-8d9062745cbd tempest-VolumeDependencyTests-693181165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58.f08a2594-bca8-44ac-aa07-2fee36c04603 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:18 devstack sudo[88363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58.f08a2594-bca8-44ac-aa07-2fee36c04603
Apr 15 20:11:18 devstack sudo[88363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:18 devstack sudo[88357]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-41a8331c-800f-4fbb-bdbe-39110528c0a1 tempest-CreateVolumesFromSnapshotTest-2121410921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-11f29364-3b0f-4e2a-be26-53a43b66e9e7.cde5f8dc-3352-4f28-8fb3-e00a464f17a9" returned: 0 in 0.491s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-41a8331c-800f-4fbb-bdbe-39110528c0a1 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-11f29364-3b0f-4e2a-be26-53a43b66e9e7.info {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:18 devstack sudo[88365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-11f29364-3b0f-4e2a-be26-53a43b66e9e7.info
Apr 15 20:11:18 devstack sudo[88365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:18 devstack sudo[88363]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c07d5544-0d20-4501-852c-8d9062745cbd tempest-VolumeDependencyTests-693181165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58.f08a2594-bca8-44ac-aa07-2fee36c04603" returned: 0 in 0.581s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c07d5544-0d20-4501-852c-8d9062745cbd tempest-VolumeDependencyTests-693181165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58.f08a2594-bca8-44ac-aa07-2fee36c04603 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:19 devstack sudo[88371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58.f08a2594-bca8-44ac-aa07-2fee36c04603
Apr 15 20:11:19 devstack sudo[88371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:19 devstack sudo[88365]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:19 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-41a8331c-800f-4fbb-bdbe-39110528c0a1 tempest-CreateVolumesFromSnapshotTest-2121410921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-11f29364-3b0f-4e2a-be26-53a43b66e9e7.info" returned: 0 in 0.558s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:19 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-41a8331c-800f-4fbb-bdbe-39110528c0a1 tempest-CreateVolumesFromSnapshotTest-2121410921 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-11f29364-3b0f-4e2a-be26-53a43b66e9e7.info is being set with open permissions: ugo+rw
Apr 15 20:11:19 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-41a8331c-800f-4fbb-bdbe-39110528c0a1 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-11f29364-3b0f-4e2a-be26-53a43b66e9e7.info {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:19 devstack sudo[88373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-11f29364-3b0f-4e2a-be26-53a43b66e9e7.info
Apr 15 20:11:19 devstack sudo[88373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:19 devstack sudo[88373]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:19 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-41a8331c-800f-4fbb-bdbe-39110528c0a1 tempest-CreateVolumesFromSnapshotTest-2121410921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-11f29364-3b0f-4e2a-be26-53a43b66e9e7.info" returned: 0 in 0.451s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:19 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-41a8331c-800f-4fbb-bdbe-39110528c0a1 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.053s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:19 devstack sudo[88371]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:19 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-d80cd95a-c98f-4ffe-831e-12927493ba20 tempest-VolumesActionsTest-1438461382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.850s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:19 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-d80cd95a-c98f-4ffe-831e-12927493ba20 tempest-VolumesActionsTest-1438461382 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:11:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-677569532',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0662c53b-499b-4bbe-81f5-f0f0c75c1217,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df37bd8c7f7a4cea8e7e0beb744ae494',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:11:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:11:17Z,use_quota=True,user_id='51042bd29b7a4a579be7666e3269ba93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:11:19 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-d80cd95a-c98f-4ffe-831e-12927493ba20 tempest-VolumesActionsTest-1438461382 None] Creating volume 0662c53b-499b-4bbe-81f5-f0f0c75c1217 {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:11:19 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-d80cd95a-c98f-4ffe-831e-12927493ba20 tempest-VolumesActionsTest-1438461382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:19 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-d80cd95a-c98f-4ffe-831e-12927493ba20 tempest-VolumesActionsTest-1438461382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:19 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-d80cd95a-c98f-4ffe-831e-12927493ba20 tempest-VolumesActionsTest-1438461382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:11:19 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-d80cd95a-c98f-4ffe-831e-12927493ba20 tempest-VolumesActionsTest-1438461382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:11:19 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-d80cd95a-c98f-4ffe-831e-12927493ba20 tempest-VolumesActionsTest-1438461382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:19 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-d80cd95a-c98f-4ffe-831e-12927493ba20 tempest-VolumesActionsTest-1438461382 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:11:19 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-d80cd95a-c98f-4ffe-831e-12927493ba20 tempest-VolumesActionsTest-1438461382 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:11:19 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d80cd95a-c98f-4ffe-831e-12927493ba20 tempest-VolumesActionsTest-1438461382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0662c53b-499b-4bbe-81f5-f0f0c75c1217 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:19 devstack sudo[88377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0662c53b-499b-4bbe-81f5-f0f0c75c1217 1073741824
Apr 15 20:11:19 devstack sudo[88377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:19 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c07d5544-0d20-4501-852c-8d9062745cbd tempest-VolumeDependencyTests-693181165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58.f08a2594-bca8-44ac-aa07-2fee36c04603" returned: 0 in 0.579s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:19 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-41a8331c-800f-4fbb-bdbe-39110528c0a1 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Create snapshot completed successfully
Apr 15 20:11:19 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-c07d5544-0d20-4501-852c-8d9062745cbd tempest-VolumeDependencyTests-693181165 None] Lock "cinder-quobyte-f08a2594-bca8-44ac-aa07-2fee36c04603" released by "_delete_snapshot" :: held 2.302s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:11:19 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-c07d5544-0d20-4501-852c-8d9062745cbd tempest-VolumeDependencyTests-693181165 None] Lock "cinder-quobyte-dc1243bb-baf5-4d69-b2a0-d945e1733c58" released by "delete_snapshot" :: held 2.320s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:11:19 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-c07d5544-0d20-4501-852c-8d9062745cbd tempest-VolumeDependencyTests-693181165 None] Created reservations ['b54549f1-effc-4eba-a48d-6ce9a3a6ec45', '45a70d12-920b-46bb-afa3-57b8c2ba98e9', '1cd611b9-a244-43a1-832e-6c17dcabc616', '7897582c-b556-4371-8206-29db801ede46'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:11:19 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-c07d5544-0d20-4501-852c-8d9062745cbd tempest-VolumeDependencyTests-693181165 None] Delete snapshot completed successfully.
Apr 15 20:11:19 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-c07d5544-0d20-4501-852c-8d9062745cbd tempest-VolumeDependencyTests-693181165 None] Lock "cinder-f08a2594-bca8-44ac-aa07-2fee36c04603-delete_snapshot" released by "delete_snapshot" :: held 2.430s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:11:20 devstack sudo[88377]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d80cd95a-c98f-4ffe-831e-12927493ba20 tempest-VolumesActionsTest-1438461382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0662c53b-499b-4bbe-81f5-f0f0c75c1217 1073741824" returned: 0 in 0.515s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d80cd95a-c98f-4ffe-831e-12927493ba20 tempest-VolumesActionsTest-1438461382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0662c53b-499b-4bbe-81f5-f0f0c75c1217 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:20 devstack sudo[88382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0662c53b-499b-4bbe-81f5-f0f0c75c1217
Apr 15 20:11:20 devstack sudo[88382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:20 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-32e74ca1-ae04-4f63-b549-ac89e7531859 tempest-VolumeDependencyTests-693181165 None] Acquiring lock "cinder-dc1243bb-baf5-4d69-b2a0-d945e1733c58-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:11:20 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-32e74ca1-ae04-4f63-b549-ac89e7531859 tempest-VolumeDependencyTests-693181165 None] Lock "cinder-dc1243bb-baf5-4d69-b2a0-d945e1733c58-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:11:20 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-32e74ca1-ae04-4f63-b549-ac89e7531859 tempest-VolumeDependencyTests-693181165 None] Acquiring lock "cinder-quobyte-dc1243bb-baf5-4d69-b2a0-d945e1733c58" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:11:20 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-32e74ca1-ae04-4f63-b549-ac89e7531859 tempest-VolumeDependencyTests-693181165 None] Lock "cinder-quobyte-dc1243bb-baf5-4d69-b2a0-d945e1733c58" acquired by "delete_volume" :: waited 0.009s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:11:20 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f861ab4-7eae-4304-b7c9-227307b63eca]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:11:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-32e74ca1-ae04-4f63-b549-ac89e7531859 tempest-VolumeDependencyTests-693181165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:20 devstack sudo[88382]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d80cd95a-c98f-4ffe-831e-12927493ba20 tempest-VolumesActionsTest-1438461382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0662c53b-499b-4bbe-81f5-f0f0c75c1217" returned: 0 in 0.470s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:20 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-d80cd95a-c98f-4ffe-831e-12927493ba20 tempest-VolumesActionsTest-1438461382 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:11:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-d80cd95a-c98f-4ffe-831e-12927493ba20 tempest-VolumesActionsTest-1438461382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-5c3b800d-959d-4dbd-8340-3e2fa56c71d3 tempest-VolumesGetTest-1188070236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.619s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:20 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-5c3b800d-959d-4dbd-8340-3e2fa56c71d3 tempest-VolumesGetTest-1188070236 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:11:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-254638342',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b06ce6c-11d7-41ab-aaa8-51bbe1b82058,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7fd52c85921a443d92f594a7f2280e9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:11:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:11:15Z,use_quota=True,user_id='d7a23dd5ade7439ca285e5922adb8785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:11:20 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-5c3b800d-959d-4dbd-8340-3e2fa56c71d3 tempest-VolumesGetTest-1188070236 None] Creating volume 2b06ce6c-11d7-41ab-aaa8-51bbe1b82058 {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:11:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-5c3b800d-959d-4dbd-8340-3e2fa56c71d3 tempest-VolumesGetTest-1188070236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-5c3b800d-959d-4dbd-8340-3e2fa56c71d3 tempest-VolumesGetTest-1188070236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:20 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-5c3b800d-959d-4dbd-8340-3e2fa56c71d3 tempest-VolumesGetTest-1188070236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:11:20 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-5c3b800d-959d-4dbd-8340-3e2fa56c71d3 tempest-VolumesGetTest-1188070236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:11:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-5c3b800d-959d-4dbd-8340-3e2fa56c71d3 tempest-VolumesGetTest-1188070236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:20 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-5c3b800d-959d-4dbd-8340-3e2fa56c71d3 tempest-VolumesGetTest-1188070236 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:11:20 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-5c3b800d-959d-4dbd-8340-3e2fa56c71d3 tempest-VolumesGetTest-1188070236 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:11:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5c3b800d-959d-4dbd-8340-3e2fa56c71d3 tempest-VolumesGetTest-1188070236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-2b06ce6c-11d7-41ab-aaa8-51bbe1b82058 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:20 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d80cd95a-c98f-4ffe-831e-12927493ba20 tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed7955bc-be52-4c90-acb4-1f2c64abdd8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0662c53b-499b-4bbe-81f5-f0f0c75c1217', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:20 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d80cd95a-c98f-4ffe-831e-12927493ba20 tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08f868ee-a91b-46c0-85b0-3da38614132e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:20 devstack sudo[88385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58
Apr 15 20:11:20 devstack sudo[88385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:20 devstack sudo[88386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-2b06ce6c-11d7-41ab-aaa8-51bbe1b82058 1073741824
Apr 15 20:11:20 devstack sudo[88386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:20 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-d80cd95a-c98f-4ffe-831e-12927493ba20 tempest-VolumesActionsTest-1438461382 None] Volume volume-0662c53b-499b-4bbe-81f5-f0f0c75c1217 (0662c53b-499b-4bbe-81f5-f0f0c75c1217): created successfully
Apr 15 20:11:20 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d80cd95a-c98f-4ffe-831e-12927493ba20 tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08f868ee-a91b-46c0-85b0-3da38614132e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:20 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d80cd95a-c98f-4ffe-831e-12927493ba20 tempest-VolumesActionsTest-1438461382 None] Flow 'volume_create_manager' (6e90dbda-8f0f-4a77-8d34-0b10eb4a3c14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:11:20 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-b03ac880-f65e-4af4-a39e-67c6a8d51d48 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:11:20 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b03ac880-f65e-4af4-a39e-67c6a8d51d48 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Flow 'volume_create_manager' (07700e73-60e8-4657-8348-392590bd287e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:11:20 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b03ac880-f65e-4af4-a39e-67c6a8d51d48 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a1ed994-fe6c-4483-a7a8-9ac506deaab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:20 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b03ac880-f65e-4af4-a39e-67c6a8d51d48 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a1ed994-fe6c-4483-a7a8-9ac506deaab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:11:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2016283387',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=feeca0e5-81b7-4b60-ab20-d453e814601e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eebe9fc76d38432d93ee1792de21d1d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:11:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:11:21Z,use_quota=True,user_id='d6eb8d03b80141129e3905dedb67c44d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:20 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b03ac880-f65e-4af4-a39e-67c6a8d51d48 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff075dd8-144f-4819-9790-380d3321c135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:20 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b03ac880-f65e-4af4-a39e-67c6a8d51d48 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff075dd8-144f-4819-9790-380d3321c135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:20 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b03ac880-f65e-4af4-a39e-67c6a8d51d48 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b67a81f-3099-4def-937b-7a747017e3d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:20 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b03ac880-f65e-4af4-a39e-67c6a8d51d48 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b67a81f-3099-4def-937b-7a747017e3d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'feeca0e5-81b7-4b60-ab20-d453e814601e', 'volume_name': 'volume-feeca0e5-81b7-4b60-ab20-d453e814601e', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:20 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b03ac880-f65e-4af4-a39e-67c6a8d51d48 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c424edf6-6b83-4901-8d6e-8d4e53673f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:20 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b03ac880-f65e-4af4-a39e-67c6a8d51d48 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c424edf6-6b83-4901-8d6e-8d4e53673f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:20 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b03ac880-f65e-4af4-a39e-67c6a8d51d48 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bd89d10-3e0f-43b0-96fe-d8e5593c7818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:20 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-b03ac880-f65e-4af4-a39e-67c6a8d51d48 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Volume feeca0e5-81b7-4b60-ab20-d453e814601e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-feeca0e5-81b7-4b60-ab20-d453e814601e', 'volume_size': 1}
Apr 15 20:11:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-b03ac880-f65e-4af4-a39e-67c6a8d51d48 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:20 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-d80cd95a-c98f-4ffe-831e-12927493ba20 tempest-VolumesActionsTest-1438461382 None] Created volume successfully.
Apr 15 20:11:20 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-37effb8a-acb3-49ba-847f-f9a51c024301 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:11:20 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-37effb8a-acb3-49ba-847f-f9a51c024301 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Flow 'volume_create_manager' (52cfdfaa-5167-4012-8417-9676abaa83e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:11:20 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-37effb8a-acb3-49ba-847f-f9a51c024301 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fb2f07f-3a16-440e-b0e7-e7ff97308f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:20 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-37effb8a-acb3-49ba-847f-f9a51c024301 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fb2f07f-3a16-440e-b0e7-e7ff97308f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:11:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1994067381',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6321df1e-e37c-423e-b3d4-f2cb2cf0dc08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eebe9fc76d38432d93ee1792de21d1d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:11:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:11:21Z,use_quota=True,user_id='d6eb8d03b80141129e3905dedb67c44d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:20 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-37effb8a-acb3-49ba-847f-f9a51c024301 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b978a82-5b83-4104-9153-7a41731db766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:20 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-37effb8a-acb3-49ba-847f-f9a51c024301 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b978a82-5b83-4104-9153-7a41731db766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:20 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-37effb8a-acb3-49ba-847f-f9a51c024301 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa9e7ceb-2c08-49fe-a9b2-2eb602f59c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:20 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-37effb8a-acb3-49ba-847f-f9a51c024301 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa9e7ceb-2c08-49fe-a9b2-2eb602f59c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6321df1e-e37c-423e-b3d4-f2cb2cf0dc08', 'volume_name': 'volume-6321df1e-e37c-423e-b3d4-f2cb2cf0dc08', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:20 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-37effb8a-acb3-49ba-847f-f9a51c024301 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a64f5702-0b53-449a-920f-595332543b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:20 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-37effb8a-acb3-49ba-847f-f9a51c024301 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a64f5702-0b53-449a-920f-595332543b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:20 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-37effb8a-acb3-49ba-847f-f9a51c024301 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (998a7dbd-4e72-425e-a675-3a5fcb560700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:20 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-37effb8a-acb3-49ba-847f-f9a51c024301 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Volume 6321df1e-e37c-423e-b3d4-f2cb2cf0dc08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6321df1e-e37c-423e-b3d4-f2cb2cf0dc08', 'volume_size': 1}
Apr 15 20:11:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-37effb8a-acb3-49ba-847f-f9a51c024301 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:20 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-0d15bb04-6e46-4974-b51f-a205996c0811 tempest-VolumesActionsTest-2098528605 None] Acquiring lock "cinder-0662c53b-499b-4bbe-81f5-f0f0c75c1217-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:11:20 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-0d15bb04-6e46-4974-b51f-a205996c0811 tempest-VolumesActionsTest-2098528605 None] Lock "cinder-0662c53b-499b-4bbe-81f5-f0f0c75c1217-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-0d15bb04-6e46-4974-b51f-a205996c0811 tempest-VolumesActionsTest-2098528605 None] Acquiring lock "cinder-quobyte-0662c53b-499b-4bbe-81f5-f0f0c75c1217" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-0d15bb04-6e46-4974-b51f-a205996c0811 tempest-VolumesActionsTest-2098528605 None] Lock "cinder-quobyte-0662c53b-499b-4bbe-81f5-f0f0c75c1217" acquired by "delete_volume" :: waited 0.013s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f17051-5bf6-4f54-8118-683a7e618f6d]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-0d15bb04-6e46-4974-b51f-a205996c0811 tempest-VolumesActionsTest-2098528605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0662c53b-499b-4bbe-81f5-f0f0c75c1217 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd5b2fb9-dcad-45ca-b3e7-fbcd6ee795d2 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-fd5b2fb9-dcad-45ca-b3e7-fbcd6ee795d2 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Flow 'volume_create_manager' (853b6e7f-3857-49c5-9ca0-ed9aa11f76e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:11:21 devstack sudo[88389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0662c53b-499b-4bbe-81f5-f0f0c75c1217
Apr 15 20:11:21 devstack sudo[88389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-fd5b2fb9-dcad-45ca-b3e7-fbcd6ee795d2 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80b43c1b-653d-484f-b9ee-d421b4b74693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-fd5b2fb9-dcad-45ca-b3e7-fbcd6ee795d2 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80b43c1b-653d-484f-b9ee-d421b4b74693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:11:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-45251737',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=998b76ac-0004-4b17-8559-e88cd297e712,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eebe9fc76d38432d93ee1792de21d1d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:11:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:11:21Z,use_quota=True,user_id='d6eb8d03b80141129e3905dedb67c44d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-fd5b2fb9-dcad-45ca-b3e7-fbcd6ee795d2 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f28affc-8b72-41c6-bece-b68481025a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-fd5b2fb9-dcad-45ca-b3e7-fbcd6ee795d2 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f28affc-8b72-41c6-bece-b68481025a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-fd5b2fb9-dcad-45ca-b3e7-fbcd6ee795d2 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (756d2f53-acc8-49f5-9916-4216a6e70322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-fd5b2fb9-dcad-45ca-b3e7-fbcd6ee795d2 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (756d2f53-acc8-49f5-9916-4216a6e70322) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '998b76ac-0004-4b17-8559-e88cd297e712', 'volume_name': 'volume-998b76ac-0004-4b17-8559-e88cd297e712', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-fd5b2fb9-dcad-45ca-b3e7-fbcd6ee795d2 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (203ac806-983c-47c1-8a76-4bd215b3b9dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-fd5b2fb9-dcad-45ca-b3e7-fbcd6ee795d2 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (203ac806-983c-47c1-8a76-4bd215b3b9dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-fd5b2fb9-dcad-45ca-b3e7-fbcd6ee795d2 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99c85411-ce72-4dd3-b983-4c935ef4b5ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:21 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-fd5b2fb9-dcad-45ca-b3e7-fbcd6ee795d2 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Volume 998b76ac-0004-4b17-8559-e88cd297e712: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-998b76ac-0004-4b17-8559-e88cd297e712', 'volume_size': 1}
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-fd5b2fb9-dcad-45ca-b3e7-fbcd6ee795d2 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:21 devstack sudo[88386]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5c3b800d-959d-4dbd-8340-3e2fa56c71d3 tempest-VolumesGetTest-1188070236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-2b06ce6c-11d7-41ab-aaa8-51bbe1b82058 1073741824" returned: 0 in 0.708s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:21 devstack sudo[88385]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-32e74ca1-ae04-4f63-b549-ac89e7531859 tempest-VolumeDependencyTests-693181165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58" returned: 0 in 0.752s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-32e74ca1-ae04-4f63-b549-ac89e7531859 tempest-VolumeDependencyTests-693181165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:21 devstack sudo[88397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58
Apr 15 20:11:21 devstack sudo[88397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5c3b800d-959d-4dbd-8340-3e2fa56c71d3 tempest-VolumesGetTest-1188070236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-2b06ce6c-11d7-41ab-aaa8-51bbe1b82058 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-d210b960-b1a2-46ed-8d42-fadf5262fbd8 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d210b960-b1a2-46ed-8d42-fadf5262fbd8 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Flow 'volume_create_manager' (60fabf49-7c78-40a2-82a1-30072ae2cae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d210b960-b1a2-46ed-8d42-fadf5262fbd8 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a38f8da-beac-4809-998d-f0bdf74d0685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:21 devstack sudo[88399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-2b06ce6c-11d7-41ab-aaa8-51bbe1b82058
Apr 15 20:11:21 devstack sudo[88399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d210b960-b1a2-46ed-8d42-fadf5262fbd8 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a38f8da-beac-4809-998d-f0bdf74d0685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:11:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-800620976',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b18039d5-5122-4445-8d80-a5e768e72285,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eebe9fc76d38432d93ee1792de21d1d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:11:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:11:21Z,use_quota=True,user_id='d6eb8d03b80141129e3905dedb67c44d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d210b960-b1a2-46ed-8d42-fadf5262fbd8 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (025f1c60-737c-4dae-bc24-6b49628d3cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d210b960-b1a2-46ed-8d42-fadf5262fbd8 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (025f1c60-737c-4dae-bc24-6b49628d3cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d210b960-b1a2-46ed-8d42-fadf5262fbd8 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4d47378-912e-454c-b366-5a1e7080fcd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d210b960-b1a2-46ed-8d42-fadf5262fbd8 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4d47378-912e-454c-b366-5a1e7080fcd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b18039d5-5122-4445-8d80-a5e768e72285', 'volume_name': 'volume-b18039d5-5122-4445-8d80-a5e768e72285', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d210b960-b1a2-46ed-8d42-fadf5262fbd8 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf75e16c-cc08-4f38-b96f-5162018e5336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d210b960-b1a2-46ed-8d42-fadf5262fbd8 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf75e16c-cc08-4f38-b96f-5162018e5336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d210b960-b1a2-46ed-8d42-fadf5262fbd8 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ceaae09-6c22-4d99-8c62-67103a6d37e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:21 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-d210b960-b1a2-46ed-8d42-fadf5262fbd8 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Volume b18039d5-5122-4445-8d80-a5e768e72285: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b18039d5-5122-4445-8d80-a5e768e72285', 'volume_size': 1}
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-d210b960-b1a2-46ed-8d42-fadf5262fbd8 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-cde66fe2-fcc1-44d0-8888-d29c005a0807 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-cde66fe2-fcc1-44d0-8888-d29c005a0807 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Flow 'volume_create_manager' (5e5ff289-3654-46f0-bb09-2f46c4fbae7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-cde66fe2-fcc1-44d0-8888-d29c005a0807 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ca8a539-ff10-460f-a4ad-4a7f8e0887b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-cde66fe2-fcc1-44d0-8888-d29c005a0807 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ca8a539-ff10-460f-a4ad-4a7f8e0887b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:11:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-280238100',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b153ebd7-2ba3-4084-b990-a3f36170f9e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eebe9fc76d38432d93ee1792de21d1d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:11:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:11:22Z,use_quota=True,user_id='d6eb8d03b80141129e3905dedb67c44d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-cde66fe2-fcc1-44d0-8888-d29c005a0807 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f8b74e0-fc3b-4897-a50f-bce393aecf0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-cde66fe2-fcc1-44d0-8888-d29c005a0807 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f8b74e0-fc3b-4897-a50f-bce393aecf0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-cde66fe2-fcc1-44d0-8888-d29c005a0807 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e30a461d-e858-4f19-bede-e0f8a963b121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-cde66fe2-fcc1-44d0-8888-d29c005a0807 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e30a461d-e858-4f19-bede-e0f8a963b121) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b153ebd7-2ba3-4084-b990-a3f36170f9e8', 'volume_name': 'volume-b153ebd7-2ba3-4084-b990-a3f36170f9e8', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:21 devstack sudo[88389]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-cde66fe2-fcc1-44d0-8888-d29c005a0807 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb7d0cc2-fbc2-4ae0-9dca-4bdc508de3d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-cde66fe2-fcc1-44d0-8888-d29c005a0807 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb7d0cc2-fbc2-4ae0-9dca-4bdc508de3d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-cde66fe2-fcc1-44d0-8888-d29c005a0807 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e8197d2-4c2a-4937-b77d-13094a074a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:21 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-cde66fe2-fcc1-44d0-8888-d29c005a0807 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Volume b153ebd7-2ba3-4084-b990-a3f36170f9e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b153ebd7-2ba3-4084-b990-a3f36170f9e8', 'volume_size': 1}
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-cde66fe2-fcc1-44d0-8888-d29c005a0807 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-0d15bb04-6e46-4974-b51f-a205996c0811 tempest-VolumesActionsTest-2098528605 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0662c53b-499b-4bbe-81f5-f0f0c75c1217" returned: 0 in 0.615s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-0d15bb04-6e46-4974-b51f-a205996c0811 tempest-VolumesActionsTest-2098528605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0662c53b-499b-4bbe-81f5-f0f0c75c1217 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:21 devstack sudo[88404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0662c53b-499b-4bbe-81f5-f0f0c75c1217
Apr 15 20:11:21 devstack sudo[88404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:21 devstack sudo[88397]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-32e74ca1-ae04-4f63-b549-ac89e7531859 tempest-VolumeDependencyTests-693181165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-dc1243bb-baf5-4d69-b2a0-d945e1733c58" returned: 0 in 0.492s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-32e74ca1-ae04-4f63-b549-ac89e7531859 tempest-VolumeDependencyTests-693181165 None] Lock "cinder-quobyte-dc1243bb-baf5-4d69-b2a0-d945e1733c58" released by "delete_volume" :: held 1.298s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-32e74ca1-ae04-4f63-b549-ac89e7531859 tempest-VolumeDependencyTests-693181165 None] Created reservations ['72c89d47-3534-4e3e-a175-03f788b36c63', '8c3b800a-59d2-45b7-8934-1135c96bb20a', 'c26b9ce2-f764-403c-b9c1-bf09d7f519e8', '85f3e160-ac1d-45a7-ba2e-3f474ff749a0'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-32e74ca1-ae04-4f63-b549-ac89e7531859 tempest-VolumeDependencyTests-693181165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-32e74ca1-ae04-4f63-b549-ac89e7531859 tempest-VolumeDependencyTests-693181165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-32e74ca1-ae04-4f63-b549-ac89e7531859 tempest-VolumeDependencyTests-693181165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-32e74ca1-ae04-4f63-b549-ac89e7531859 tempest-VolumeDependencyTests-693181165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-32e74ca1-ae04-4f63-b549-ac89e7531859 tempest-VolumeDependencyTests-693181165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-32e74ca1-ae04-4f63-b549-ac89e7531859 tempest-VolumeDependencyTests-693181165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:21 devstack sudo[88408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:11:21 devstack sudo[88408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:21 devstack sudo[88399]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5c3b800d-959d-4dbd-8340-3e2fa56c71d3 tempest-VolumesGetTest-1188070236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-2b06ce6c-11d7-41ab-aaa8-51bbe1b82058" returned: 0 in 0.570s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-5c3b800d-959d-4dbd-8340-3e2fa56c71d3 tempest-VolumesGetTest-1188070236 None] <== create_volume: return (1345ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-5c3b800d-959d-4dbd-8340-3e2fa56c71d3 tempest-VolumesGetTest-1188070236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.349s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-b03ac880-f65e-4af4-a39e-67c6a8d51d48 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.176s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-b03ac880-f65e-4af4-a39e-67c6a8d51d48 tempest-CreateVolumesFromSnapshotTest-2121410921 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:11:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2016283387',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=feeca0e5-81b7-4b60-ab20-d453e814601e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eebe9fc76d38432d93ee1792de21d1d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:11:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:11:21Z,use_quota=True,user_id='d6eb8d03b80141129e3905dedb67c44d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-b03ac880-f65e-4af4-a39e-67c6a8d51d48 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Creating volume feeca0e5-81b7-4b60-ab20-d453e814601e {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-b03ac880-f65e-4af4-a39e-67c6a8d51d48 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-b03ac880-f65e-4af4-a39e-67c6a8d51d48 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-b03ac880-f65e-4af4-a39e-67c6a8d51d48 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-b03ac880-f65e-4af4-a39e-67c6a8d51d48 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-b03ac880-f65e-4af4-a39e-67c6a8d51d48 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-b03ac880-f65e-4af4-a39e-67c6a8d51d48 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:11:21 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-b03ac880-f65e-4af4-a39e-67c6a8d51d48 tempest-CreateVolumesFromSnapshotTest-2121410921 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b03ac880-f65e-4af4-a39e-67c6a8d51d48 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-feeca0e5-81b7-4b60-ab20-d453e814601e 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:21 devstack sudo[88410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-feeca0e5-81b7-4b60-ab20-d453e814601e 1073741824
Apr 15 20:11:21 devstack sudo[88410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG cinder.volume.volume_utils [None req-5c3b800d-959d-4dbd-8340-3e2fa56c71d3 tempest-VolumesGetTest-1188070236 None] Attempting download of 565a23e3-dcfa-4a62-b361-219578b0cd92 ((None, [{'url': 'file:///opt/stack/data/glance/images/565a23e3-dcfa-4a62-b361-219578b0cd92', 'metadata': {}}])) to volume 2b06ce6c-11d7-41ab-aaa8-51bbe1b82058. {{(pid=82646) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f88667-d2c7-4575-86b9-4f1a9519032e]: (4, 'raw') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:11:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5c3b800d-959d-4dbd-8340-3e2fa56c71d3 tempest-VolumesGetTest-1188070236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_565a23e3-dcfa-4a62-b361-219578b0cd92_kb11_3jj {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:22 devstack sudo[88412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_565a23e3-dcfa-4a62-b361-219578b0cd92_kb11_3jj
Apr 15 20:11:22 devstack sudo[88412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:22 devstack sudo[88404]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-0d15bb04-6e46-4974-b51f-a205996c0811 tempest-VolumesActionsTest-2098528605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0662c53b-499b-4bbe-81f5-f0f0c75c1217" returned: 0 in 0.467s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:22 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-0d15bb04-6e46-4974-b51f-a205996c0811 tempest-VolumesActionsTest-2098528605 None] Lock "cinder-quobyte-0662c53b-499b-4bbe-81f5-f0f0c75c1217" released by "delete_volume" :: held 1.115s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:11:22 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-0d15bb04-6e46-4974-b51f-a205996c0811 tempest-VolumesActionsTest-2098528605 None] Created reservations ['3b4ded16-0ece-422a-9936-fa150e0860ad', 'c5849ff3-b326-4080-b05c-5180e95c45c1', 'c7c7096d-2306-4417-a8b2-cb109fc64223', '22d6b313-3648-4258-99bb-05d525efb59e'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:11:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-0d15bb04-6e46-4974-b51f-a205996c0811 tempest-VolumesActionsTest-2098528605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-0d15bb04-6e46-4974-b51f-a205996c0811 tempest-VolumesActionsTest-2098528605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:22 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-0d15bb04-6e46-4974-b51f-a205996c0811 tempest-VolumesActionsTest-2098528605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:11:22 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-0d15bb04-6e46-4974-b51f-a205996c0811 tempest-VolumesActionsTest-2098528605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:11:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-0d15bb04-6e46-4974-b51f-a205996c0811 tempest-VolumesActionsTest-2098528605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-0d15bb04-6e46-4974-b51f-a205996c0811 tempest-VolumesActionsTest-2098528605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:22 devstack sudo[88415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:11:22 devstack sudo[88415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:22 devstack sudo[88408]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-32e74ca1-ae04-4f63-b549-ac89e7531859 tempest-VolumeDependencyTests-693181165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.532s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:22 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-32e74ca1-ae04-4f63-b549-ac89e7531859 tempest-VolumeDependencyTests-693181165 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:11:22 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-32e74ca1-ae04-4f63-b549-ac89e7531859 tempest-VolumeDependencyTests-693181165 None] Deleted volume successfully.
Apr 15 20:11:22 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-32e74ca1-ae04-4f63-b549-ac89e7531859 tempest-VolumeDependencyTests-693181165 None] Lock "cinder-dc1243bb-baf5-4d69-b2a0-d945e1733c58-delete_volume" released by "delete_volume" :: held 1.959s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:11:22 devstack sudo[88412]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5c3b800d-959d-4dbd-8340-3e2fa56c71d3 tempest-VolumesGetTest-1188070236 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_565a23e3-dcfa-4a62-b361-219578b0cd92_kb11_3jj" returned: 0 in 0.497s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5c3b800d-959d-4dbd-8340-3e2fa56c71d3 tempest-VolumesGetTest-1188070236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_565a23e3-dcfa-4a62-b361-219578b0cd92_kb11_3jj {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:22 devstack sudo[88410]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b03ac880-f65e-4af4-a39e-67c6a8d51d48 tempest-CreateVolumesFromSnapshotTest-2121410921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-feeca0e5-81b7-4b60-ab20-d453e814601e 1073741824" returned: 0 in 0.577s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b03ac880-f65e-4af4-a39e-67c6a8d51d48 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-feeca0e5-81b7-4b60-ab20-d453e814601e {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:22 devstack sudo[88423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_565a23e3-dcfa-4a62-b361-219578b0cd92_kb11_3jj
Apr 15 20:11:22 devstack sudo[88424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-feeca0e5-81b7-4b60-ab20-d453e814601e
Apr 15 20:11:22 devstack sudo[88423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:22 devstack sudo[88424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:22 devstack sudo[88415]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-0d15bb04-6e46-4974-b51f-a205996c0811 tempest-VolumesActionsTest-2098528605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.558s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:22 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-0d15bb04-6e46-4974-b51f-a205996c0811 tempest-VolumesActionsTest-2098528605 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:11:22 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-0d15bb04-6e46-4974-b51f-a205996c0811 tempest-VolumesActionsTest-2098528605 None] Deleted volume successfully.
Apr 15 20:11:22 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-0d15bb04-6e46-4974-b51f-a205996c0811 tempest-VolumesActionsTest-2098528605 None] Lock "cinder-0662c53b-499b-4bbe-81f5-f0f0c75c1217-delete_volume" released by "delete_volume" :: held 1.809s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:11:22 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-cac21c5d-fab9-48ed-9594-2caa508315e8 tempest-VolumeDependencyTests-693181165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:11:22 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-cac21c5d-fab9-48ed-9594-2caa508315e8 tempest-VolumeDependencyTests-693181165 None] Flow 'volume_create_manager' (fe5ea482-d199-4039-ad53-448f9ccce017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:11:22 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-cac21c5d-fab9-48ed-9594-2caa508315e8 tempest-VolumeDependencyTests-693181165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af904900-bfa8-4e28-aea2-84439070da7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:22 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-cac21c5d-fab9-48ed-9594-2caa508315e8 tempest-VolumeDependencyTests-693181165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af904900-bfa8-4e28-aea2-84439070da7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:11:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-928895942',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2665a01-77ba-4bca-a73d-eef01fc39c28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9003f754c2ca4640a792c44fe89d47cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:11:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:11:23Z,use_quota=True,user_id='18ac03d032214d0c8ed2876217eaad94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:22 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-cac21c5d-fab9-48ed-9594-2caa508315e8 tempest-VolumeDependencyTests-693181165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fe22d8f-df1c-4439-abb3-b25f5a634d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:22 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-cac21c5d-fab9-48ed-9594-2caa508315e8 tempest-VolumeDependencyTests-693181165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fe22d8f-df1c-4439-abb3-b25f5a634d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:22 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-cac21c5d-fab9-48ed-9594-2caa508315e8 tempest-VolumeDependencyTests-693181165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffac9ac1-3ce6-47a4-8c8f-13e6c3b94891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:22 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-cac21c5d-fab9-48ed-9594-2caa508315e8 tempest-VolumeDependencyTests-693181165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffac9ac1-3ce6-47a4-8c8f-13e6c3b94891) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2665a01-77ba-4bca-a73d-eef01fc39c28', 'volume_name': 'volume-c2665a01-77ba-4bca-a73d-eef01fc39c28', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:22 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-cac21c5d-fab9-48ed-9594-2caa508315e8 tempest-VolumeDependencyTests-693181165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (612e4edf-829d-47bd-9485-4f394df3f30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:22 devstack sudo[88424]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:22 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-cac21c5d-fab9-48ed-9594-2caa508315e8 tempest-VolumeDependencyTests-693181165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (612e4edf-829d-47bd-9485-4f394df3f30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:22 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-cac21c5d-fab9-48ed-9594-2caa508315e8 tempest-VolumeDependencyTests-693181165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc0fafc0-5ba9-4fab-807e-6ed02aacf61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:22 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-cac21c5d-fab9-48ed-9594-2caa508315e8 tempest-VolumeDependencyTests-693181165 None] Volume c2665a01-77ba-4bca-a73d-eef01fc39c28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2665a01-77ba-4bca-a73d-eef01fc39c28', 'volume_size': 1}
Apr 15 20:11:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-cac21c5d-fab9-48ed-9594-2caa508315e8 tempest-VolumeDependencyTests-693181165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b03ac880-f65e-4af4-a39e-67c6a8d51d48 tempest-CreateVolumesFromSnapshotTest-2121410921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-feeca0e5-81b7-4b60-ab20-d453e814601e" returned: 0 in 0.466s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:22 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-b03ac880-f65e-4af4-a39e-67c6a8d51d48 tempest-CreateVolumesFromSnapshotTest-2121410921 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:11:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-b03ac880-f65e-4af4-a39e-67c6a8d51d48 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-37effb8a-acb3-49ba-847f-f9a51c024301 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.059s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:22 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-37effb8a-acb3-49ba-847f-f9a51c024301 tempest-CreateVolumesFromSnapshotTest-2121410921 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:11:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1994067381',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6321df1e-e37c-423e-b3d4-f2cb2cf0dc08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eebe9fc76d38432d93ee1792de21d1d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:11:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:11:21Z,use_quota=True,user_id='d6eb8d03b80141129e3905dedb67c44d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:11:22 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-37effb8a-acb3-49ba-847f-f9a51c024301 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Creating volume 6321df1e-e37c-423e-b3d4-f2cb2cf0dc08 {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:11:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-37effb8a-acb3-49ba-847f-f9a51c024301 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-37effb8a-acb3-49ba-847f-f9a51c024301 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:22 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-37effb8a-acb3-49ba-847f-f9a51c024301 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:11:22 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-37effb8a-acb3-49ba-847f-f9a51c024301 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:11:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-37effb8a-acb3-49ba-847f-f9a51c024301 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:22 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-37effb8a-acb3-49ba-847f-f9a51c024301 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:11:22 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-37effb8a-acb3-49ba-847f-f9a51c024301 tempest-CreateVolumesFromSnapshotTest-2121410921 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:11:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-37effb8a-acb3-49ba-847f-f9a51c024301 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6321df1e-e37c-423e-b3d4-f2cb2cf0dc08 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:23 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b03ac880-f65e-4af4-a39e-67c6a8d51d48 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bd89d10-3e0f-43b0-96fe-d8e5593c7818) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-feeca0e5-81b7-4b60-ab20-d453e814601e', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:23 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b03ac880-f65e-4af4-a39e-67c6a8d51d48 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faa943d8-042e-4063-93bc-b52b32314e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:23 devstack sudo[88431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6321df1e-e37c-423e-b3d4-f2cb2cf0dc08 1073741824
Apr 15 20:11:23 devstack sudo[88431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:23 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-b03ac880-f65e-4af4-a39e-67c6a8d51d48 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Volume volume-feeca0e5-81b7-4b60-ab20-d453e814601e (feeca0e5-81b7-4b60-ab20-d453e814601e): created successfully
Apr 15 20:11:23 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b03ac880-f65e-4af4-a39e-67c6a8d51d48 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faa943d8-042e-4063-93bc-b52b32314e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:23 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b03ac880-f65e-4af4-a39e-67c6a8d51d48 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Flow 'volume_create_manager' (07700e73-60e8-4657-8348-392590bd287e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:11:23 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-b03ac880-f65e-4af4-a39e-67c6a8d51d48 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Created volume successfully.
Apr 15 20:11:23 devstack sudo[88423]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:23 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5c3b800d-959d-4dbd-8340-3e2fa56c71d3 tempest-VolumesGetTest-1188070236 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_565a23e3-dcfa-4a62-b361-219578b0cd92_kb11_3jj" returned: 1 in 0.596s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:23 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5c3b800d-959d-4dbd-8340-3e2fa56c71d3 tempest-VolumesGetTest-1188070236 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_565a23e3-dcfa-4a62-b361-219578b0cd92_kb11_3jj' failed. Not Retrying. {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 20:11:23 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[5efc6d51-bd14-4782-8ed2-e9d19311a7c6]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:11:23 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5c3b800d-959d-4dbd-8340-3e2fa56c71d3 tempest-VolumesGetTest-1188070236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_565a23e3-dcfa-4a62-b361-219578b0cd92_zxgu5f4adevstack@QuobyteHD {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:23 devstack sudo[88433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_565a23e3-dcfa-4a62-b361-219578b0cd92_zxgu5f4adevstack@QuobyteHD
Apr 15 20:11:23 devstack sudo[88433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:23 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-be8b9b8c-aa32-4a71-9a5a-639d3dc3f5b7 tempest-VolumesActionsTest-1438461382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:11:23 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-be8b9b8c-aa32-4a71-9a5a-639d3dc3f5b7 tempest-VolumesActionsTest-1438461382 None] Flow 'volume_create_manager' (c06b801e-6012-4f06-a5be-15525b49f63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:11:23 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-be8b9b8c-aa32-4a71-9a5a-639d3dc3f5b7 tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3620a6f0-bf12-4863-973b-042e21a2542d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:23 devstack sudo[88431]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:23 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-be8b9b8c-aa32-4a71-9a5a-639d3dc3f5b7 tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3620a6f0-bf12-4863-973b-042e21a2542d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:11:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-806268686',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89344b46-a9f4-41f1-9578-fa2c97c004b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df37bd8c7f7a4cea8e7e0beb744ae494',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:11:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:11:23Z,use_quota=True,user_id='51042bd29b7a4a579be7666e3269ba93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:23 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-be8b9b8c-aa32-4a71-9a5a-639d3dc3f5b7 tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f5c66b3-6526-4d1f-b818-354beff1d181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:23 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-be8b9b8c-aa32-4a71-9a5a-639d3dc3f5b7 tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f5c66b3-6526-4d1f-b818-354beff1d181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:23 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-be8b9b8c-aa32-4a71-9a5a-639d3dc3f5b7 tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeb2c525-f275-498c-9d4b-ceb814d49fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:23 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-be8b9b8c-aa32-4a71-9a5a-639d3dc3f5b7 tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeb2c525-f275-498c-9d4b-ceb814d49fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89344b46-a9f4-41f1-9578-fa2c97c004b6', 'volume_name': 'volume-89344b46-a9f4-41f1-9578-fa2c97c004b6', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:23 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-be8b9b8c-aa32-4a71-9a5a-639d3dc3f5b7 tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed27fe88-7b96-49f6-abde-734b9a7a2671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:23 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-be8b9b8c-aa32-4a71-9a5a-639d3dc3f5b7 tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed27fe88-7b96-49f6-abde-734b9a7a2671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:23 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-be8b9b8c-aa32-4a71-9a5a-639d3dc3f5b7 tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1b8dff5-7e26-48c9-b257-d22ef71bbb4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:23 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-be8b9b8c-aa32-4a71-9a5a-639d3dc3f5b7 tempest-VolumesActionsTest-1438461382 None] Volume 89344b46-a9f4-41f1-9578-fa2c97c004b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89344b46-a9f4-41f1-9578-fa2c97c004b6', 'volume_size': 1}
Apr 15 20:11:23 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-be8b9b8c-aa32-4a71-9a5a-639d3dc3f5b7 tempest-VolumesActionsTest-1438461382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:23 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-37effb8a-acb3-49ba-847f-f9a51c024301 tempest-CreateVolumesFromSnapshotTest-2121410921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6321df1e-e37c-423e-b3d4-f2cb2cf0dc08 1073741824" returned: 0 in 0.557s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:23 devstack sudo[88433]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:23 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5c3b800d-959d-4dbd-8340-3e2fa56c71d3 tempest-VolumesGetTest-1188070236 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_565a23e3-dcfa-4a62-b361-219578b0cd92_zxgu5f4adevstack@QuobyteHD" returned: 0 in 0.503s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:23 devstack cinder-volume[82646]: DEBUG cinder.image.image_utils [None req-5c3b800d-959d-4dbd-8340-3e2fa56c71d3 tempest-VolumesGetTest-1188070236 None] 565a23e3-dcfa-4a62-b361-219578b0cd92 was qcow2, converting to raw {{(pid=82646) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 15 20:11:23 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5c3b800d-959d-4dbd-8340-3e2fa56c71d3 tempest-VolumesGetTest-1188070236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_565a23e3-dcfa-4a62-b361-219578b0cd92_zxgu5f4adevstack@QuobyteHD /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-2b06ce6c-11d7-41ab-aaa8-51bbe1b82058 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:23 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-37effb8a-acb3-49ba-847f-f9a51c024301 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6321df1e-e37c-423e-b3d4-f2cb2cf0dc08 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:23 devstack sudo[88441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_565a23e3-dcfa-4a62-b361-219578b0cd92_zxgu5f4adevstack@QuobyteHD /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-2b06ce6c-11d7-41ab-aaa8-51bbe1b82058
Apr 15 20:11:23 devstack sudo[88441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:23 devstack sudo[88442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6321df1e-e37c-423e-b3d4-f2cb2cf0dc08
Apr 15 20:11:23 devstack sudo[88442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:24 devstack sudo[88442]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-37effb8a-acb3-49ba-847f-f9a51c024301 tempest-CreateVolumesFromSnapshotTest-2121410921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6321df1e-e37c-423e-b3d4-f2cb2cf0dc08" returned: 0 in 0.458s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:24 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-37effb8a-acb3-49ba-847f-f9a51c024301 tempest-CreateVolumesFromSnapshotTest-2121410921 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:11:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-37effb8a-acb3-49ba-847f-f9a51c024301 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-fd5b2fb9-dcad-45ca-b3e7-fbcd6ee795d2 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.874s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:24 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-fd5b2fb9-dcad-45ca-b3e7-fbcd6ee795d2 tempest-CreateVolumesFromSnapshotTest-2121410921 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:11:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-45251737',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=998b76ac-0004-4b17-8559-e88cd297e712,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eebe9fc76d38432d93ee1792de21d1d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:11:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:11:21Z,use_quota=True,user_id='d6eb8d03b80141129e3905dedb67c44d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:11:24 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-fd5b2fb9-dcad-45ca-b3e7-fbcd6ee795d2 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Creating volume 998b76ac-0004-4b17-8559-e88cd297e712 {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:11:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-fd5b2fb9-dcad-45ca-b3e7-fbcd6ee795d2 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-fd5b2fb9-dcad-45ca-b3e7-fbcd6ee795d2 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:24 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-fd5b2fb9-dcad-45ca-b3e7-fbcd6ee795d2 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:11:24 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-fd5b2fb9-dcad-45ca-b3e7-fbcd6ee795d2 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:11:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-fd5b2fb9-dcad-45ca-b3e7-fbcd6ee795d2 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:24 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-fd5b2fb9-dcad-45ca-b3e7-fbcd6ee795d2 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:11:24 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-fd5b2fb9-dcad-45ca-b3e7-fbcd6ee795d2 tempest-CreateVolumesFromSnapshotTest-2121410921 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:11:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-fd5b2fb9-dcad-45ca-b3e7-fbcd6ee795d2 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-998b76ac-0004-4b17-8559-e88cd297e712 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:24 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-37effb8a-acb3-49ba-847f-f9a51c024301 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (998a7dbd-4e72-425e-a675-3a5fcb560700) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6321df1e-e37c-423e-b3d4-f2cb2cf0dc08', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:24 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-37effb8a-acb3-49ba-847f-f9a51c024301 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c30c7c4-aab6-4b3b-a944-5cb0355d377f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:24 devstack sudo[88458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-998b76ac-0004-4b17-8559-e88cd297e712 1073741824
Apr 15 20:11:24 devstack sudo[88458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:24 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-37effb8a-acb3-49ba-847f-f9a51c024301 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Volume volume-6321df1e-e37c-423e-b3d4-f2cb2cf0dc08 (6321df1e-e37c-423e-b3d4-f2cb2cf0dc08): created successfully
Apr 15 20:11:24 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-37effb8a-acb3-49ba-847f-f9a51c024301 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c30c7c4-aab6-4b3b-a944-5cb0355d377f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:24 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-37effb8a-acb3-49ba-847f-f9a51c024301 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Flow 'volume_create_manager' (52cfdfaa-5167-4012-8417-9676abaa83e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:11:24 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-37effb8a-acb3-49ba-847f-f9a51c024301 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Created volume successfully.
Apr 15 20:11:24 devstack sudo[88441]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5c3b800d-959d-4dbd-8340-3e2fa56c71d3 tempest-VolumesGetTest-1188070236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_565a23e3-dcfa-4a62-b361-219578b0cd92_zxgu5f4adevstack@QuobyteHD /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-2b06ce6c-11d7-41ab-aaa8-51bbe1b82058" returned: 0 in 0.857s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:24 devstack cinder-volume[82646]: DEBUG cinder.image.image_utils [None req-5c3b800d-959d-4dbd-8340-3e2fa56c71d3 tempest-VolumesGetTest-1188070236 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_565a23e3-dcfa-4a62-b361-219578b0cd92_zxgu5f4adevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-2b06ce6c-11d7-41ab-aaa8-51bbe1b82058 {{(pid=82646) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 20:11:24 devstack cinder-volume[82646]: INFO cinder.image.image_utils [None req-5c3b800d-959d-4dbd-8340-3e2fa56c71d3 tempest-VolumesGetTest-1188070236 None] Converted 112.00 MB image at 112.00 MB/s
Apr 15 20:11:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5c3b800d-959d-4dbd-8340-3e2fa56c71d3 tempest-VolumesGetTest-1188070236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-2b06ce6c-11d7-41ab-aaa8-51bbe1b82058 1G {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:24 devstack sudo[88460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-2b06ce6c-11d7-41ab-aaa8-51bbe1b82058 1G
Apr 15 20:11:24 devstack sudo[88460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:24 devstack sudo[88458]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-fd5b2fb9-dcad-45ca-b3e7-fbcd6ee795d2 tempest-CreateVolumesFromSnapshotTest-2121410921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-998b76ac-0004-4b17-8559-e88cd297e712 1073741824" returned: 0 in 0.563s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-fd5b2fb9-dcad-45ca-b3e7-fbcd6ee795d2 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-998b76ac-0004-4b17-8559-e88cd297e712 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:24 devstack sudo[88465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-998b76ac-0004-4b17-8559-e88cd297e712
Apr 15 20:11:24 devstack sudo[88465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:24 devstack sudo[88460]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5c3b800d-959d-4dbd-8340-3e2fa56c71d3 tempest-VolumesGetTest-1188070236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-2b06ce6c-11d7-41ab-aaa8-51bbe1b82058 1G" returned: 0 in 0.471s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:24 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ead6bd-f165-44d1-94df-b18a17732e63]: (4, 'raw') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:11:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5c3b800d-959d-4dbd-8340-3e2fa56c71d3 tempest-VolumesGetTest-1188070236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-2b06ce6c-11d7-41ab-aaa8-51bbe1b82058 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:25 devstack sudo[88470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-2b06ce6c-11d7-41ab-aaa8-51bbe1b82058
Apr 15 20:11:25 devstack sudo[88470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:25 devstack sudo[88465]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:25 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-fd5b2fb9-dcad-45ca-b3e7-fbcd6ee795d2 tempest-CreateVolumesFromSnapshotTest-2121410921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-998b76ac-0004-4b17-8559-e88cd297e712" returned: 0 in 0.438s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:25 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-fd5b2fb9-dcad-45ca-b3e7-fbcd6ee795d2 tempest-CreateVolumesFromSnapshotTest-2121410921 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:11:25 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-fd5b2fb9-dcad-45ca-b3e7-fbcd6ee795d2 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:25 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-d210b960-b1a2-46ed-8d42-fadf5262fbd8 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.668s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:25 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-d210b960-b1a2-46ed-8d42-fadf5262fbd8 tempest-CreateVolumesFromSnapshotTest-2121410921 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:11:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-800620976',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b18039d5-5122-4445-8d80-a5e768e72285,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eebe9fc76d38432d93ee1792de21d1d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:11:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:11:21Z,use_quota=True,user_id='d6eb8d03b80141129e3905dedb67c44d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:11:25 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-d210b960-b1a2-46ed-8d42-fadf5262fbd8 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Creating volume b18039d5-5122-4445-8d80-a5e768e72285 {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:11:25 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-d210b960-b1a2-46ed-8d42-fadf5262fbd8 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:25 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-d210b960-b1a2-46ed-8d42-fadf5262fbd8 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:25 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-d210b960-b1a2-46ed-8d42-fadf5262fbd8 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:11:25 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-d210b960-b1a2-46ed-8d42-fadf5262fbd8 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:11:25 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-d210b960-b1a2-46ed-8d42-fadf5262fbd8 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:25 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-d210b960-b1a2-46ed-8d42-fadf5262fbd8 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:11:25 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-d210b960-b1a2-46ed-8d42-fadf5262fbd8 tempest-CreateVolumesFromSnapshotTest-2121410921 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:11:25 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d210b960-b1a2-46ed-8d42-fadf5262fbd8 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b18039d5-5122-4445-8d80-a5e768e72285 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:25 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-fd5b2fb9-dcad-45ca-b3e7-fbcd6ee795d2 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99c85411-ce72-4dd3-b983-4c935ef4b5ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-998b76ac-0004-4b17-8559-e88cd297e712', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:25 devstack sudo[88473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b18039d5-5122-4445-8d80-a5e768e72285 1073741824
Apr 15 20:11:25 devstack sudo[88473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:25 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-fd5b2fb9-dcad-45ca-b3e7-fbcd6ee795d2 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71bbd7c3-0671-43bf-992d-d6b5b6d759df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:25 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-fd5b2fb9-dcad-45ca-b3e7-fbcd6ee795d2 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Volume volume-998b76ac-0004-4b17-8559-e88cd297e712 (998b76ac-0004-4b17-8559-e88cd297e712): created successfully
Apr 15 20:11:25 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-fd5b2fb9-dcad-45ca-b3e7-fbcd6ee795d2 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71bbd7c3-0671-43bf-992d-d6b5b6d759df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:25 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-fd5b2fb9-dcad-45ca-b3e7-fbcd6ee795d2 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Flow 'volume_create_manager' (853b6e7f-3857-49c5-9ca0-ed9aa11f76e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:11:25 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-fd5b2fb9-dcad-45ca-b3e7-fbcd6ee795d2 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Created volume successfully.
Apr 15 20:11:25 devstack sudo[88470]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:25 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5c3b800d-959d-4dbd-8340-3e2fa56c71d3 tempest-VolumesGetTest-1188070236 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-2b06ce6c-11d7-41ab-aaa8-51bbe1b82058" returned: 0 in 0.460s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:25 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5c3b800d-959d-4dbd-8340-3e2fa56c71d3 tempest-VolumesGetTest-1188070236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-2b06ce6c-11d7-41ab-aaa8-51bbe1b82058 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:25 devstack sudo[88477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-2b06ce6c-11d7-41ab-aaa8-51bbe1b82058
Apr 15 20:11:25 devstack sudo[88477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:25 devstack sudo[88473]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:25 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d210b960-b1a2-46ed-8d42-fadf5262fbd8 tempest-CreateVolumesFromSnapshotTest-2121410921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b18039d5-5122-4445-8d80-a5e768e72285 1073741824" returned: 0 in 0.479s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:25 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d210b960-b1a2-46ed-8d42-fadf5262fbd8 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b18039d5-5122-4445-8d80-a5e768e72285 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:25 devstack sudo[88482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b18039d5-5122-4445-8d80-a5e768e72285
Apr 15 20:11:25 devstack sudo[88482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:25 devstack sudo[88477]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:25 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5c3b800d-959d-4dbd-8340-3e2fa56c71d3 tempest-VolumesGetTest-1188070236 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-2b06ce6c-11d7-41ab-aaa8-51bbe1b82058" returned: 1 in 0.519s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:25 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5c3b800d-959d-4dbd-8340-3e2fa56c71d3 tempest-VolumesGetTest-1188070236 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-2b06ce6c-11d7-41ab-aaa8-51bbe1b82058' failed. Not Retrying. {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 20:11:25 devstack cinder-volume[82646]: DEBUG cinder.volume.volume_utils [None req-5c3b800d-959d-4dbd-8340-3e2fa56c71d3 tempest-VolumesGetTest-1188070236 None] Downloaded image 565a23e3-dcfa-4a62-b361-219578b0cd92 ((None, [{'url': 'file:///opt/stack/data/glance/images/565a23e3-dcfa-4a62-b361-219578b0cd92', 'metadata': {}}])) to volume 2b06ce6c-11d7-41ab-aaa8-51bbe1b82058 successfully. {{(pid=82646) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 15 20:11:25 devstack cinder-volume[82646]: DEBUG cinder.image.image_utils [None req-5c3b800d-959d-4dbd-8340-3e2fa56c71d3 tempest-VolumesGetTest-1188070236 None] Temporary image 565a23e3-dcfa-4a62-b361-219578b0cd92 for user d7a23dd5ade7439ca285e5922adb8785 is deleted. {{(pid=82646) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 15 20:11:25 devstack cinder-volume[82646]: DEBUG cinder.volume.volume_utils [None req-5c3b800d-959d-4dbd-8340-3e2fa56c71d3 tempest-VolumesGetTest-1188070236 None] Marking volume 2b06ce6c-11d7-41ab-aaa8-51bbe1b82058 as bootable. {{(pid=82646) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 15 20:11:25 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c3b800d-959d-4dbd-8340-3e2fa56c71d3 tempest-VolumesGetTest-1188070236 None] Copying metadata from image 565a23e3-dcfa-4a62-b361-219578b0cd92 to 2b06ce6c-11d7-41ab-aaa8-51bbe1b82058. {{(pid=82646) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 15 20:11:25 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c3b800d-959d-4dbd-8340-3e2fa56c71d3 tempest-VolumesGetTest-1188070236 None] Creating volume glance metadata for volume 2b06ce6c-11d7-41ab-aaa8-51bbe1b82058 backed by image 565a23e3-dcfa-4a62-b361-219578b0cd92 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '565a23e3-dcfa-4a62-b361-219578b0cd92', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82646) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 15 20:11:25 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-5c3b800d-959d-4dbd-8340-3e2fa56c71d3 tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8acde680-abe4-4e0a-9366-eb54543c54d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b06ce6c-11d7-41ab-aaa8-51bbe1b82058', 'volume_size': 1, 'image_id': '565a23e3-dcfa-4a62-b361-219578b0cd92', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/565a23e3-dcfa-4a62-b361-219578b0cd92', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '27d9c820db6c4abea4324fe8ea0f90e6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '565a23e3-dcfa-4a62-b361-219578b0cd92', 'created_at': datetime.datetime(2026, 4, 15, 18, 0, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 18, 0, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/565a23e3-dcfa-4a62-b361-219578b0cd92/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe167eaba60>}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:25 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-5c3b800d-959d-4dbd-8340-3e2fa56c71d3 tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04aa1bfb-e3de-4b32-96ba-7f51711c89ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:25 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-5c3b800d-959d-4dbd-8340-3e2fa56c71d3 tempest-VolumesGetTest-1188070236 None] Volume volume-2b06ce6c-11d7-41ab-aaa8-51bbe1b82058 (2b06ce6c-11d7-41ab-aaa8-51bbe1b82058): created successfully
Apr 15 20:11:25 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-5c3b800d-959d-4dbd-8340-3e2fa56c71d3 tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04aa1bfb-e3de-4b32-96ba-7f51711c89ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:25 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-5c3b800d-959d-4dbd-8340-3e2fa56c71d3 tempest-VolumesGetTest-1188070236 None] Flow 'volume_create_manager' (c3732ef7-8db4-4259-b75d-102fd5fe90eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:11:26 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-5c3b800d-959d-4dbd-8340-3e2fa56c71d3 tempest-VolumesGetTest-1188070236 None] Created volume successfully.
Apr 15 20:11:26 devstack sudo[88482]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:26 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d210b960-b1a2-46ed-8d42-fadf5262fbd8 tempest-CreateVolumesFromSnapshotTest-2121410921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b18039d5-5122-4445-8d80-a5e768e72285" returned: 0 in 0.453s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:26 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-d210b960-b1a2-46ed-8d42-fadf5262fbd8 tempest-CreateVolumesFromSnapshotTest-2121410921 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:11:26 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-d210b960-b1a2-46ed-8d42-fadf5262fbd8 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:26 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-cde66fe2-fcc1-44d0-8888-d29c005a0807 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.413s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:26 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-cde66fe2-fcc1-44d0-8888-d29c005a0807 tempest-CreateVolumesFromSnapshotTest-2121410921 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:11:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-280238100',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b153ebd7-2ba3-4084-b990-a3f36170f9e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eebe9fc76d38432d93ee1792de21d1d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:11:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:11:22Z,use_quota=True,user_id='d6eb8d03b80141129e3905dedb67c44d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:11:26 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-cde66fe2-fcc1-44d0-8888-d29c005a0807 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Creating volume b153ebd7-2ba3-4084-b990-a3f36170f9e8 {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:11:26 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-cde66fe2-fcc1-44d0-8888-d29c005a0807 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:26 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-cde66fe2-fcc1-44d0-8888-d29c005a0807 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:26 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-cde66fe2-fcc1-44d0-8888-d29c005a0807 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:11:26 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-cde66fe2-fcc1-44d0-8888-d29c005a0807 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:11:26 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-cde66fe2-fcc1-44d0-8888-d29c005a0807 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:26 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-cde66fe2-fcc1-44d0-8888-d29c005a0807 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:11:26 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-cde66fe2-fcc1-44d0-8888-d29c005a0807 tempest-CreateVolumesFromSnapshotTest-2121410921 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:11:26 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-cde66fe2-fcc1-44d0-8888-d29c005a0807 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b153ebd7-2ba3-4084-b990-a3f36170f9e8 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:26 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d210b960-b1a2-46ed-8d42-fadf5262fbd8 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ceaae09-6c22-4d99-8c62-67103a6d37e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b18039d5-5122-4445-8d80-a5e768e72285', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:26 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d210b960-b1a2-46ed-8d42-fadf5262fbd8 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cf20e4d-c681-4bb2-9c2b-3fae32b8f7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:26 devstack sudo[88489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b153ebd7-2ba3-4084-b990-a3f36170f9e8 1073741824
Apr 15 20:11:26 devstack sudo[88489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:26 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-d210b960-b1a2-46ed-8d42-fadf5262fbd8 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Volume volume-b18039d5-5122-4445-8d80-a5e768e72285 (b18039d5-5122-4445-8d80-a5e768e72285): created successfully
Apr 15 20:11:26 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d210b960-b1a2-46ed-8d42-fadf5262fbd8 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cf20e4d-c681-4bb2-9c2b-3fae32b8f7de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:26 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d210b960-b1a2-46ed-8d42-fadf5262fbd8 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Flow 'volume_create_manager' (60fabf49-7c78-40a2-82a1-30072ae2cae6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:11:26 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-d210b960-b1a2-46ed-8d42-fadf5262fbd8 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Created volume successfully.
Apr 15 20:11:26 devstack sudo[88489]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:26 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-cde66fe2-fcc1-44d0-8888-d29c005a0807 tempest-CreateVolumesFromSnapshotTest-2121410921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b153ebd7-2ba3-4084-b990-a3f36170f9e8 1073741824" returned: 0 in 0.461s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:26 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-cde66fe2-fcc1-44d0-8888-d29c005a0807 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b153ebd7-2ba3-4084-b990-a3f36170f9e8 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:26 devstack sudo[88494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b153ebd7-2ba3-4084-b990-a3f36170f9e8
Apr 15 20:11:26 devstack sudo[88494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:26 devstack sudo[88494]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:26 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-cde66fe2-fcc1-44d0-8888-d29c005a0807 tempest-CreateVolumesFromSnapshotTest-2121410921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b153ebd7-2ba3-4084-b990-a3f36170f9e8" returned: 0 in 0.428s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:26 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-cde66fe2-fcc1-44d0-8888-d29c005a0807 tempest-CreateVolumesFromSnapshotTest-2121410921 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:11:26 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-cde66fe2-fcc1-44d0-8888-d29c005a0807 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:26 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-cac21c5d-fab9-48ed-9594-2caa508315e8 tempest-VolumeDependencyTests-693181165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:26 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-cac21c5d-fab9-48ed-9594-2caa508315e8 tempest-VolumeDependencyTests-693181165 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:11:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-928895942',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2665a01-77ba-4bca-a73d-eef01fc39c28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9003f754c2ca4640a792c44fe89d47cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:11:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:11:23Z,use_quota=True,user_id='18ac03d032214d0c8ed2876217eaad94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:11:26 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-cac21c5d-fab9-48ed-9594-2caa508315e8 tempest-VolumeDependencyTests-693181165 None] Creating volume c2665a01-77ba-4bca-a73d-eef01fc39c28 {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:11:26 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-cac21c5d-fab9-48ed-9594-2caa508315e8 tempest-VolumeDependencyTests-693181165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:26 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-cac21c5d-fab9-48ed-9594-2caa508315e8 tempest-VolumeDependencyTests-693181165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:26 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-cac21c5d-fab9-48ed-9594-2caa508315e8 tempest-VolumeDependencyTests-693181165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:11:26 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-cac21c5d-fab9-48ed-9594-2caa508315e8 tempest-VolumeDependencyTests-693181165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:11:26 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-cac21c5d-fab9-48ed-9594-2caa508315e8 tempest-VolumeDependencyTests-693181165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:26 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-cac21c5d-fab9-48ed-9594-2caa508315e8 tempest-VolumeDependencyTests-693181165 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:11:26 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-cac21c5d-fab9-48ed-9594-2caa508315e8 tempest-VolumeDependencyTests-693181165 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:11:26 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-cac21c5d-fab9-48ed-9594-2caa508315e8 tempest-VolumeDependencyTests-693181165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2665a01-77ba-4bca-a73d-eef01fc39c28 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:27 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-cde66fe2-fcc1-44d0-8888-d29c005a0807 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e8197d2-4c2a-4937-b77d-13094a074a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b153ebd7-2ba3-4084-b990-a3f36170f9e8', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:27 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-cde66fe2-fcc1-44d0-8888-d29c005a0807 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15d82465-0526-4704-93cd-749fbb8b78aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:27 devstack sudo[88497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2665a01-77ba-4bca-a73d-eef01fc39c28 1073741824
Apr 15 20:11:27 devstack sudo[88497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:27 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-cde66fe2-fcc1-44d0-8888-d29c005a0807 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Volume volume-b153ebd7-2ba3-4084-b990-a3f36170f9e8 (b153ebd7-2ba3-4084-b990-a3f36170f9e8): created successfully
Apr 15 20:11:27 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-cde66fe2-fcc1-44d0-8888-d29c005a0807 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15d82465-0526-4704-93cd-749fbb8b78aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:27 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-cde66fe2-fcc1-44d0-8888-d29c005a0807 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Flow 'volume_create_manager' (5e5ff289-3654-46f0-bb09-2f46c4fbae7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:11:27 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-cde66fe2-fcc1-44d0-8888-d29c005a0807 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Created volume successfully.
Apr 15 20:11:27 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-34f23738-4796-47a2-b3ef-4e7d9c7a0644 tempest-VolumesGetTest-1188070236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:11:27 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-34f23738-4796-47a2-b3ef-4e7d9c7a0644 tempest-VolumesGetTest-1188070236 None] Flow 'volume_create_manager' (a08da07b-1b24-475a-8d11-3c0be7507f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:11:27 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-34f23738-4796-47a2-b3ef-4e7d9c7a0644 tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a104570-76e5-449d-936f-272400a2940c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:27 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-34f23738-4796-47a2-b3ef-4e7d9c7a0644 tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a104570-76e5-449d-936f-272400a2940c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:11:27Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1149214803',display_name='tempest-VolumesGetTest-Volume-118161730',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c79cf603-7af0-423f-a8ce-6ea9902da89d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fd52c85921a443d92f594a7f2280e9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:11:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:11:27Z,use_quota=True,user_id='d7a23dd5ade7439ca285e5922adb8785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:27 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-34f23738-4796-47a2-b3ef-4e7d9c7a0644 tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31378ca7-4f24-4e69-8d1d-b889151c40f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:27 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-34f23738-4796-47a2-b3ef-4e7d9c7a0644 tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31378ca7-4f24-4e69-8d1d-b889151c40f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:27 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-34f23738-4796-47a2-b3ef-4e7d9c7a0644 tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d3dc251-65e1-4972-a5c6-25dd82fd7266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:27 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-34f23738-4796-47a2-b3ef-4e7d9c7a0644 tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d3dc251-65e1-4972-a5c6-25dd82fd7266) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c79cf603-7af0-423f-a8ce-6ea9902da89d', 'volume_name': 'volume-c79cf603-7af0-423f-a8ce-6ea9902da89d', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:27 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-34f23738-4796-47a2-b3ef-4e7d9c7a0644 tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fd7b96d-e955-495f-babe-647977f684e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:27 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-34f23738-4796-47a2-b3ef-4e7d9c7a0644 tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fd7b96d-e955-495f-babe-647977f684e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:27 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-34f23738-4796-47a2-b3ef-4e7d9c7a0644 tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acd83216-2226-46e7-9213-a4f212b3d6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:27 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-34f23738-4796-47a2-b3ef-4e7d9c7a0644 tempest-VolumesGetTest-1188070236 None] Volume c79cf603-7af0-423f-a8ce-6ea9902da89d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c79cf603-7af0-423f-a8ce-6ea9902da89d', 'volume_size': 1}
Apr 15 20:11:27 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-34f23738-4796-47a2-b3ef-4e7d9c7a0644 tempest-VolumesGetTest-1188070236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:27 devstack sudo[88497]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:27 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-cac21c5d-fab9-48ed-9594-2caa508315e8 tempest-VolumeDependencyTests-693181165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2665a01-77ba-4bca-a73d-eef01fc39c28 1073741824" returned: 0 in 0.535s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:27 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-cac21c5d-fab9-48ed-9594-2caa508315e8 tempest-VolumeDependencyTests-693181165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2665a01-77ba-4bca-a73d-eef01fc39c28 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:27 devstack sudo[88502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2665a01-77ba-4bca-a73d-eef01fc39c28
Apr 15 20:11:27 devstack sudo[88502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:27 devstack sudo[88502]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:27 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-cac21c5d-fab9-48ed-9594-2caa508315e8 tempest-VolumeDependencyTests-693181165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2665a01-77ba-4bca-a73d-eef01fc39c28" returned: 0 in 0.418s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:27 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-cac21c5d-fab9-48ed-9594-2caa508315e8 tempest-VolumeDependencyTests-693181165 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:11:27 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-cac21c5d-fab9-48ed-9594-2caa508315e8 tempest-VolumeDependencyTests-693181165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:27 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-be8b9b8c-aa32-4a71-9a5a-639d3dc3f5b7 tempest-VolumesActionsTest-1438461382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.422s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:27 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-be8b9b8c-aa32-4a71-9a5a-639d3dc3f5b7 tempest-VolumesActionsTest-1438461382 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:11:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-806268686',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89344b46-a9f4-41f1-9578-fa2c97c004b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df37bd8c7f7a4cea8e7e0beb744ae494',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:11:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:11:23Z,use_quota=True,user_id='51042bd29b7a4a579be7666e3269ba93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:11:27 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-be8b9b8c-aa32-4a71-9a5a-639d3dc3f5b7 tempest-VolumesActionsTest-1438461382 None] Creating volume 89344b46-a9f4-41f1-9578-fa2c97c004b6 {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:11:27 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-be8b9b8c-aa32-4a71-9a5a-639d3dc3f5b7 tempest-VolumesActionsTest-1438461382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:27 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-be8b9b8c-aa32-4a71-9a5a-639d3dc3f5b7 tempest-VolumesActionsTest-1438461382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:27 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-be8b9b8c-aa32-4a71-9a5a-639d3dc3f5b7 tempest-VolumesActionsTest-1438461382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:11:27 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-be8b9b8c-aa32-4a71-9a5a-639d3dc3f5b7 tempest-VolumesActionsTest-1438461382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:11:27 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-be8b9b8c-aa32-4a71-9a5a-639d3dc3f5b7 tempest-VolumesActionsTest-1438461382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:27 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-be8b9b8c-aa32-4a71-9a5a-639d3dc3f5b7 tempest-VolumesActionsTest-1438461382 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:11:27 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-be8b9b8c-aa32-4a71-9a5a-639d3dc3f5b7 tempest-VolumesActionsTest-1438461382 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:11:27 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-be8b9b8c-aa32-4a71-9a5a-639d3dc3f5b7 tempest-VolumesActionsTest-1438461382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-89344b46-a9f4-41f1-9578-fa2c97c004b6 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:27 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-cac21c5d-fab9-48ed-9594-2caa508315e8 tempest-VolumeDependencyTests-693181165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc0fafc0-5ba9-4fab-807e-6ed02aacf61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2665a01-77ba-4bca-a73d-eef01fc39c28', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:27 devstack sudo[88506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-89344b46-a9f4-41f1-9578-fa2c97c004b6 1073741824
Apr 15 20:11:27 devstack sudo[88506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:28 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-cac21c5d-fab9-48ed-9594-2caa508315e8 tempest-VolumeDependencyTests-693181165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5edc4b98-0b04-460e-854f-1d18bc9e2888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:28 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-cac21c5d-fab9-48ed-9594-2caa508315e8 tempest-VolumeDependencyTests-693181165 None] Volume volume-c2665a01-77ba-4bca-a73d-eef01fc39c28 (c2665a01-77ba-4bca-a73d-eef01fc39c28): created successfully
Apr 15 20:11:28 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-cac21c5d-fab9-48ed-9594-2caa508315e8 tempest-VolumeDependencyTests-693181165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5edc4b98-0b04-460e-854f-1d18bc9e2888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:28 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-cac21c5d-fab9-48ed-9594-2caa508315e8 tempest-VolumeDependencyTests-693181165 None] Flow 'volume_create_manager' (fe5ea482-d199-4039-ad53-448f9ccce017) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:11:28 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-cac21c5d-fab9-48ed-9594-2caa508315e8 tempest-VolumeDependencyTests-693181165 None] Created volume successfully.
Apr 15 20:11:28 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-697e5389-b436-48e8-824c-529ca2bfcbd8 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Acquiring lock "cinder-b153ebd7-2ba3-4084-b990-a3f36170f9e8-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:11:28 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-697e5389-b436-48e8-824c-529ca2bfcbd8 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Lock "cinder-b153ebd7-2ba3-4084-b990-a3f36170f9e8-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:11:28 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-697e5389-b436-48e8-824c-529ca2bfcbd8 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Acquiring lock "cinder-quobyte-b153ebd7-2ba3-4084-b990-a3f36170f9e8" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:11:28 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-697e5389-b436-48e8-824c-529ca2bfcbd8 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Lock "cinder-quobyte-b153ebd7-2ba3-4084-b990-a3f36170f9e8" acquired by "delete_volume" :: waited 0.007s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:11:28 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[004222f0-b888-4ec2-b4aa-f89ee7356cef]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:11:28 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-697e5389-b436-48e8-824c-529ca2bfcbd8 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b153ebd7-2ba3-4084-b990-a3f36170f9e8 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:28 devstack sudo[88508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b153ebd7-2ba3-4084-b990-a3f36170f9e8
Apr 15 20:11:28 devstack sudo[88508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:28 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:11:28 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] Flow 'volume_create_manager' (4e2b6f4c-320f-4e0c-9aae-1fda244e403f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:11:28 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a9a6340-3417-4655-93cd-307b6a7d0523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:28 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a9a6340-3417-4655-93cd-307b6a7d0523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:11:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2131791763',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54bf8d29-4939-4520-9f02-58e05cd5d161,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9003f754c2ca4640a792c44fe89d47cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:11:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=c2665a01-77ba-4bca-a73d-eef01fc39c28,status='creating',terminated_at=None,updated_at=2026-04-15T18:11:28Z,use_quota=True,user_id='18ac03d032214d0c8ed2876217eaad94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:28 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adb723ca-bc49-4f16-970f-ccc164b65d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:28 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adb723ca-bc49-4f16-970f-ccc164b65d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:28 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1e959f4-332b-4393-a9f9-4c5d3563a5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:28 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1e959f4-332b-4393-a9f9-4c5d3563a5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '54bf8d29-4939-4520-9f02-58e05cd5d161', 'volume_name': 'volume-54bf8d29-4939-4520-9f02-58e05cd5d161', 'volume_size': 1, 'source_volid': 'c2665a01-77ba-4bca-a73d-eef01fc39c28', 'source_volstatus': 'available'}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:28 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b7907eb-bc13-4617-a937-88a57b9f7499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:28 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b7907eb-bc13-4617-a937-88a57b9f7499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:28 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ee40006-4f72-4129-84fa-ac64979ef5d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:28 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] Volume 54bf8d29-4939-4520-9f02-58e05cd5d161: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-54bf8d29-4939-4520-9f02-58e05cd5d161', 'volume_size': 1, 'source_volid': 'c2665a01-77ba-4bca-a73d-eef01fc39c28', 'source_volstatus': 'available'}
Apr 15 20:11:28 devstack sudo[88506]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:28 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-be8b9b8c-aa32-4a71-9a5a-639d3dc3f5b7 tempest-VolumesActionsTest-1438461382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-89344b46-a9f4-41f1-9578-fa2c97c004b6 1073741824" returned: 0 in 0.587s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:28 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:28 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-be8b9b8c-aa32-4a71-9a5a-639d3dc3f5b7 tempest-VolumesActionsTest-1438461382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-89344b46-a9f4-41f1-9578-fa2c97c004b6 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:28 devstack sudo[88516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-89344b46-a9f4-41f1-9578-fa2c97c004b6
Apr 15 20:11:28 devstack sudo[88516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:28 devstack sudo[88508]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:28 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-697e5389-b436-48e8-824c-529ca2bfcbd8 tempest-CreateVolumesFromSnapshotTest-2121410921 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b153ebd7-2ba3-4084-b990-a3f36170f9e8" returned: 0 in 0.523s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:28 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-697e5389-b436-48e8-824c-529ca2bfcbd8 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b153ebd7-2ba3-4084-b990-a3f36170f9e8 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:28 devstack sudo[88518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b153ebd7-2ba3-4084-b990-a3f36170f9e8
Apr 15 20:11:28 devstack sudo[88518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:29 devstack sudo[88516]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-be8b9b8c-aa32-4a71-9a5a-639d3dc3f5b7 tempest-VolumesActionsTest-1438461382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-89344b46-a9f4-41f1-9578-fa2c97c004b6" returned: 0 in 0.423s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:29 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-be8b9b8c-aa32-4a71-9a5a-639d3dc3f5b7 tempest-VolumesActionsTest-1438461382 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:11:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-be8b9b8c-aa32-4a71-9a5a-639d3dc3f5b7 tempest-VolumesActionsTest-1438461382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-34f23738-4796-47a2-b3ef-4e7d9c7a0644 tempest-VolumesGetTest-1188070236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.552s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:29 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-34f23738-4796-47a2-b3ef-4e7d9c7a0644 tempest-VolumesGetTest-1188070236 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:11:27Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1149214803',display_name='tempest-VolumesGetTest-Volume-118161730',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c79cf603-7af0-423f-a8ce-6ea9902da89d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fd52c85921a443d92f594a7f2280e9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:11:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:11:27Z,use_quota=True,user_id='d7a23dd5ade7439ca285e5922adb8785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:11:29 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-34f23738-4796-47a2-b3ef-4e7d9c7a0644 tempest-VolumesGetTest-1188070236 None] Creating volume c79cf603-7af0-423f-a8ce-6ea9902da89d {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:11:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-34f23738-4796-47a2-b3ef-4e7d9c7a0644 tempest-VolumesGetTest-1188070236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-34f23738-4796-47a2-b3ef-4e7d9c7a0644 tempest-VolumesGetTest-1188070236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:29 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-34f23738-4796-47a2-b3ef-4e7d9c7a0644 tempest-VolumesGetTest-1188070236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:11:29 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-34f23738-4796-47a2-b3ef-4e7d9c7a0644 tempest-VolumesGetTest-1188070236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:11:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-34f23738-4796-47a2-b3ef-4e7d9c7a0644 tempest-VolumesGetTest-1188070236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:29 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-34f23738-4796-47a2-b3ef-4e7d9c7a0644 tempest-VolumesGetTest-1188070236 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:11:29 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-34f23738-4796-47a2-b3ef-4e7d9c7a0644 tempest-VolumesGetTest-1188070236 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:11:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-34f23738-4796-47a2-b3ef-4e7d9c7a0644 tempest-VolumesGetTest-1188070236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c79cf603-7af0-423f-a8ce-6ea9902da89d 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:29 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-be8b9b8c-aa32-4a71-9a5a-639d3dc3f5b7 tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1b8dff5-7e26-48c9-b257-d22ef71bbb4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89344b46-a9f4-41f1-9578-fa2c97c004b6', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:29 devstack sudo[88522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c79cf603-7af0-423f-a8ce-6ea9902da89d 1073741824
Apr 15 20:11:29 devstack sudo[88522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:29 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-be8b9b8c-aa32-4a71-9a5a-639d3dc3f5b7 tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07e16443-248b-4d50-b462-6c0415760894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:29 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-be8b9b8c-aa32-4a71-9a5a-639d3dc3f5b7 tempest-VolumesActionsTest-1438461382 None] Volume volume-89344b46-a9f4-41f1-9578-fa2c97c004b6 (89344b46-a9f4-41f1-9578-fa2c97c004b6): created successfully
Apr 15 20:11:29 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-be8b9b8c-aa32-4a71-9a5a-639d3dc3f5b7 tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07e16443-248b-4d50-b462-6c0415760894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:29 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-be8b9b8c-aa32-4a71-9a5a-639d3dc3f5b7 tempest-VolumesActionsTest-1438461382 None] Flow 'volume_create_manager' (c06b801e-6012-4f06-a5be-15525b49f63f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:11:29 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-be8b9b8c-aa32-4a71-9a5a-639d3dc3f5b7 tempest-VolumesActionsTest-1438461382 None] Created volume successfully.
Apr 15 20:11:29 devstack sudo[88518]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-697e5389-b436-48e8-824c-529ca2bfcbd8 tempest-CreateVolumesFromSnapshotTest-2121410921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b153ebd7-2ba3-4084-b990-a3f36170f9e8" returned: 0 in 0.431s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:29 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-697e5389-b436-48e8-824c-529ca2bfcbd8 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Lock "cinder-quobyte-b153ebd7-2ba3-4084-b990-a3f36170f9e8" released by "delete_volume" :: held 0.984s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:11:29 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-697e5389-b436-48e8-824c-529ca2bfcbd8 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Created reservations ['ccd264e9-0ed9-4144-b0d5-e98188dd60bd', '996ad671-1533-47b4-b01e-32569be90be6', '4f4a047b-d6ed-4fde-8826-3069e3332451', 'f1bbadec-4916-49a3-aa0c-1b47d99c4771'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:11:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-697e5389-b436-48e8-824c-529ca2bfcbd8 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-697e5389-b436-48e8-824c-529ca2bfcbd8 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:29 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-697e5389-b436-48e8-824c-529ca2bfcbd8 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:11:29 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-697e5389-b436-48e8-824c-529ca2bfcbd8 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:11:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-697e5389-b436-48e8-824c-529ca2bfcbd8 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-697e5389-b436-48e8-824c-529ca2bfcbd8 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:29 devstack sudo[88524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:11:29 devstack sudo[88524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:29 devstack sudo[88522]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-34f23738-4796-47a2-b3ef-4e7d9c7a0644 tempest-VolumesGetTest-1188070236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c79cf603-7af0-423f-a8ce-6ea9902da89d 1073741824" returned: 0 in 0.540s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-34f23738-4796-47a2-b3ef-4e7d9c7a0644 tempest-VolumesGetTest-1188070236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c79cf603-7af0-423f-a8ce-6ea9902da89d {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:29 devstack sudo[88530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c79cf603-7af0-423f-a8ce-6ea9902da89d
Apr 15 20:11:29 devstack sudo[88530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:29 devstack sudo[88524]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-697e5389-b436-48e8-824c-529ca2bfcbd8 tempest-CreateVolumesFromSnapshotTest-2121410921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.444s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:29 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-697e5389-b436-48e8-824c-529ca2bfcbd8 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:11:29 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-697e5389-b436-48e8-824c-529ca2bfcbd8 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Deleted volume successfully.
Apr 15 20:11:29 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-697e5389-b436-48e8-824c-529ca2bfcbd8 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Lock "cinder-b153ebd7-2ba3-4084-b990-a3f36170f9e8-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:11:29 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-bfd0723e-5bad-4886-8b38-42dd9a10bbfc tempest-VolumesActionsTest-2098528605 None] Acquiring lock "cinder-89344b46-a9f4-41f1-9578-fa2c97c004b6-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:11:29 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-bfd0723e-5bad-4886-8b38-42dd9a10bbfc tempest-VolumesActionsTest-2098528605 None] Lock "cinder-89344b46-a9f4-41f1-9578-fa2c97c004b6-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:11:29 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-bfd0723e-5bad-4886-8b38-42dd9a10bbfc tempest-VolumesActionsTest-2098528605 None] Acquiring lock "cinder-quobyte-89344b46-a9f4-41f1-9578-fa2c97c004b6" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:11:29 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-bfd0723e-5bad-4886-8b38-42dd9a10bbfc tempest-VolumesActionsTest-2098528605 None] Lock "cinder-quobyte-89344b46-a9f4-41f1-9578-fa2c97c004b6" acquired by "delete_volume" :: waited 0.008s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:11:29 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f000c84-2e36-42ea-a5b5-1736f0751a52]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:11:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bfd0723e-5bad-4886-8b38-42dd9a10bbfc tempest-VolumesActionsTest-2098528605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-89344b46-a9f4-41f1-9578-fa2c97c004b6 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:30 devstack sudo[88532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-89344b46-a9f4-41f1-9578-fa2c97c004b6
Apr 15 20:11:30 devstack sudo[88532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:30 devstack sudo[88530]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-34f23738-4796-47a2-b3ef-4e7d9c7a0644 tempest-VolumesGetTest-1188070236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c79cf603-7af0-423f-a8ce-6ea9902da89d" returned: 0 in 0.466s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:30 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-34f23738-4796-47a2-b3ef-4e7d9c7a0644 tempest-VolumesGetTest-1188070236 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:11:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-34f23738-4796-47a2-b3ef-4e7d9c7a0644 tempest-VolumesGetTest-1188070236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.495s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:30 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] Cloning volume c2665a01-77ba-4bca-a73d-eef01fc39c28 to volume 54bf8d29-4939-4520-9f02-58e05cd5d161
Apr 15 20:11:30 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-34f23738-4796-47a2-b3ef-4e7d9c7a0644 tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acd83216-2226-46e7-9213-a4f212b3d6f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c79cf603-7af0-423f-a8ce-6ea9902da89d', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:30 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-34f23738-4796-47a2-b3ef-4e7d9c7a0644 tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dd8f344-c2f8-468d-bc63-a049dff1f2f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:30 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-34f23738-4796-47a2-b3ef-4e7d9c7a0644 tempest-VolumesGetTest-1188070236 None] Volume volume-c79cf603-7af0-423f-a8ce-6ea9902da89d (c79cf603-7af0-423f-a8ce-6ea9902da89d): created successfully
Apr 15 20:11:30 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-34f23738-4796-47a2-b3ef-4e7d9c7a0644 tempest-VolumesGetTest-1188070236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dd8f344-c2f8-468d-bc63-a049dff1f2f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:30 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-34f23738-4796-47a2-b3ef-4e7d9c7a0644 tempest-VolumesGetTest-1188070236 None] Flow 'volume_create_manager' (a08da07b-1b24-475a-8d11-3c0be7507f7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:11:30 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-34f23738-4796-47a2-b3ef-4e7d9c7a0644 tempest-VolumesGetTest-1188070236 None] Created volume successfully.
Apr 15 20:11:30 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] Creating offline snapshot 8f08a68b-3ebd-42a1-941e-e4688180956d of volume c2665a01-77ba-4bca-a73d-eef01fc39c28 {{(pid=82646) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 20:11:30 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[49521ecf-6206-4d36-86f6-7afc11f9226c]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:11:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2665a01-77ba-4bca-a73d-eef01fc39c28 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:30 devstack sudo[88535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2665a01-77ba-4bca-a73d-eef01fc39c28
Apr 15 20:11:30 devstack sudo[88535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:30 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-b18cf888-2e55-45fb-a5b0-5f05661b6df5 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Acquiring lock "cinder-b18039d5-5122-4445-8d80-a5e768e72285-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:11:30 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-b18cf888-2e55-45fb-a5b0-5f05661b6df5 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Lock "cinder-b18039d5-5122-4445-8d80-a5e768e72285-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:11:30 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-b18cf888-2e55-45fb-a5b0-5f05661b6df5 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Acquiring lock "cinder-quobyte-b18039d5-5122-4445-8d80-a5e768e72285" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:11:30 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-b18cf888-2e55-45fb-a5b0-5f05661b6df5 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Lock "cinder-quobyte-b18039d5-5122-4445-8d80-a5e768e72285" acquired by "delete_volume" :: waited 0.011s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:11:30 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7628cba-f31f-4167-963a-a188ebb79e0f]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:11:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b18cf888-2e55-45fb-a5b0-5f05661b6df5 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b18039d5-5122-4445-8d80-a5e768e72285 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:30 devstack sudo[88537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b18039d5-5122-4445-8d80-a5e768e72285
Apr 15 20:11:30 devstack sudo[88537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:30 devstack sudo[88532]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bfd0723e-5bad-4886-8b38-42dd9a10bbfc tempest-VolumesActionsTest-2098528605 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-89344b46-a9f4-41f1-9578-fa2c97c004b6" returned: 0 in 0.601s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bfd0723e-5bad-4886-8b38-42dd9a10bbfc tempest-VolumesActionsTest-2098528605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-89344b46-a9f4-41f1-9578-fa2c97c004b6 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:30 devstack sudo[88542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-89344b46-a9f4-41f1-9578-fa2c97c004b6
Apr 15 20:11:30 devstack sudo[88542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:30 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-2e886d70-add7-4049-81bb-50de54396e60 tempest-VolumesGetTest-1188070236 None] Acquiring lock "cinder-c79cf603-7af0-423f-a8ce-6ea9902da89d-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:11:30 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-2e886d70-add7-4049-81bb-50de54396e60 tempest-VolumesGetTest-1188070236 None] Lock "cinder-c79cf603-7af0-423f-a8ce-6ea9902da89d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:11:30 devstack sudo[88535]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2665a01-77ba-4bca-a73d-eef01fc39c28" returned: 0 in 0.663s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2665a01-77ba-4bca-a73d-eef01fc39c28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2665a01-77ba-4bca-a73d-eef01fc39c28.8f08a68b-3ebd-42a1-941e-e4688180956d 1G {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:30 devstack sudo[88547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2665a01-77ba-4bca-a73d-eef01fc39c28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2665a01-77ba-4bca-a73d-eef01fc39c28.8f08a68b-3ebd-42a1-941e-e4688180956d 1G
Apr 15 20:11:30 devstack sudo[88547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:30 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-2e886d70-add7-4049-81bb-50de54396e60 tempest-VolumesGetTest-1188070236 None] Acquiring lock "cinder-quobyte-c79cf603-7af0-423f-a8ce-6ea9902da89d" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:11:30 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-2e886d70-add7-4049-81bb-50de54396e60 tempest-VolumesGetTest-1188070236 None] Lock "cinder-quobyte-c79cf603-7af0-423f-a8ce-6ea9902da89d" acquired by "delete_volume" :: waited 0.008s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:11:30 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1ed31c-7453-4f35-88c0-d60d26628f2a]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:11:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-2e886d70-add7-4049-81bb-50de54396e60 tempest-VolumesGetTest-1188070236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c79cf603-7af0-423f-a8ce-6ea9902da89d {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:30 devstack sudo[88549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c79cf603-7af0-423f-a8ce-6ea9902da89d
Apr 15 20:11:30 devstack sudo[88549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:30 devstack sudo[88537]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b18cf888-2e55-45fb-a5b0-5f05661b6df5 tempest-CreateVolumesFromSnapshotTest-2121410921 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b18039d5-5122-4445-8d80-a5e768e72285" returned: 0 in 0.644s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b18cf888-2e55-45fb-a5b0-5f05661b6df5 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b18039d5-5122-4445-8d80-a5e768e72285 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:31 devstack sudo[88555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b18039d5-5122-4445-8d80-a5e768e72285
Apr 15 20:11:31 devstack sudo[88555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:31 devstack sudo[88542]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bfd0723e-5bad-4886-8b38-42dd9a10bbfc tempest-VolumesActionsTest-2098528605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-89344b46-a9f4-41f1-9578-fa2c97c004b6" returned: 0 in 0.499s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:31 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-bfd0723e-5bad-4886-8b38-42dd9a10bbfc tempest-VolumesActionsTest-2098528605 None] Lock "cinder-quobyte-89344b46-a9f4-41f1-9578-fa2c97c004b6" released by "delete_volume" :: held 1.125s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:11:31 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-bfd0723e-5bad-4886-8b38-42dd9a10bbfc tempest-VolumesActionsTest-2098528605 None] Created reservations ['87e14b2e-2c4f-441a-990f-cdc3eb60a77d', '9a7394cb-da2a-49e2-b579-1508907142d7', '9be02c30-fbd5-4ffc-929f-cb1829803ef9', '67a708b9-25e8-4aa3-bcbd-5655cb4c685c'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:11:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-bfd0723e-5bad-4886-8b38-42dd9a10bbfc tempest-VolumesActionsTest-2098528605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-bfd0723e-5bad-4886-8b38-42dd9a10bbfc tempest-VolumesActionsTest-2098528605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:31 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-bfd0723e-5bad-4886-8b38-42dd9a10bbfc tempest-VolumesActionsTest-2098528605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:11:31 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-bfd0723e-5bad-4886-8b38-42dd9a10bbfc tempest-VolumesActionsTest-2098528605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:11:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-bfd0723e-5bad-4886-8b38-42dd9a10bbfc tempest-VolumesActionsTest-2098528605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bfd0723e-5bad-4886-8b38-42dd9a10bbfc tempest-VolumesActionsTest-2098528605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:31 devstack sudo[88557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:11:31 devstack sudo[88557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:31 devstack sudo[88547]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2665a01-77ba-4bca-a73d-eef01fc39c28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2665a01-77ba-4bca-a73d-eef01fc39c28.8f08a68b-3ebd-42a1-941e-e4688180956d 1G" returned: 0 in 0.609s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2665a01-77ba-4bca-a73d-eef01fc39c28 -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2665a01-77ba-4bca-a73d-eef01fc39c28.8f08a68b-3ebd-42a1-941e-e4688180956d {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:31 devstack sudo[88566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2665a01-77ba-4bca-a73d-eef01fc39c28 -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2665a01-77ba-4bca-a73d-eef01fc39c28.8f08a68b-3ebd-42a1-941e-e4688180956d
Apr 15 20:11:31 devstack sudo[88566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:31 devstack sudo[88549]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-2e886d70-add7-4049-81bb-50de54396e60 tempest-VolumesGetTest-1188070236 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c79cf603-7af0-423f-a8ce-6ea9902da89d" returned: 0 in 0.613s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-2e886d70-add7-4049-81bb-50de54396e60 tempest-VolumesGetTest-1188070236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c79cf603-7af0-423f-a8ce-6ea9902da89d {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:31 devstack sudo[88555]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:31 devstack sudo[88568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c79cf603-7af0-423f-a8ce-6ea9902da89d
Apr 15 20:11:31 devstack sudo[88568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b18cf888-2e55-45fb-a5b0-5f05661b6df5 tempest-CreateVolumesFromSnapshotTest-2121410921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b18039d5-5122-4445-8d80-a5e768e72285" returned: 0 in 0.515s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:31 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-b18cf888-2e55-45fb-a5b0-5f05661b6df5 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Lock "cinder-quobyte-b18039d5-5122-4445-8d80-a5e768e72285" released by "delete_volume" :: held 1.186s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:11:31 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-b18cf888-2e55-45fb-a5b0-5f05661b6df5 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Created reservations ['f55ff1a5-6d9c-4c28-83f5-20cfe6831c02', 'd803a1b6-574c-44be-8408-53767c0f52b8', '7485eb04-92fc-44a0-b19b-3bc792a97470', 'c4be10fd-6001-4f93-9079-520c3f325885'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:11:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-b18cf888-2e55-45fb-a5b0-5f05661b6df5 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-b18cf888-2e55-45fb-a5b0-5f05661b6df5 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:31 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-b18cf888-2e55-45fb-a5b0-5f05661b6df5 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:11:31 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-b18cf888-2e55-45fb-a5b0-5f05661b6df5 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:11:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-b18cf888-2e55-45fb-a5b0-5f05661b6df5 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b18cf888-2e55-45fb-a5b0-5f05661b6df5 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:31 devstack sudo[88571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:11:31 devstack sudo[88571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:31 devstack sudo[88557]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bfd0723e-5bad-4886-8b38-42dd9a10bbfc tempest-VolumesActionsTest-2098528605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.589s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:31 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-bfd0723e-5bad-4886-8b38-42dd9a10bbfc tempest-VolumesActionsTest-2098528605 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:11:31 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-bfd0723e-5bad-4886-8b38-42dd9a10bbfc tempest-VolumesActionsTest-2098528605 None] Deleted volume successfully.
Apr 15 20:11:31 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-bfd0723e-5bad-4886-8b38-42dd9a10bbfc tempest-VolumesActionsTest-2098528605 None] Lock "cinder-89344b46-a9f4-41f1-9578-fa2c97c004b6-delete_volume" released by "delete_volume" :: held 1.880s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:11:31 devstack sudo[88566]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2665a01-77ba-4bca-a73d-eef01fc39c28 -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2665a01-77ba-4bca-a73d-eef01fc39c28.8f08a68b-3ebd-42a1-941e-e4688180956d" returned: 0 in 0.492s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:31 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2665a01-77ba-4bca-a73d-eef01fc39c28.8f08a68b-3ebd-42a1-941e-e4688180956d is being set with open permissions: ugo+rw
Apr 15 20:11:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2665a01-77ba-4bca-a73d-eef01fc39c28.8f08a68b-3ebd-42a1-941e-e4688180956d {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:31 devstack sudo[88577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2665a01-77ba-4bca-a73d-eef01fc39c28.8f08a68b-3ebd-42a1-941e-e4688180956d
Apr 15 20:11:31 devstack sudo[88577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:31 devstack sudo[88568]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-2e886d70-add7-4049-81bb-50de54396e60 tempest-VolumesGetTest-1188070236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c79cf603-7af0-423f-a8ce-6ea9902da89d" returned: 0 in 0.511s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:31 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-2e886d70-add7-4049-81bb-50de54396e60 tempest-VolumesGetTest-1188070236 None] Lock "cinder-quobyte-c79cf603-7af0-423f-a8ce-6ea9902da89d" released by "delete_volume" :: held 1.149s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:11:32 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-2e886d70-add7-4049-81bb-50de54396e60 tempest-VolumesGetTest-1188070236 None] Created reservations ['5c57d8cd-e85e-41dc-b0ce-7b0a01a78a43', '6565ddf6-6a18-41f3-ad7b-89a75c93475f', '98e76950-707a-4e27-a7a6-fb64df58154c', '37170693-ca9a-491e-bc3e-3b36a1cb5379'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:11:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-2e886d70-add7-4049-81bb-50de54396e60 tempest-VolumesGetTest-1188070236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-2e886d70-add7-4049-81bb-50de54396e60 tempest-VolumesGetTest-1188070236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:32 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-2e886d70-add7-4049-81bb-50de54396e60 tempest-VolumesGetTest-1188070236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:11:32 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-2e886d70-add7-4049-81bb-50de54396e60 tempest-VolumesGetTest-1188070236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:11:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-2e886d70-add7-4049-81bb-50de54396e60 tempest-VolumesGetTest-1188070236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-2e886d70-add7-4049-81bb-50de54396e60 tempest-VolumesGetTest-1188070236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:32 devstack sudo[88580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:11:32 devstack sudo[88580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:32 devstack sudo[88571]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b18cf888-2e55-45fb-a5b0-5f05661b6df5 tempest-CreateVolumesFromSnapshotTest-2121410921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.564s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:32 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-b18cf888-2e55-45fb-a5b0-5f05661b6df5 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:11:32 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-b18cf888-2e55-45fb-a5b0-5f05661b6df5 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Deleted volume successfully.
Apr 15 20:11:32 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-b18cf888-2e55-45fb-a5b0-5f05661b6df5 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Lock "cinder-b18039d5-5122-4445-8d80-a5e768e72285-delete_volume" released by "delete_volume" :: held 1.961s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:11:32 devstack sudo[88577]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2665a01-77ba-4bca-a73d-eef01fc39c28.8f08a68b-3ebd-42a1-941e-e4688180956d" returned: 0 in 0.463s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2665a01-77ba-4bca-a73d-eef01fc39c28.info {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:32 devstack sudo[88583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2665a01-77ba-4bca-a73d-eef01fc39c28.info
Apr 15 20:11:32 devstack sudo[88583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:32 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-c82e4028-6f4c-44de-b0d0-2ed0b825086c tempest-VolumesActionsTest-1438461382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:11:32 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-c82e4028-6f4c-44de-b0d0-2ed0b825086c tempest-VolumesActionsTest-1438461382 None] Flow 'volume_create_manager' (9f8ddeae-dcf2-4778-b8ad-f706486bb8a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:11:32 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-c82e4028-6f4c-44de-b0d0-2ed0b825086c tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc47f1db-1bf8-4a7d-b659-fded8b0af9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:32 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-44ecd591-5450-41bd-b186-559bee2ebe48 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Acquiring lock "cinder-998b76ac-0004-4b17-8559-e88cd297e712-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:11:32 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-c82e4028-6f4c-44de-b0d0-2ed0b825086c tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc47f1db-1bf8-4a7d-b659-fded8b0af9ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:11:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1244539019',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=342d9089-88b4-48d2-bbf8-24fa65a0faf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df37bd8c7f7a4cea8e7e0beb744ae494',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:11:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:11:32Z,use_quota=True,user_id='51042bd29b7a4a579be7666e3269ba93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:32 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-c82e4028-6f4c-44de-b0d0-2ed0b825086c tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa89644f-0f81-4ae2-8ebc-60655ca176e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:32 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-c82e4028-6f4c-44de-b0d0-2ed0b825086c tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa89644f-0f81-4ae2-8ebc-60655ca176e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:32 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-c82e4028-6f4c-44de-b0d0-2ed0b825086c tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac6dcfe7-e40b-4719-af66-415284934855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:32 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-c82e4028-6f4c-44de-b0d0-2ed0b825086c tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac6dcfe7-e40b-4719-af66-415284934855) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '342d9089-88b4-48d2-bbf8-24fa65a0faf3', 'volume_name': 'volume-342d9089-88b4-48d2-bbf8-24fa65a0faf3', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:32 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-c82e4028-6f4c-44de-b0d0-2ed0b825086c tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f0b658d-c7e8-423f-9625-a21e9bd01fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:32 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-c82e4028-6f4c-44de-b0d0-2ed0b825086c tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f0b658d-c7e8-423f-9625-a21e9bd01fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:32 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-c82e4028-6f4c-44de-b0d0-2ed0b825086c tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b4aef10-bddd-45d0-b2c2-1a98601eb746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:32 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-c82e4028-6f4c-44de-b0d0-2ed0b825086c tempest-VolumesActionsTest-1438461382 None] Volume 342d9089-88b4-48d2-bbf8-24fa65a0faf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-342d9089-88b4-48d2-bbf8-24fa65a0faf3', 'volume_size': 1}
Apr 15 20:11:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-c82e4028-6f4c-44de-b0d0-2ed0b825086c tempest-VolumesActionsTest-1438461382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:32 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-44ecd591-5450-41bd-b186-559bee2ebe48 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Lock "cinder-998b76ac-0004-4b17-8559-e88cd297e712-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:11:32 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-44ecd591-5450-41bd-b186-559bee2ebe48 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Acquiring lock "cinder-quobyte-998b76ac-0004-4b17-8559-e88cd297e712" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:11:32 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-44ecd591-5450-41bd-b186-559bee2ebe48 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Lock "cinder-quobyte-998b76ac-0004-4b17-8559-e88cd297e712" acquired by "delete_volume" :: waited 0.007s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:11:32 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2bbb7c6-5525-46e7-ab53-c9e712a5aa31]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:11:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-44ecd591-5450-41bd-b186-559bee2ebe48 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-998b76ac-0004-4b17-8559-e88cd297e712 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:32 devstack sudo[88580]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-2e886d70-add7-4049-81bb-50de54396e60 tempest-VolumesGetTest-1188070236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.521s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:32 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-2e886d70-add7-4049-81bb-50de54396e60 tempest-VolumesGetTest-1188070236 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:11:32 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-2e886d70-add7-4049-81bb-50de54396e60 tempest-VolumesGetTest-1188070236 None] Deleted volume successfully.
Apr 15 20:11:32 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-2e886d70-add7-4049-81bb-50de54396e60 tempest-VolumesGetTest-1188070236 None] Lock "cinder-c79cf603-7af0-423f-a8ce-6ea9902da89d-delete_volume" released by "delete_volume" :: held 1.848s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:11:32 devstack sudo[88586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-998b76ac-0004-4b17-8559-e88cd297e712
Apr 15 20:11:32 devstack sudo[88586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:32 devstack sudo[88583]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2665a01-77ba-4bca-a73d-eef01fc39c28.info" returned: 0 in 0.447s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:32 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2665a01-77ba-4bca-a73d-eef01fc39c28.info is being set with open permissions: ugo+rw
Apr 15 20:11:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2665a01-77ba-4bca-a73d-eef01fc39c28.info {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:32 devstack sudo[88589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2665a01-77ba-4bca-a73d-eef01fc39c28.info
Apr 15 20:11:32 devstack sudo[88589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:32 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-3cfc2c09-0b63-453e-aaf8-a625b890805b tempest-VolumesGetTest-1188070236 None] Acquiring lock "cinder-2b06ce6c-11d7-41ab-aaa8-51bbe1b82058-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:11:32 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-3cfc2c09-0b63-453e-aaf8-a625b890805b tempest-VolumesGetTest-1188070236 None] Lock "cinder-2b06ce6c-11d7-41ab-aaa8-51bbe1b82058-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:11:33 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-3cfc2c09-0b63-453e-aaf8-a625b890805b tempest-VolumesGetTest-1188070236 None] Acquiring lock "cinder-quobyte-2b06ce6c-11d7-41ab-aaa8-51bbe1b82058" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:11:33 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-3cfc2c09-0b63-453e-aaf8-a625b890805b tempest-VolumesGetTest-1188070236 None] Lock "cinder-quobyte-2b06ce6c-11d7-41ab-aaa8-51bbe1b82058" acquired by "delete_volume" :: waited 0.010s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:11:33 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2de198-00cb-4304-bc4e-3b507aeae8e1]: (4, 'raw') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:11:33 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-3cfc2c09-0b63-453e-aaf8-a625b890805b tempest-VolumesGetTest-1188070236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-2b06ce6c-11d7-41ab-aaa8-51bbe1b82058 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:33 devstack sudo[88586]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:33 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-44ecd591-5450-41bd-b186-559bee2ebe48 tempest-CreateVolumesFromSnapshotTest-2121410921 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-998b76ac-0004-4b17-8559-e88cd297e712" returned: 0 in 0.569s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:33 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-44ecd591-5450-41bd-b186-559bee2ebe48 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-998b76ac-0004-4b17-8559-e88cd297e712 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:33 devstack sudo[88594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-2b06ce6c-11d7-41ab-aaa8-51bbe1b82058
Apr 15 20:11:33 devstack sudo[88594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:33 devstack sudo[88601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-998b76ac-0004-4b17-8559-e88cd297e712
Apr 15 20:11:33 devstack sudo[88601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:33 devstack sudo[88589]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:33 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2665a01-77ba-4bca-a73d-eef01fc39c28.info" returned: 0 in 0.446s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:33 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] Acquiring lock "cinder-quobyte-54bf8d29-4939-4520-9f02-58e05cd5d161" by "_copy_volume_from_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:11:33 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] Lock "cinder-quobyte-54bf8d29-4939-4520-9f02-58e05cd5d161" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:11:33 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] snapshot: 8f08a68b-3ebd-42a1-941e-e4688180956d, volume: 54bf8d29-4939-4520-9f02-58e05cd5d161,  {{(pid=82646) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 15 20:11:33 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:33 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:33 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:11:33 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:11:33 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:33 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[384fb988-8523-4d50-9177-fdfdf5e72219]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:11:33 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2665a01-77ba-4bca-a73d-eef01fc39c28.8f08a68b-3ebd-42a1-941e-e4688180956d {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:33 devstack sudo[88605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2665a01-77ba-4bca-a73d-eef01fc39c28.8f08a68b-3ebd-42a1-941e-e4688180956d
Apr 15 20:11:33 devstack sudo[88605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:33 devstack sudo[88601]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:33 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-44ecd591-5450-41bd-b186-559bee2ebe48 tempest-CreateVolumesFromSnapshotTest-2121410921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-998b76ac-0004-4b17-8559-e88cd297e712" returned: 0 in 0.438s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:33 devstack sudo[88594]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:33 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-44ecd591-5450-41bd-b186-559bee2ebe48 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Lock "cinder-quobyte-998b76ac-0004-4b17-8559-e88cd297e712" released by "delete_volume" :: held 1.028s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:11:33 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-3cfc2c09-0b63-453e-aaf8-a625b890805b tempest-VolumesGetTest-1188070236 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-2b06ce6c-11d7-41ab-aaa8-51bbe1b82058" returned: 0 in 0.516s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:33 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-3cfc2c09-0b63-453e-aaf8-a625b890805b tempest-VolumesGetTest-1188070236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-2b06ce6c-11d7-41ab-aaa8-51bbe1b82058 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:33 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-44ecd591-5450-41bd-b186-559bee2ebe48 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Created reservations ['f6700acd-8a66-47b6-ae1c-32f4376ca18c', 'f730737d-890b-4762-9c17-47b509af74ea', '71424d31-76b0-4a35-9586-2e8176618ca4', '1a37d2cd-5d0e-452f-bb11-dfd37f6be92c'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:11:33 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-44ecd591-5450-41bd-b186-559bee2ebe48 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:33 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-44ecd591-5450-41bd-b186-559bee2ebe48 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:33 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-44ecd591-5450-41bd-b186-559bee2ebe48 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:11:33 devstack sudo[88610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-2b06ce6c-11d7-41ab-aaa8-51bbe1b82058
Apr 15 20:11:33 devstack sudo[88610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:33 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-44ecd591-5450-41bd-b186-559bee2ebe48 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:11:33 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-44ecd591-5450-41bd-b186-559bee2ebe48 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:33 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-44ecd591-5450-41bd-b186-559bee2ebe48 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:33 devstack sudo[88612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:11:33 devstack sudo[88612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:33 devstack sudo[88605]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:33 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2665a01-77ba-4bca-a73d-eef01fc39c28.8f08a68b-3ebd-42a1-941e-e4688180956d" returned: 0 in 0.513s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:33 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2665a01-77ba-4bca-a73d-eef01fc39c28(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82646) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 20:11:33 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2665a01-77ba-4bca-a73d-eef01fc39c28 {{(pid=82646) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 15 20:11:33 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] Creating direct copy from snapshot {{(pid=82646) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 15 20:11:33 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[bafaffd0-4e83-487b-875f-84e7d854ee10]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:11:33 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2665a01-77ba-4bca-a73d-eef01fc39c28 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:33 devstack sudo[88617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2665a01-77ba-4bca-a73d-eef01fc39c28
Apr 15 20:11:33 devstack sudo[88617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:34 devstack sudo[88610]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:34 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-3cfc2c09-0b63-453e-aaf8-a625b890805b tempest-VolumesGetTest-1188070236 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-2b06ce6c-11d7-41ab-aaa8-51bbe1b82058" returned: 1 in 0.528s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:34 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-3cfc2c09-0b63-453e-aaf8-a625b890805b tempest-VolumesGetTest-1188070236 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-2b06ce6c-11d7-41ab-aaa8-51bbe1b82058' failed. Not Retrying. {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 20:11:34 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-3cfc2c09-0b63-453e-aaf8-a625b890805b tempest-VolumesGetTest-1188070236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-2b06ce6c-11d7-41ab-aaa8-51bbe1b82058 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:34 devstack sudo[88612]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:34 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-44ecd591-5450-41bd-b186-559bee2ebe48 tempest-CreateVolumesFromSnapshotTest-2121410921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.446s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:34 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-44ecd591-5450-41bd-b186-559bee2ebe48 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:11:34 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-44ecd591-5450-41bd-b186-559bee2ebe48 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Deleted volume successfully.
Apr 15 20:11:34 devstack sudo[88623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-2b06ce6c-11d7-41ab-aaa8-51bbe1b82058
Apr 15 20:11:34 devstack sudo[88623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:34 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-44ecd591-5450-41bd-b186-559bee2ebe48 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Lock "cinder-998b76ac-0004-4b17-8559-e88cd297e712-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:11:34 devstack sudo[88617]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:34 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2665a01-77ba-4bca-a73d-eef01fc39c28" returned: 0 in 0.474s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:34 devstack cinder-volume[82646]: DEBUG cinder.utils [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] Path /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-54bf8d29-4939-4520-9f02-58e05cd5d161 not found in is_blk_device check {{(pid=82646) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 15 20:11:34 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2665a01-77ba-4bca-a73d-eef01fc39c28 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-54bf8d29-4939-4520-9f02-58e05cd5d161 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:34 devstack sudo[88628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2665a01-77ba-4bca-a73d-eef01fc39c28 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-54bf8d29-4939-4520-9f02-58e05cd5d161
Apr 15 20:11:34 devstack sudo[88628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:34 devstack sudo[88623]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:34 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-3cfc2c09-0b63-453e-aaf8-a625b890805b tempest-VolumesGetTest-1188070236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-2b06ce6c-11d7-41ab-aaa8-51bbe1b82058" returned: 0 in 0.441s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:34 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-3cfc2c09-0b63-453e-aaf8-a625b890805b tempest-VolumesGetTest-1188070236 None] Lock "cinder-quobyte-2b06ce6c-11d7-41ab-aaa8-51bbe1b82058" released by "delete_volume" :: held 1.536s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:11:34 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-3cfc2c09-0b63-453e-aaf8-a625b890805b tempest-VolumesGetTest-1188070236 None] Created reservations ['9f7bbfd4-0c79-4677-b3a8-5ff96a8cc67c', '174c4372-128f-4300-aa18-a031e5093dfe', '923766bc-bdda-4248-b971-749190ac95bc', '8ba15003-c9ec-471e-9564-4aeff1442ef2'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:11:34 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-5b04dcd8-e42c-441d-a0fc-085c7f26c5e6 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Acquiring lock "cinder-6321df1e-e37c-423e-b3d4-f2cb2cf0dc08-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:11:34 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-5b04dcd8-e42c-441d-a0fc-085c7f26c5e6 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Lock "cinder-6321df1e-e37c-423e-b3d4-f2cb2cf0dc08-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:11:34 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-3cfc2c09-0b63-453e-aaf8-a625b890805b tempest-VolumesGetTest-1188070236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:34 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-3cfc2c09-0b63-453e-aaf8-a625b890805b tempest-VolumesGetTest-1188070236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:34 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-3cfc2c09-0b63-453e-aaf8-a625b890805b tempest-VolumesGetTest-1188070236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:11:34 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-3cfc2c09-0b63-453e-aaf8-a625b890805b tempest-VolumesGetTest-1188070236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:11:34 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-3cfc2c09-0b63-453e-aaf8-a625b890805b tempest-VolumesGetTest-1188070236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:34 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-3cfc2c09-0b63-453e-aaf8-a625b890805b tempest-VolumesGetTest-1188070236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:34 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-5b04dcd8-e42c-441d-a0fc-085c7f26c5e6 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Acquiring lock "cinder-quobyte-6321df1e-e37c-423e-b3d4-f2cb2cf0dc08" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:11:34 devstack sudo[88634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:11:34 devstack sudo[88634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:34 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-5b04dcd8-e42c-441d-a0fc-085c7f26c5e6 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Lock "cinder-quobyte-6321df1e-e37c-423e-b3d4-f2cb2cf0dc08" acquired by "delete_volume" :: waited 0.017s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:11:34 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd1497e-63d0-434e-ae3c-943c72cd4c3a]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:11:34 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5b04dcd8-e42c-441d-a0fc-085c7f26c5e6 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6321df1e-e37c-423e-b3d4-f2cb2cf0dc08 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:34 devstack sudo[88636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6321df1e-e37c-423e-b3d4-f2cb2cf0dc08
Apr 15 20:11:34 devstack sudo[88636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:36 devstack sudo[88634]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:36 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-3cfc2c09-0b63-453e-aaf8-a625b890805b tempest-VolumesGetTest-1188070236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 1.649s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:36 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-3cfc2c09-0b63-453e-aaf8-a625b890805b tempest-VolumesGetTest-1188070236 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:11:36 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-3cfc2c09-0b63-453e-aaf8-a625b890805b tempest-VolumesGetTest-1188070236 None] Deleted volume successfully.
Apr 15 20:11:36 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-3cfc2c09-0b63-453e-aaf8-a625b890805b tempest-VolumesGetTest-1188070236 None] Lock "cinder-2b06ce6c-11d7-41ab-aaa8-51bbe1b82058-delete_volume" released by "delete_volume" :: held 3.426s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:11:36 devstack sudo[88636]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:36 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5b04dcd8-e42c-441d-a0fc-085c7f26c5e6 tempest-CreateVolumesFromSnapshotTest-2121410921 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6321df1e-e37c-423e-b3d4-f2cb2cf0dc08" returned: 0 in 1.691s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:36 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5b04dcd8-e42c-441d-a0fc-085c7f26c5e6 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6321df1e-e37c-423e-b3d4-f2cb2cf0dc08 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:36 devstack sudo[88650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6321df1e-e37c-423e-b3d4-f2cb2cf0dc08
Apr 15 20:11:36 devstack sudo[88650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:36 devstack sudo[88628]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:36 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2665a01-77ba-4bca-a73d-eef01fc39c28 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-54bf8d29-4939-4520-9f02-58e05cd5d161" returned: 0 in 2.592s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:36 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a367be-668e-4f48-b58a-8fffa790fe57]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:11:36 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2665a01-77ba-4bca-a73d-eef01fc39c28 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:36 devstack sudo[88652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2665a01-77ba-4bca-a73d-eef01fc39c28
Apr 15 20:11:36 devstack sudo[88652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:37 devstack sudo[88650]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:37 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5b04dcd8-e42c-441d-a0fc-085c7f26c5e6 tempest-CreateVolumesFromSnapshotTest-2121410921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6321df1e-e37c-423e-b3d4-f2cb2cf0dc08" returned: 0 in 0.810s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:37 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-5b04dcd8-e42c-441d-a0fc-085c7f26c5e6 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Lock "cinder-quobyte-6321df1e-e37c-423e-b3d4-f2cb2cf0dc08" released by "delete_volume" :: held 2.538s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:11:37 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-5b04dcd8-e42c-441d-a0fc-085c7f26c5e6 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Created reservations ['d8c66137-4ea3-4aba-8b15-c924dc5f03f1', '98922d90-3b8a-4a34-8280-24cb73209335', '255d62a4-79af-4413-9d6c-58a248d0223f', '8cbe715f-6d62-45a2-a049-2ba17d65b21c'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:11:37 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-5b04dcd8-e42c-441d-a0fc-085c7f26c5e6 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:37 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-5b04dcd8-e42c-441d-a0fc-085c7f26c5e6 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:37 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-5b04dcd8-e42c-441d-a0fc-085c7f26c5e6 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:11:37 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-5b04dcd8-e42c-441d-a0fc-085c7f26c5e6 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:11:37 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-5b04dcd8-e42c-441d-a0fc-085c7f26c5e6 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:37 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5b04dcd8-e42c-441d-a0fc-085c7f26c5e6 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:37 devstack sudo[88655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:11:37 devstack sudo[88655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:37 devstack sudo[88652]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:37 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2665a01-77ba-4bca-a73d-eef01fc39c28" returned: 0 in 0.699s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:37 devstack cinder-volume[82646]: DEBUG cinder.image.image_utils [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] Image conversion details: src /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2665a01-77ba-4bca-a73d-eef01fc39c28, size 1024.00 MB, duration 2.59 sec, destination /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-54bf8d29-4939-4520-9f02-58e05cd5d161 {{(pid=82646) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 20:11:37 devstack cinder-volume[82646]: INFO cinder.image.image_utils [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] Converted 1024.00 MB image at 394.84 MB/s
Apr 15 20:11:37 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-54bf8d29-4939-4520-9f02-58e05cd5d161 is being set with open permissions: ugo+rw
Apr 15 20:11:37 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-54bf8d29-4939-4520-9f02-58e05cd5d161 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:37 devstack sudo[88660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-54bf8d29-4939-4520-9f02-58e05cd5d161
Apr 15 20:11:37 devstack sudo[88660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:37 devstack sudo[88655]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:37 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5b04dcd8-e42c-441d-a0fc-085c7f26c5e6 tempest-CreateVolumesFromSnapshotTest-2121410921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.456s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:37 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-5b04dcd8-e42c-441d-a0fc-085c7f26c5e6 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:11:37 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-5b04dcd8-e42c-441d-a0fc-085c7f26c5e6 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Deleted volume successfully.
Apr 15 20:11:37 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-5b04dcd8-e42c-441d-a0fc-085c7f26c5e6 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Lock "cinder-6321df1e-e37c-423e-b3d4-f2cb2cf0dc08-delete_volume" released by "delete_volume" :: held 3.193s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:11:38 devstack sudo[88660]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:38 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-54bf8d29-4939-4520-9f02-58e05cd5d161" returned: 0 in 0.408s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:38 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] Lock "cinder-quobyte-54bf8d29-4939-4520-9f02-58e05cd5d161" released by "_copy_volume_from_snapshot" :: held 4.735s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:11:38 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] Acquiring lock "cinder-quobyte-8f08a68b-3ebd-42a1-941e-e4688180956d" by "_delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:11:38 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] Lock "cinder-quobyte-8f08a68b-3ebd-42a1-941e-e4688180956d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:11:38 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] Deleting offline snapshot 8f08a68b-3ebd-42a1-941e-e4688180956d of volume c2665a01-77ba-4bca-a73d-eef01fc39c28 {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 20:11:38 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] snapshot_file for this snap is: volume-c2665a01-77ba-4bca-a73d-eef01fc39c28.8f08a68b-3ebd-42a1-941e-e4688180956d {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 20:11:38 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[62774625-8726-48b5-ad84-52f2643308b4]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:11:38 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2665a01-77ba-4bca-a73d-eef01fc39c28.8f08a68b-3ebd-42a1-941e-e4688180956d {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:38 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-6ef40914-8611-4c1d-bb36-e2b5150bf1f6 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Acquiring lock "cinder-feeca0e5-81b7-4b60-ab20-d453e814601e-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:11:38 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-6ef40914-8611-4c1d-bb36-e2b5150bf1f6 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Lock "cinder-feeca0e5-81b7-4b60-ab20-d453e814601e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:11:38 devstack sudo[88664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2665a01-77ba-4bca-a73d-eef01fc39c28.8f08a68b-3ebd-42a1-941e-e4688180956d
Apr 15 20:11:38 devstack sudo[88664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:38 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-6ef40914-8611-4c1d-bb36-e2b5150bf1f6 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Acquiring lock "cinder-quobyte-feeca0e5-81b7-4b60-ab20-d453e814601e" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:11:38 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-6ef40914-8611-4c1d-bb36-e2b5150bf1f6 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Lock "cinder-quobyte-feeca0e5-81b7-4b60-ab20-d453e814601e" acquired by "delete_volume" :: waited 0.012s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:11:38 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[26cb8588-6adb-412b-bb25-63b3f622f854]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:11:38 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6ef40914-8611-4c1d-bb36-e2b5150bf1f6 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-feeca0e5-81b7-4b60-ab20-d453e814601e {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:38 devstack sudo[88666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-feeca0e5-81b7-4b60-ab20-d453e814601e
Apr 15 20:11:38 devstack sudo[88666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:38 devstack sudo[88664]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:38 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2665a01-77ba-4bca-a73d-eef01fc39c28.8f08a68b-3ebd-42a1-941e-e4688180956d" returned: 0 in 0.583s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:38 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2665a01-77ba-4bca-a73d-eef01fc39c28(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82646) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 20:11:38 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83d3fcf-eb57-4e94-b3d2-521cf34a5588]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:11:38 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2665a01-77ba-4bca-a73d-eef01fc39c28 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:38 devstack sudo[88671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2665a01-77ba-4bca-a73d-eef01fc39c28
Apr 15 20:11:38 devstack sudo[88671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:38 devstack sudo[88666]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:38 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6ef40914-8611-4c1d-bb36-e2b5150bf1f6 tempest-CreateVolumesFromSnapshotTest-2121410921 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-feeca0e5-81b7-4b60-ab20-d453e814601e" returned: 0 in 0.594s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:38 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6ef40914-8611-4c1d-bb36-e2b5150bf1f6 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-feeca0e5-81b7-4b60-ab20-d453e814601e {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:38 devstack sudo[88676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-feeca0e5-81b7-4b60-ab20-d453e814601e
Apr 15 20:11:38 devstack sudo[88676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:39 devstack sudo[88671]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:39 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2665a01-77ba-4bca-a73d-eef01fc39c28" returned: 0 in 0.666s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:39 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2665a01-77ba-4bca-a73d-eef01fc39c28.8f08a68b-3ebd-42a1-941e-e4688180956d {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:39 devstack sudo[88682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2665a01-77ba-4bca-a73d-eef01fc39c28.8f08a68b-3ebd-42a1-941e-e4688180956d
Apr 15 20:11:39 devstack sudo[88682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:39 devstack sudo[88676]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:39 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6ef40914-8611-4c1d-bb36-e2b5150bf1f6 tempest-CreateVolumesFromSnapshotTest-2121410921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-feeca0e5-81b7-4b60-ab20-d453e814601e" returned: 0 in 0.578s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:39 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-6ef40914-8611-4c1d-bb36-e2b5150bf1f6 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Lock "cinder-quobyte-feeca0e5-81b7-4b60-ab20-d453e814601e" released by "delete_volume" :: held 1.198s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:11:39 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-6ef40914-8611-4c1d-bb36-e2b5150bf1f6 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Created reservations ['b0d44a3a-7e19-47c4-83fb-6c7ca02643e4', '65480721-69ee-40ff-a984-d07c39254b3c', 'd4077451-8e1c-40d8-97d0-9b290742a53f', '28d6ca7a-6dbf-4a8f-b8f9-e2bcee7f7a8c'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:11:39 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-6ef40914-8611-4c1d-bb36-e2b5150bf1f6 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:39 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-6ef40914-8611-4c1d-bb36-e2b5150bf1f6 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:39 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-6ef40914-8611-4c1d-bb36-e2b5150bf1f6 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:11:39 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-6ef40914-8611-4c1d-bb36-e2b5150bf1f6 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:11:39 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-6ef40914-8611-4c1d-bb36-e2b5150bf1f6 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:39 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6ef40914-8611-4c1d-bb36-e2b5150bf1f6 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:39 devstack sudo[88684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:11:39 devstack sudo[88684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:39 devstack sudo[88682]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:39 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2665a01-77ba-4bca-a73d-eef01fc39c28.8f08a68b-3ebd-42a1-941e-e4688180956d" returned: 0 in 0.614s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:39 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2665a01-77ba-4bca-a73d-eef01fc39c28.8f08a68b-3ebd-42a1-941e-e4688180956d {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:39 devstack sudo[88684]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:39 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6ef40914-8611-4c1d-bb36-e2b5150bf1f6 tempest-CreateVolumesFromSnapshotTest-2121410921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.470s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:39 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-6ef40914-8611-4c1d-bb36-e2b5150bf1f6 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:11:39 devstack sudo[88690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2665a01-77ba-4bca-a73d-eef01fc39c28.8f08a68b-3ebd-42a1-941e-e4688180956d
Apr 15 20:11:39 devstack sudo[88690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:39 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-6ef40914-8611-4c1d-bb36-e2b5150bf1f6 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Deleted volume successfully.
Apr 15 20:11:40 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-6ef40914-8611-4c1d-bb36-e2b5150bf1f6 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Lock "cinder-feeca0e5-81b7-4b60-ab20-d453e814601e-delete_volume" released by "delete_volume" :: held 1.852s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:11:40 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-9fee4b52-a5c6-4dd1-b54d-40e802933d4f tempest-CreateVolumesFromSnapshotTest-2121410921 None] Acquiring lock "cinder-cde5f8dc-3352-4f28-8fb3-e00a464f17a9-delete_snapshot" by "delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:11:40 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-9fee4b52-a5c6-4dd1-b54d-40e802933d4f tempest-CreateVolumesFromSnapshotTest-2121410921 None] Lock "cinder-cde5f8dc-3352-4f28-8fb3-e00a464f17a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:11:40 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-9fee4b52-a5c6-4dd1-b54d-40e802933d4f tempest-CreateVolumesFromSnapshotTest-2121410921 None] Acquiring lock "cinder-quobyte-11f29364-3b0f-4e2a-be26-53a43b66e9e7" by "delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:11:40 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-9fee4b52-a5c6-4dd1-b54d-40e802933d4f tempest-CreateVolumesFromSnapshotTest-2121410921 None] Lock "cinder-quobyte-11f29364-3b0f-4e2a-be26-53a43b66e9e7" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:11:40 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-9fee4b52-a5c6-4dd1-b54d-40e802933d4f tempest-CreateVolumesFromSnapshotTest-2121410921 None] Acquiring lock "cinder-quobyte-cde5f8dc-3352-4f28-8fb3-e00a464f17a9" by "_delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:11:40 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-9fee4b52-a5c6-4dd1-b54d-40e802933d4f tempest-CreateVolumesFromSnapshotTest-2121410921 None] Lock "cinder-quobyte-cde5f8dc-3352-4f28-8fb3-e00a464f17a9" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:11:40 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-9fee4b52-a5c6-4dd1-b54d-40e802933d4f tempest-CreateVolumesFromSnapshotTest-2121410921 None] Deleting offline snapshot cde5f8dc-3352-4f28-8fb3-e00a464f17a9 of volume 11f29364-3b0f-4e2a-be26-53a43b66e9e7 {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 20:11:40 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-9fee4b52-a5c6-4dd1-b54d-40e802933d4f tempest-CreateVolumesFromSnapshotTest-2121410921 None] snapshot_file for this snap is: volume-11f29364-3b0f-4e2a-be26-53a43b66e9e7.cde5f8dc-3352-4f28-8fb3-e00a464f17a9 {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 20:11:40 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[575328e0-7295-432e-8221-068ef9407856]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:11:40 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-9fee4b52-a5c6-4dd1-b54d-40e802933d4f tempest-CreateVolumesFromSnapshotTest-2121410921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-11f29364-3b0f-4e2a-be26-53a43b66e9e7.cde5f8dc-3352-4f28-8fb3-e00a464f17a9 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:40 devstack sudo[88690]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:40 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2665a01-77ba-4bca-a73d-eef01fc39c28.8f08a68b-3ebd-42a1-941e-e4688180956d" returned: 0 in 0.468s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:40 devstack sudo[88693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-11f29364-3b0f-4e2a-be26-53a43b66e9e7.cde5f8dc-3352-4f28-8fb3-e00a464f17a9
Apr 15 20:11:40 devstack sudo[88693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:40 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] Lock "cinder-quobyte-8f08a68b-3ebd-42a1-941e-e4688180956d" released by "_delete_snapshot" :: held 2.412s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:11:40 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.429s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:40 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-c82e4028-6f4c-44de-b0d0-2ed0b825086c tempest-VolumesActionsTest-1438461382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.994s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:40 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-c82e4028-6f4c-44de-b0d0-2ed0b825086c tempest-VolumesActionsTest-1438461382 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:11:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1244539019',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=342d9089-88b4-48d2-bbf8-24fa65a0faf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df37bd8c7f7a4cea8e7e0beb744ae494',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:11:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:11:32Z,use_quota=True,user_id='51042bd29b7a4a579be7666e3269ba93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:11:40 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-c82e4028-6f4c-44de-b0d0-2ed0b825086c tempest-VolumesActionsTest-1438461382 None] Creating volume 342d9089-88b4-48d2-bbf8-24fa65a0faf3 {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:11:40 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-c82e4028-6f4c-44de-b0d0-2ed0b825086c tempest-VolumesActionsTest-1438461382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:40 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-c82e4028-6f4c-44de-b0d0-2ed0b825086c tempest-VolumesActionsTest-1438461382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:40 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-c82e4028-6f4c-44de-b0d0-2ed0b825086c tempest-VolumesActionsTest-1438461382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:11:40 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-c82e4028-6f4c-44de-b0d0-2ed0b825086c tempest-VolumesActionsTest-1438461382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:11:40 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-c82e4028-6f4c-44de-b0d0-2ed0b825086c tempest-VolumesActionsTest-1438461382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:40 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-c82e4028-6f4c-44de-b0d0-2ed0b825086c tempest-VolumesActionsTest-1438461382 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:11:40 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-c82e4028-6f4c-44de-b0d0-2ed0b825086c tempest-VolumesActionsTest-1438461382 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:11:40 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c82e4028-6f4c-44de-b0d0-2ed0b825086c tempest-VolumesActionsTest-1438461382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-342d9089-88b4-48d2-bbf8-24fa65a0faf3 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:40 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ee40006-4f72-4129-84fa-ac64979ef5d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54bf8d29-4939-4520-9f02-58e05cd5d161', 'volume_size': 1, 'source_volid': 'c2665a01-77ba-4bca-a73d-eef01fc39c28', 'source_volstatus': 'available'}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:40 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca95c443-6f67-462f-9c68-d3fdad31f928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:40 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] Volume volume-54bf8d29-4939-4520-9f02-58e05cd5d161 (54bf8d29-4939-4520-9f02-58e05cd5d161): created successfully
Apr 15 20:11:40 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca95c443-6f67-462f-9c68-d3fdad31f928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:40 devstack sudo[88695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-342d9089-88b4-48d2-bbf8-24fa65a0faf3 1073741824
Apr 15 20:11:40 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] Flow 'volume_create_manager' (4e2b6f4c-320f-4e0c-9aae-1fda244e403f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:11:40 devstack sudo[88695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:40 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-78a809b2-de95-49f2-83dc-4c034a462174 tempest-VolumeDependencyTests-693181165 None] Created volume successfully.
Apr 15 20:11:40 devstack sudo[88693]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:40 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-9fee4b52-a5c6-4dd1-b54d-40e802933d4f tempest-CreateVolumesFromSnapshotTest-2121410921 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-11f29364-3b0f-4e2a-be26-53a43b66e9e7.cde5f8dc-3352-4f28-8fb3-e00a464f17a9" returned: 0 in 0.533s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:40 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-9fee4b52-a5c6-4dd1-b54d-40e802933d4f tempest-CreateVolumesFromSnapshotTest-2121410921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11f29364-3b0f-4e2a-be26-53a43b66e9e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82646) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 20:11:40 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1cebdd0-1510-4b0a-98e9-023fc088422b]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:11:40 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-9fee4b52-a5c6-4dd1-b54d-40e802933d4f tempest-CreateVolumesFromSnapshotTest-2121410921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-11f29364-3b0f-4e2a-be26-53a43b66e9e7 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:40 devstack sudo[88701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-11f29364-3b0f-4e2a-be26-53a43b66e9e7
Apr 15 20:11:40 devstack sudo[88701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:41 devstack sudo[88695]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:41 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c82e4028-6f4c-44de-b0d0-2ed0b825086c tempest-VolumesActionsTest-1438461382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-342d9089-88b4-48d2-bbf8-24fa65a0faf3 1073741824" returned: 0 in 0.609s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:41 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c82e4028-6f4c-44de-b0d0-2ed0b825086c tempest-VolumesActionsTest-1438461382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-342d9089-88b4-48d2-bbf8-24fa65a0faf3 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:41 devstack sudo[88705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-342d9089-88b4-48d2-bbf8-24fa65a0faf3
Apr 15 20:11:41 devstack sudo[88705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:41 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-359eb8f1-1eb8-4b87-8edd-13928c43c800 tempest-VolumeDependencyTests-693181165 None] Acquiring lock "cinder-c2665a01-77ba-4bca-a73d-eef01fc39c28-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:11:41 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-359eb8f1-1eb8-4b87-8edd-13928c43c800 tempest-VolumeDependencyTests-693181165 None] Lock "cinder-c2665a01-77ba-4bca-a73d-eef01fc39c28-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:11:41 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-359eb8f1-1eb8-4b87-8edd-13928c43c800 tempest-VolumeDependencyTests-693181165 None] Acquiring lock "cinder-quobyte-c2665a01-77ba-4bca-a73d-eef01fc39c28" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:11:41 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-359eb8f1-1eb8-4b87-8edd-13928c43c800 tempest-VolumeDependencyTests-693181165 None] Lock "cinder-quobyte-c2665a01-77ba-4bca-a73d-eef01fc39c28" acquired by "delete_volume" :: waited 0.021s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:11:41 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[3878c506-1de7-49c1-aec3-312b3526f41f]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:11:41 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-359eb8f1-1eb8-4b87-8edd-13928c43c800 tempest-VolumeDependencyTests-693181165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2665a01-77ba-4bca-a73d-eef01fc39c28 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:41 devstack sudo[88710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2665a01-77ba-4bca-a73d-eef01fc39c28
Apr 15 20:11:41 devstack sudo[88710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:41 devstack sudo[88701]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:41 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-9fee4b52-a5c6-4dd1-b54d-40e802933d4f tempest-CreateVolumesFromSnapshotTest-2121410921 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-11f29364-3b0f-4e2a-be26-53a43b66e9e7" returned: 0 in 0.638s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:41 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-9fee4b52-a5c6-4dd1-b54d-40e802933d4f tempest-CreateVolumesFromSnapshotTest-2121410921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-11f29364-3b0f-4e2a-be26-53a43b66e9e7.cde5f8dc-3352-4f28-8fb3-e00a464f17a9 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:41 devstack sudo[88713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-11f29364-3b0f-4e2a-be26-53a43b66e9e7.cde5f8dc-3352-4f28-8fb3-e00a464f17a9
Apr 15 20:11:41 devstack sudo[88713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:41 devstack sudo[88705]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:41 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c82e4028-6f4c-44de-b0d0-2ed0b825086c tempest-VolumesActionsTest-1438461382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-342d9089-88b4-48d2-bbf8-24fa65a0faf3" returned: 0 in 0.494s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:41 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-c82e4028-6f4c-44de-b0d0-2ed0b825086c tempest-VolumesActionsTest-1438461382 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:11:41 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-c82e4028-6f4c-44de-b0d0-2ed0b825086c tempest-VolumesActionsTest-1438461382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:41 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-c82e4028-6f4c-44de-b0d0-2ed0b825086c tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b4aef10-bddd-45d0-b2c2-1a98601eb746) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-342d9089-88b4-48d2-bbf8-24fa65a0faf3', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:41 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-c82e4028-6f4c-44de-b0d0-2ed0b825086c tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2475ede1-4dcf-441f-8b82-8f3bddef3f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:41 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-c82e4028-6f4c-44de-b0d0-2ed0b825086c tempest-VolumesActionsTest-1438461382 None] Volume volume-342d9089-88b4-48d2-bbf8-24fa65a0faf3 (342d9089-88b4-48d2-bbf8-24fa65a0faf3): created successfully
Apr 15 20:11:41 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-c82e4028-6f4c-44de-b0d0-2ed0b825086c tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2475ede1-4dcf-441f-8b82-8f3bddef3f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:41 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-c82e4028-6f4c-44de-b0d0-2ed0b825086c tempest-VolumesActionsTest-1438461382 None] Flow 'volume_create_manager' (9f8ddeae-dcf2-4778-b8ad-f706486bb8a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:11:41 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-c82e4028-6f4c-44de-b0d0-2ed0b825086c tempest-VolumesActionsTest-1438461382 None] Created volume successfully.
Apr 15 20:11:41 devstack sudo[88710]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:41 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-359eb8f1-1eb8-4b87-8edd-13928c43c800 tempest-VolumeDependencyTests-693181165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2665a01-77ba-4bca-a73d-eef01fc39c28" returned: 0 in 0.571s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:41 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-359eb8f1-1eb8-4b87-8edd-13928c43c800 tempest-VolumeDependencyTests-693181165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2665a01-77ba-4bca-a73d-eef01fc39c28 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:42 devstack sudo[88713]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:42 devstack sudo[88721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2665a01-77ba-4bca-a73d-eef01fc39c28
Apr 15 20:11:42 devstack sudo[88721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:42 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-9fee4b52-a5c6-4dd1-b54d-40e802933d4f tempest-CreateVolumesFromSnapshotTest-2121410921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-11f29364-3b0f-4e2a-be26-53a43b66e9e7.cde5f8dc-3352-4f28-8fb3-e00a464f17a9" returned: 0 in 0.475s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:42 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-9fee4b52-a5c6-4dd1-b54d-40e802933d4f tempest-CreateVolumesFromSnapshotTest-2121410921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-11f29364-3b0f-4e2a-be26-53a43b66e9e7.cde5f8dc-3352-4f28-8fb3-e00a464f17a9 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:42 devstack sudo[88723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-11f29364-3b0f-4e2a-be26-53a43b66e9e7.cde5f8dc-3352-4f28-8fb3-e00a464f17a9
Apr 15 20:11:42 devstack sudo[88723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:42 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-df60bb3f-84ea-4478-a707-245ca1d3a5f6 tempest-VolumesActionsTest-2098528605 None] Acquiring lock "cinder-342d9089-88b4-48d2-bbf8-24fa65a0faf3-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:11:42 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-df60bb3f-84ea-4478-a707-245ca1d3a5f6 tempest-VolumesActionsTest-2098528605 None] Lock "cinder-342d9089-88b4-48d2-bbf8-24fa65a0faf3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:11:42 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-df60bb3f-84ea-4478-a707-245ca1d3a5f6 tempest-VolumesActionsTest-2098528605 None] Acquiring lock "cinder-quobyte-342d9089-88b4-48d2-bbf8-24fa65a0faf3" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:11:42 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-df60bb3f-84ea-4478-a707-245ca1d3a5f6 tempest-VolumesActionsTest-2098528605 None] Lock "cinder-quobyte-342d9089-88b4-48d2-bbf8-24fa65a0faf3" acquired by "delete_volume" :: waited 0.007s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:11:42 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa8c4bc-2ed0-4f9e-906c-239458405df5]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:11:42 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-df60bb3f-84ea-4478-a707-245ca1d3a5f6 tempest-VolumesActionsTest-2098528605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-342d9089-88b4-48d2-bbf8-24fa65a0faf3 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:42 devstack sudo[88725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-342d9089-88b4-48d2-bbf8-24fa65a0faf3
Apr 15 20:11:42 devstack sudo[88725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:42 devstack sudo[88721]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:42 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-359eb8f1-1eb8-4b87-8edd-13928c43c800 tempest-VolumeDependencyTests-693181165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c2665a01-77ba-4bca-a73d-eef01fc39c28" returned: 0 in 0.543s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:42 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-359eb8f1-1eb8-4b87-8edd-13928c43c800 tempest-VolumeDependencyTests-693181165 None] Lock "cinder-quobyte-c2665a01-77ba-4bca-a73d-eef01fc39c28" released by "delete_volume" :: held 1.175s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:11:42 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-359eb8f1-1eb8-4b87-8edd-13928c43c800 tempest-VolumeDependencyTests-693181165 None] Created reservations ['75fe7cd2-75a8-4643-98d2-9c2f13a1f659', '1915ab72-e106-42c2-b0c4-0beb8c7f5408', '372f84e2-a28e-47a4-b3f1-eeefcfe7c670', 'd66898b0-3c4c-4026-9504-6b1c54d6ada6'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:11:42 devstack sudo[88723]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:42 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-9fee4b52-a5c6-4dd1-b54d-40e802933d4f tempest-CreateVolumesFromSnapshotTest-2121410921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-11f29364-3b0f-4e2a-be26-53a43b66e9e7.cde5f8dc-3352-4f28-8fb3-e00a464f17a9" returned: 0 in 0.571s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:42 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-359eb8f1-1eb8-4b87-8edd-13928c43c800 tempest-VolumeDependencyTests-693181165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:42 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-359eb8f1-1eb8-4b87-8edd-13928c43c800 tempest-VolumeDependencyTests-693181165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:42 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-359eb8f1-1eb8-4b87-8edd-13928c43c800 tempest-VolumeDependencyTests-693181165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:11:42 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-359eb8f1-1eb8-4b87-8edd-13928c43c800 tempest-VolumeDependencyTests-693181165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:11:42 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-359eb8f1-1eb8-4b87-8edd-13928c43c800 tempest-VolumeDependencyTests-693181165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:42 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-359eb8f1-1eb8-4b87-8edd-13928c43c800 tempest-VolumeDependencyTests-693181165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:42 devstack sudo[88729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:11:42 devstack sudo[88729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:42 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-9fee4b52-a5c6-4dd1-b54d-40e802933d4f tempest-CreateVolumesFromSnapshotTest-2121410921 None] Lock "cinder-quobyte-cde5f8dc-3352-4f28-8fb3-e00a464f17a9" released by "_delete_snapshot" :: held 2.326s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:11:42 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-9fee4b52-a5c6-4dd1-b54d-40e802933d4f tempest-CreateVolumesFromSnapshotTest-2121410921 None] Lock "cinder-quobyte-11f29364-3b0f-4e2a-be26-53a43b66e9e7" released by "delete_snapshot" :: held 2.340s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:11:42 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-9fee4b52-a5c6-4dd1-b54d-40e802933d4f tempest-CreateVolumesFromSnapshotTest-2121410921 None] Created reservations ['789aed17-4a2e-4075-b8e8-8b9aec6d880d', '06212aea-1d75-4734-9ee5-b985edefd75b', '39c8c084-b469-4002-853a-f95c4005cc72', '060bddfc-44ac-4bbc-acfb-535abd418e5f'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:11:42 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-9fee4b52-a5c6-4dd1-b54d-40e802933d4f tempest-CreateVolumesFromSnapshotTest-2121410921 None] Delete snapshot completed successfully.
Apr 15 20:11:42 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-9fee4b52-a5c6-4dd1-b54d-40e802933d4f tempest-CreateVolumesFromSnapshotTest-2121410921 None] Lock "cinder-cde5f8dc-3352-4f28-8fb3-e00a464f17a9-delete_snapshot" released by "delete_snapshot" :: held 2.420s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:11:42 devstack sudo[88725]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:42 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-df60bb3f-84ea-4478-a707-245ca1d3a5f6 tempest-VolumesActionsTest-2098528605 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-342d9089-88b4-48d2-bbf8-24fa65a0faf3" returned: 0 in 0.620s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:42 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-df60bb3f-84ea-4478-a707-245ca1d3a5f6 tempest-VolumesActionsTest-2098528605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-342d9089-88b4-48d2-bbf8-24fa65a0faf3 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:42 devstack sudo[88734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-342d9089-88b4-48d2-bbf8-24fa65a0faf3
Apr 15 20:11:42 devstack sudo[88734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:43 devstack sudo[88729]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:43 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-359eb8f1-1eb8-4b87-8edd-13928c43c800 tempest-VolumeDependencyTests-693181165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.428s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:43 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-359eb8f1-1eb8-4b87-8edd-13928c43c800 tempest-VolumeDependencyTests-693181165 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:11:43 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-359eb8f1-1eb8-4b87-8edd-13928c43c800 tempest-VolumeDependencyTests-693181165 None] Deleted volume successfully.
Apr 15 20:11:43 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-359eb8f1-1eb8-4b87-8edd-13928c43c800 tempest-VolumeDependencyTests-693181165 None] Lock "cinder-c2665a01-77ba-4bca-a73d-eef01fc39c28-delete_volume" released by "delete_volume" :: held 1.754s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:11:43 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-5d3fdcc4-d3f3-4533-9412-844e279cec61 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Acquiring lock "cinder-11f29364-3b0f-4e2a-be26-53a43b66e9e7-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:11:43 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-5d3fdcc4-d3f3-4533-9412-844e279cec61 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Lock "cinder-11f29364-3b0f-4e2a-be26-53a43b66e9e7-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:11:43 devstack sudo[88734]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:43 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-df60bb3f-84ea-4478-a707-245ca1d3a5f6 tempest-VolumesActionsTest-2098528605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-342d9089-88b4-48d2-bbf8-24fa65a0faf3" returned: 0 in 0.563s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:43 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-df60bb3f-84ea-4478-a707-245ca1d3a5f6 tempest-VolumesActionsTest-2098528605 None] Lock "cinder-quobyte-342d9089-88b4-48d2-bbf8-24fa65a0faf3" released by "delete_volume" :: held 1.226s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:11:43 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-5d3fdcc4-d3f3-4533-9412-844e279cec61 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Acquiring lock "cinder-quobyte-11f29364-3b0f-4e2a-be26-53a43b66e9e7" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:11:43 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-5d3fdcc4-d3f3-4533-9412-844e279cec61 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Lock "cinder-quobyte-11f29364-3b0f-4e2a-be26-53a43b66e9e7" acquired by "delete_volume" :: waited 0.011s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:11:43 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-079a9dc1-adb3-4b77-819f-b9ee523047c0 tempest-VolumeDependencyTests-693181165 None] Acquiring lock "cinder-54bf8d29-4939-4520-9f02-58e05cd5d161-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:11:43 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56be221-37c1-42f3-b515-4f321c92b740]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:11:43 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5d3fdcc4-d3f3-4533-9412-844e279cec61 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-11f29364-3b0f-4e2a-be26-53a43b66e9e7 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:43 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-079a9dc1-adb3-4b77-819f-b9ee523047c0 tempest-VolumeDependencyTests-693181165 None] Lock "cinder-54bf8d29-4939-4520-9f02-58e05cd5d161-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:11:43 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-df60bb3f-84ea-4478-a707-245ca1d3a5f6 tempest-VolumesActionsTest-2098528605 None] Created reservations ['81de55a1-a1b3-42e1-ad4a-59ca06202831', 'afb5f0bf-93aa-45fa-9b3f-0e6308c81460', 'fb7a95ad-d876-409a-ade8-ed94b520c41b', '38276e3e-eb5d-41fb-86c9-4c91412c9a12'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:11:43 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-079a9dc1-adb3-4b77-819f-b9ee523047c0 tempest-VolumeDependencyTests-693181165 None] Acquiring lock "cinder-quobyte-54bf8d29-4939-4520-9f02-58e05cd5d161" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:11:43 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-079a9dc1-adb3-4b77-819f-b9ee523047c0 tempest-VolumeDependencyTests-693181165 None] Lock "cinder-quobyte-54bf8d29-4939-4520-9f02-58e05cd5d161" acquired by "delete_volume" :: waited 0.012s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:11:43 devstack sudo[88738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-11f29364-3b0f-4e2a-be26-53a43b66e9e7
Apr 15 20:11:43 devstack sudo[88738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:43 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3407f0-2489-4de3-9e30-16bed83de662]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:11:43 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-079a9dc1-adb3-4b77-819f-b9ee523047c0 tempest-VolumeDependencyTests-693181165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-54bf8d29-4939-4520-9f02-58e05cd5d161 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:43 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-df60bb3f-84ea-4478-a707-245ca1d3a5f6 tempest-VolumesActionsTest-2098528605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:43 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-df60bb3f-84ea-4478-a707-245ca1d3a5f6 tempest-VolumesActionsTest-2098528605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:43 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-df60bb3f-84ea-4478-a707-245ca1d3a5f6 tempest-VolumesActionsTest-2098528605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:11:43 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-df60bb3f-84ea-4478-a707-245ca1d3a5f6 tempest-VolumesActionsTest-2098528605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:11:43 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-df60bb3f-84ea-4478-a707-245ca1d3a5f6 tempest-VolumesActionsTest-2098528605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:43 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-df60bb3f-84ea-4478-a707-245ca1d3a5f6 tempest-VolumesActionsTest-2098528605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:43 devstack sudo[88774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:11:43 devstack sudo[88774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:43 devstack sudo[88753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-54bf8d29-4939-4520-9f02-58e05cd5d161
Apr 15 20:11:43 devstack sudo[88753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:44 devstack sudo[88774]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:44 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-df60bb3f-84ea-4478-a707-245ca1d3a5f6 tempest-VolumesActionsTest-2098528605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.489s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:44 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-df60bb3f-84ea-4478-a707-245ca1d3a5f6 tempest-VolumesActionsTest-2098528605 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:11:44 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-df60bb3f-84ea-4478-a707-245ca1d3a5f6 tempest-VolumesActionsTest-2098528605 None] Deleted volume successfully.
Apr 15 20:11:44 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-df60bb3f-84ea-4478-a707-245ca1d3a5f6 tempest-VolumesActionsTest-2098528605 None] Lock "cinder-342d9089-88b4-48d2-bbf8-24fa65a0faf3-delete_volume" released by "delete_volume" :: held 2.037s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:11:44 devstack sudo[88738]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:44 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5d3fdcc4-d3f3-4533-9412-844e279cec61 tempest-CreateVolumesFromSnapshotTest-2121410921 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-11f29364-3b0f-4e2a-be26-53a43b66e9e7" returned: 0 in 0.712s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:44 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5d3fdcc4-d3f3-4533-9412-844e279cec61 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-11f29364-3b0f-4e2a-be26-53a43b66e9e7 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:44 devstack sudo[88783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-11f29364-3b0f-4e2a-be26-53a43b66e9e7
Apr 15 20:11:44 devstack sudo[88783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:44 devstack sudo[88753]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:44 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-079a9dc1-adb3-4b77-819f-b9ee523047c0 tempest-VolumeDependencyTests-693181165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-54bf8d29-4939-4520-9f02-58e05cd5d161" returned: 0 in 0.993s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:44 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-079a9dc1-adb3-4b77-819f-b9ee523047c0 tempest-VolumeDependencyTests-693181165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-54bf8d29-4939-4520-9f02-58e05cd5d161 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:44 devstack sudo[88788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-54bf8d29-4939-4520-9f02-58e05cd5d161
Apr 15 20:11:44 devstack sudo[88788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:44 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3c60717-7531-476d-b08c-b230d649bfd4 tempest-VolumesActionsTest-1438461382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:11:44 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e3c60717-7531-476d-b08c-b230d649bfd4 tempest-VolumesActionsTest-1438461382 None] Flow 'volume_create_manager' (2709f1fe-42e5-47e8-95d1-c6a56effba4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:11:44 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e3c60717-7531-476d-b08c-b230d649bfd4 tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (472aea7e-c4fd-4e5e-bc1c-105567fec46c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:45 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e3c60717-7531-476d-b08c-b230d649bfd4 tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (472aea7e-c4fd-4e5e-bc1c-105567fec46c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:11:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1115620624',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d7d129c-4636-455d-9a5d-8b16113a4734,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df37bd8c7f7a4cea8e7e0beb744ae494',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:11:45Z,use_quota=True,user_id='51042bd29b7a4a579be7666e3269ba93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:45 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e3c60717-7531-476d-b08c-b230d649bfd4 tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (436dc7ad-b19e-4bd2-a24f-d1abdc3c94f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:45 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e3c60717-7531-476d-b08c-b230d649bfd4 tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (436dc7ad-b19e-4bd2-a24f-d1abdc3c94f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:45 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e3c60717-7531-476d-b08c-b230d649bfd4 tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72eff409-7d97-4d38-84f0-f30910b1ef4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:45 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e3c60717-7531-476d-b08c-b230d649bfd4 tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72eff409-7d97-4d38-84f0-f30910b1ef4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d7d129c-4636-455d-9a5d-8b16113a4734', 'volume_name': 'volume-0d7d129c-4636-455d-9a5d-8b16113a4734', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:45 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e3c60717-7531-476d-b08c-b230d649bfd4 tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93110265-9b6b-4ef9-9d69-c01a07124dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:45 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e3c60717-7531-476d-b08c-b230d649bfd4 tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93110265-9b6b-4ef9-9d69-c01a07124dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:45 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e3c60717-7531-476d-b08c-b230d649bfd4 tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d466df90-9e16-4805-bd8d-7dc4c196bdf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:45 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-e3c60717-7531-476d-b08c-b230d649bfd4 tempest-VolumesActionsTest-1438461382 None] Volume 0d7d129c-4636-455d-9a5d-8b16113a4734: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d7d129c-4636-455d-9a5d-8b16113a4734', 'volume_size': 1}
Apr 15 20:11:45 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-e3c60717-7531-476d-b08c-b230d649bfd4 tempest-VolumesActionsTest-1438461382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:45 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-e3c60717-7531-476d-b08c-b230d649bfd4 tempest-VolumesActionsTest-1438461382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:45 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-e3c60717-7531-476d-b08c-b230d649bfd4 tempest-VolumesActionsTest-1438461382 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:11:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1115620624',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d7d129c-4636-455d-9a5d-8b16113a4734,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df37bd8c7f7a4cea8e7e0beb744ae494',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:11:45Z,use_quota=True,user_id='51042bd29b7a4a579be7666e3269ba93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:11:45 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-e3c60717-7531-476d-b08c-b230d649bfd4 tempest-VolumesActionsTest-1438461382 None] Creating volume 0d7d129c-4636-455d-9a5d-8b16113a4734 {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:11:45 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-e3c60717-7531-476d-b08c-b230d649bfd4 tempest-VolumesActionsTest-1438461382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:45 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-e3c60717-7531-476d-b08c-b230d649bfd4 tempest-VolumesActionsTest-1438461382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:45 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-e3c60717-7531-476d-b08c-b230d649bfd4 tempest-VolumesActionsTest-1438461382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:11:45 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-e3c60717-7531-476d-b08c-b230d649bfd4 tempest-VolumesActionsTest-1438461382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:11:45 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-e3c60717-7531-476d-b08c-b230d649bfd4 tempest-VolumesActionsTest-1438461382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:45 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-e3c60717-7531-476d-b08c-b230d649bfd4 tempest-VolumesActionsTest-1438461382 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:11:45 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-e3c60717-7531-476d-b08c-b230d649bfd4 tempest-VolumesActionsTest-1438461382 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:11:45 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e3c60717-7531-476d-b08c-b230d649bfd4 tempest-VolumesActionsTest-1438461382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0d7d129c-4636-455d-9a5d-8b16113a4734 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:45 devstack sudo[88790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0d7d129c-4636-455d-9a5d-8b16113a4734 1073741824
Apr 15 20:11:45 devstack sudo[88790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:45 devstack sudo[88788]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:45 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-079a9dc1-adb3-4b77-819f-b9ee523047c0 tempest-VolumeDependencyTests-693181165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-54bf8d29-4939-4520-9f02-58e05cd5d161" returned: 0 in 0.544s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:45 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-079a9dc1-adb3-4b77-819f-b9ee523047c0 tempest-VolumeDependencyTests-693181165 None] Lock "cinder-quobyte-54bf8d29-4939-4520-9f02-58e05cd5d161" released by "delete_volume" :: held 1.582s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:11:45 devstack sudo[88783]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:45 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5d3fdcc4-d3f3-4533-9412-844e279cec61 tempest-CreateVolumesFromSnapshotTest-2121410921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-11f29364-3b0f-4e2a-be26-53a43b66e9e7" returned: 0 in 0.974s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:45 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-5d3fdcc4-d3f3-4533-9412-844e279cec61 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Lock "cinder-quobyte-11f29364-3b0f-4e2a-be26-53a43b66e9e7" released by "delete_volume" :: held 1.732s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:11:45 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-079a9dc1-adb3-4b77-819f-b9ee523047c0 tempest-VolumeDependencyTests-693181165 None] Created reservations ['14794e68-1e5f-4fe5-89e2-9cfbbaea4e5c', '4f033a05-8748-463d-a56d-e542b4c08aff', '6157f7d6-d4c2-4d35-b56d-de78eac45419', 'e09704d5-0b29-4960-882f-53a4aa542573'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:11:45 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-5d3fdcc4-d3f3-4533-9412-844e279cec61 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Created reservations ['07b2f194-a0e5-4f4c-85ac-3d7f4972e1e4', '20d08b31-deec-4be0-bfae-c06a9ec095e0', 'ad221d96-f8df-4968-b048-8686af5f00fc', '4fb3d8ff-bb2f-499c-ab8e-a78822353f85'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:11:45 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-079a9dc1-adb3-4b77-819f-b9ee523047c0 tempest-VolumeDependencyTests-693181165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:45 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-079a9dc1-adb3-4b77-819f-b9ee523047c0 tempest-VolumeDependencyTests-693181165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:45 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-079a9dc1-adb3-4b77-819f-b9ee523047c0 tempest-VolumeDependencyTests-693181165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:11:45 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-079a9dc1-adb3-4b77-819f-b9ee523047c0 tempest-VolumeDependencyTests-693181165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:11:45 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-079a9dc1-adb3-4b77-819f-b9ee523047c0 tempest-VolumeDependencyTests-693181165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:45 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-079a9dc1-adb3-4b77-819f-b9ee523047c0 tempest-VolumeDependencyTests-693181165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:45 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-5d3fdcc4-d3f3-4533-9412-844e279cec61 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:45 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-5d3fdcc4-d3f3-4533-9412-844e279cec61 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:45 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-5d3fdcc4-d3f3-4533-9412-844e279cec61 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:11:45 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-5d3fdcc4-d3f3-4533-9412-844e279cec61 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:11:45 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-5d3fdcc4-d3f3-4533-9412-844e279cec61 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:45 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5d3fdcc4-d3f3-4533-9412-844e279cec61 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:45 devstack sudo[88794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:11:45 devstack sudo[88794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:45 devstack sudo[88799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:11:45 devstack sudo[88799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:45 devstack sudo[88790]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:45 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e3c60717-7531-476d-b08c-b230d649bfd4 tempest-VolumesActionsTest-1438461382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0d7d129c-4636-455d-9a5d-8b16113a4734 1073741824" returned: 0 in 0.608s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:45 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e3c60717-7531-476d-b08c-b230d649bfd4 tempest-VolumesActionsTest-1438461382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0d7d129c-4636-455d-9a5d-8b16113a4734 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:45 devstack sudo[88801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0d7d129c-4636-455d-9a5d-8b16113a4734
Apr 15 20:11:45 devstack sudo[88801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:45 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-9bb9d174-230d-4efa-8343-e70cab348cea tempest-VolumeDependencyTests-693181165 None] Acquiring lock "cinder-2cfcd7b4-057b-4951-a963-6aac4ee2eaac-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:11:45 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-9bb9d174-230d-4efa-8343-e70cab348cea tempest-VolumeDependencyTests-693181165 None] Lock "cinder-2cfcd7b4-057b-4951-a963-6aac4ee2eaac-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:11:46 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-9bb9d174-230d-4efa-8343-e70cab348cea tempest-VolumeDependencyTests-693181165 None] Acquiring lock "cinder-quobyte-2cfcd7b4-057b-4951-a963-6aac4ee2eaac" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:11:46 devstack sudo[88799]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5d3fdcc4-d3f3-4533-9412-844e279cec61 tempest-CreateVolumesFromSnapshotTest-2121410921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.600s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:46 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-5d3fdcc4-d3f3-4533-9412-844e279cec61 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:11:46 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-9bb9d174-230d-4efa-8343-e70cab348cea tempest-VolumeDependencyTests-693181165 None] Lock "cinder-quobyte-2cfcd7b4-057b-4951-a963-6aac4ee2eaac" acquired by "delete_volume" :: waited 0.029s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:11:46 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-5d3fdcc4-d3f3-4533-9412-844e279cec61 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Deleted volume successfully.
Apr 15 20:11:46 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c38e06-0b53-4bd5-9201-46718d50c6aa]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:11:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-9bb9d174-230d-4efa-8343-e70cab348cea tempest-VolumeDependencyTests-693181165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-2cfcd7b4-057b-4951-a963-6aac4ee2eaac {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:46 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-5d3fdcc4-d3f3-4533-9412-844e279cec61 tempest-CreateVolumesFromSnapshotTest-2121410921 None] Lock "cinder-11f29364-3b0f-4e2a-be26-53a43b66e9e7-delete_volume" released by "delete_volume" :: held 2.610s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:11:46 devstack sudo[88805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-2cfcd7b4-057b-4951-a963-6aac4ee2eaac
Apr 15 20:11:46 devstack sudo[88805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:46 devstack sudo[88794]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-079a9dc1-adb3-4b77-819f-b9ee523047c0 tempest-VolumeDependencyTests-693181165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.858s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:46 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-079a9dc1-adb3-4b77-819f-b9ee523047c0 tempest-VolumeDependencyTests-693181165 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:11:46 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-079a9dc1-adb3-4b77-819f-b9ee523047c0 tempest-VolumeDependencyTests-693181165 None] Deleted volume successfully.
Apr 15 20:11:46 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-079a9dc1-adb3-4b77-819f-b9ee523047c0 tempest-VolumeDependencyTests-693181165 None] Lock "cinder-54bf8d29-4939-4520-9f02-58e05cd5d161-delete_volume" released by "delete_volume" :: held 2.652s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:11:46 devstack sudo[88801]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e3c60717-7531-476d-b08c-b230d649bfd4 tempest-VolumesActionsTest-1438461382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0d7d129c-4636-455d-9a5d-8b16113a4734" returned: 0 in 0.737s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:46 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-e3c60717-7531-476d-b08c-b230d649bfd4 tempest-VolumesActionsTest-1438461382 None] <== create_volume: return (1399ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:11:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-e3c60717-7531-476d-b08c-b230d649bfd4 tempest-VolumesActionsTest-1438461382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.401s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:46 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e3c60717-7531-476d-b08c-b230d649bfd4 tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d466df90-9e16-4805-bd8d-7dc4c196bdf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d7d129c-4636-455d-9a5d-8b16113a4734', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:46 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e3c60717-7531-476d-b08c-b230d649bfd4 tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (095ee07d-6d72-47fc-8f18-37447609138b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:46 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-e3c60717-7531-476d-b08c-b230d649bfd4 tempest-VolumesActionsTest-1438461382 None] Volume volume-0d7d129c-4636-455d-9a5d-8b16113a4734 (0d7d129c-4636-455d-9a5d-8b16113a4734): created successfully
Apr 15 20:11:46 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e3c60717-7531-476d-b08c-b230d649bfd4 tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (095ee07d-6d72-47fc-8f18-37447609138b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:46 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e3c60717-7531-476d-b08c-b230d649bfd4 tempest-VolumesActionsTest-1438461382 None] Flow 'volume_create_manager' (2709f1fe-42e5-47e8-95d1-c6a56effba4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:11:46 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-e3c60717-7531-476d-b08c-b230d649bfd4 tempest-VolumesActionsTest-1438461382 None] Created volume successfully.
Apr 15 20:11:46 devstack sudo[88805]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-9bb9d174-230d-4efa-8343-e70cab348cea tempest-VolumeDependencyTests-693181165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-2cfcd7b4-057b-4951-a963-6aac4ee2eaac" returned: 0 in 0.682s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-9bb9d174-230d-4efa-8343-e70cab348cea tempest-VolumeDependencyTests-693181165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-2cfcd7b4-057b-4951-a963-6aac4ee2eaac {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:46 devstack sudo[88812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-2cfcd7b4-057b-4951-a963-6aac4ee2eaac
Apr 15 20:11:46 devstack sudo[88812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:47 devstack sudo[88812]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:47 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-9bb9d174-230d-4efa-8343-e70cab348cea tempest-VolumeDependencyTests-693181165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-2cfcd7b4-057b-4951-a963-6aac4ee2eaac" returned: 0 in 0.527s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:47 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-9bb9d174-230d-4efa-8343-e70cab348cea tempest-VolumeDependencyTests-693181165 None] Lock "cinder-quobyte-2cfcd7b4-057b-4951-a963-6aac4ee2eaac" released by "delete_volume" :: held 1.245s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:11:47 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-e2bbc9a7-4c8f-496f-ad02-fb04b73784a0 tempest-VolumesActionsTest-2098528605 None] Acquiring lock "cinder-0d7d129c-4636-455d-9a5d-8b16113a4734-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:11:47 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-267e6e7f-5a4e-4548-b1db-7ab0f1b6b0eb tempest-VolumesSnapshotTestJSON-895312450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:11:47 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-267e6e7f-5a4e-4548-b1db-7ab0f1b6b0eb tempest-VolumesSnapshotTestJSON-895312450 None] Flow 'volume_create_manager' (2aa4e5e9-1016-4360-9073-d1bf9939751e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:11:47 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-267e6e7f-5a4e-4548-b1db-7ab0f1b6b0eb tempest-VolumesSnapshotTestJSON-895312450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a942009e-dc12-4dac-af21-3a53a16f7afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:47 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-267e6e7f-5a4e-4548-b1db-7ab0f1b6b0eb tempest-VolumesSnapshotTestJSON-895312450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a942009e-dc12-4dac-af21-3a53a16f7afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1902588938',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=305fd023-9eca-42d8-a381-0877d56ee1dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='170389fee38140d9bf7a7115672201ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:11:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:11:47Z,use_quota=True,user_id='118d321c471c4eb281e6cc3e2bf90691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:47 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-267e6e7f-5a4e-4548-b1db-7ab0f1b6b0eb tempest-VolumesSnapshotTestJSON-895312450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca82c6be-bd3f-461d-aad1-ba4df64d33e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:47 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-267e6e7f-5a4e-4548-b1db-7ab0f1b6b0eb tempest-VolumesSnapshotTestJSON-895312450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca82c6be-bd3f-461d-aad1-ba4df64d33e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:47 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-267e6e7f-5a4e-4548-b1db-7ab0f1b6b0eb tempest-VolumesSnapshotTestJSON-895312450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e593ea2-64db-4eb6-b561-70dcd43e07fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:47 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-267e6e7f-5a4e-4548-b1db-7ab0f1b6b0eb tempest-VolumesSnapshotTestJSON-895312450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e593ea2-64db-4eb6-b561-70dcd43e07fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '305fd023-9eca-42d8-a381-0877d56ee1dc', 'volume_name': 'volume-305fd023-9eca-42d8-a381-0877d56ee1dc', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:47 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-267e6e7f-5a4e-4548-b1db-7ab0f1b6b0eb tempest-VolumesSnapshotTestJSON-895312450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec8cf556-6615-4725-a2a5-6008d5cb23b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:47 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-267e6e7f-5a4e-4548-b1db-7ab0f1b6b0eb tempest-VolumesSnapshotTestJSON-895312450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec8cf556-6615-4725-a2a5-6008d5cb23b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:47 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-267e6e7f-5a4e-4548-b1db-7ab0f1b6b0eb tempest-VolumesSnapshotTestJSON-895312450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d55e15e-c78c-4a89-9536-94d0d2ee36ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:47 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-267e6e7f-5a4e-4548-b1db-7ab0f1b6b0eb tempest-VolumesSnapshotTestJSON-895312450 None] Volume 305fd023-9eca-42d8-a381-0877d56ee1dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-305fd023-9eca-42d8-a381-0877d56ee1dc', 'volume_size': 1}
Apr 15 20:11:47 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-267e6e7f-5a4e-4548-b1db-7ab0f1b6b0eb tempest-VolumesSnapshotTestJSON-895312450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:47 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-267e6e7f-5a4e-4548-b1db-7ab0f1b6b0eb tempest-VolumesSnapshotTestJSON-895312450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:47 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-267e6e7f-5a4e-4548-b1db-7ab0f1b6b0eb tempest-VolumesSnapshotTestJSON-895312450 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1902588938',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=305fd023-9eca-42d8-a381-0877d56ee1dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='170389fee38140d9bf7a7115672201ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:11:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:11:47Z,use_quota=True,user_id='118d321c471c4eb281e6cc3e2bf90691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:11:47 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-267e6e7f-5a4e-4548-b1db-7ab0f1b6b0eb tempest-VolumesSnapshotTestJSON-895312450 None] Creating volume 305fd023-9eca-42d8-a381-0877d56ee1dc {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:11:47 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-267e6e7f-5a4e-4548-b1db-7ab0f1b6b0eb tempest-VolumesSnapshotTestJSON-895312450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:47 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-267e6e7f-5a4e-4548-b1db-7ab0f1b6b0eb tempest-VolumesSnapshotTestJSON-895312450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:47 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-267e6e7f-5a4e-4548-b1db-7ab0f1b6b0eb tempest-VolumesSnapshotTestJSON-895312450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:11:47 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-267e6e7f-5a4e-4548-b1db-7ab0f1b6b0eb tempest-VolumesSnapshotTestJSON-895312450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:11:47 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-267e6e7f-5a4e-4548-b1db-7ab0f1b6b0eb tempest-VolumesSnapshotTestJSON-895312450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:47 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-267e6e7f-5a4e-4548-b1db-7ab0f1b6b0eb tempest-VolumesSnapshotTestJSON-895312450 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:11:47 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-267e6e7f-5a4e-4548-b1db-7ab0f1b6b0eb tempest-VolumesSnapshotTestJSON-895312450 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:11:47 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-267e6e7f-5a4e-4548-b1db-7ab0f1b6b0eb tempest-VolumesSnapshotTestJSON-895312450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-305fd023-9eca-42d8-a381-0877d56ee1dc 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:47 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-e2bbc9a7-4c8f-496f-ad02-fb04b73784a0 tempest-VolumesActionsTest-2098528605 None] Lock "cinder-0d7d129c-4636-455d-9a5d-8b16113a4734-delete_volume" acquired by "delete_volume" :: waited 0.120s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:11:47 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-9bb9d174-230d-4efa-8343-e70cab348cea tempest-VolumeDependencyTests-693181165 None] Created reservations ['93cda642-a719-4595-8849-a3b37e5355f4', 'b5f0ad25-7204-435f-867a-44734ac889b2', '253fe2d7-f58d-47b6-b996-71d86838ebd6', '9546e580-f71a-4f0a-b380-1c7d5159b0e6'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:11:47 devstack sudo[88815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-305fd023-9eca-42d8-a381-0877d56ee1dc 1073741824
Apr 15 20:11:47 devstack sudo[88815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:47 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-e2bbc9a7-4c8f-496f-ad02-fb04b73784a0 tempest-VolumesActionsTest-2098528605 None] Acquiring lock "cinder-quobyte-0d7d129c-4636-455d-9a5d-8b16113a4734" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:11:47 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-e2bbc9a7-4c8f-496f-ad02-fb04b73784a0 tempest-VolumesActionsTest-2098528605 None] Lock "cinder-quobyte-0d7d129c-4636-455d-9a5d-8b16113a4734" acquired by "delete_volume" :: waited 0.010s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:11:47 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e5f024-fcf8-4146-8fa5-4e931ea8601d]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:11:47 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e2bbc9a7-4c8f-496f-ad02-fb04b73784a0 tempest-VolumesActionsTest-2098528605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0d7d129c-4636-455d-9a5d-8b16113a4734 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:47 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-9bb9d174-230d-4efa-8343-e70cab348cea tempest-VolumeDependencyTests-693181165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:47 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-9bb9d174-230d-4efa-8343-e70cab348cea tempest-VolumeDependencyTests-693181165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:47 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-9bb9d174-230d-4efa-8343-e70cab348cea tempest-VolumeDependencyTests-693181165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:11:47 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-9bb9d174-230d-4efa-8343-e70cab348cea tempest-VolumeDependencyTests-693181165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:11:47 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-9bb9d174-230d-4efa-8343-e70cab348cea tempest-VolumeDependencyTests-693181165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:47 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-9bb9d174-230d-4efa-8343-e70cab348cea tempest-VolumeDependencyTests-693181165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:47 devstack sudo[88818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:11:47 devstack sudo[88818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:47 devstack sudo[88817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0d7d129c-4636-455d-9a5d-8b16113a4734
Apr 15 20:11:47 devstack sudo[88817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:48 devstack sudo[88815]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-267e6e7f-5a4e-4548-b1db-7ab0f1b6b0eb tempest-VolumesSnapshotTestJSON-895312450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-305fd023-9eca-42d8-a381-0877d56ee1dc 1073741824" returned: 0 in 0.570s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-267e6e7f-5a4e-4548-b1db-7ab0f1b6b0eb tempest-VolumesSnapshotTestJSON-895312450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-305fd023-9eca-42d8-a381-0877d56ee1dc {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:48 devstack sudo[88828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-305fd023-9eca-42d8-a381-0877d56ee1dc
Apr 15 20:11:48 devstack sudo[88828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:48 devstack sudo[88818]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-9bb9d174-230d-4efa-8343-e70cab348cea tempest-VolumeDependencyTests-693181165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.534s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:48 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-9bb9d174-230d-4efa-8343-e70cab348cea tempest-VolumeDependencyTests-693181165 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:11:48 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-9bb9d174-230d-4efa-8343-e70cab348cea tempest-VolumeDependencyTests-693181165 None] Deleted volume successfully.
Apr 15 20:11:48 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-9bb9d174-230d-4efa-8343-e70cab348cea tempest-VolumeDependencyTests-693181165 None] Lock "cinder-2cfcd7b4-057b-4951-a963-6aac4ee2eaac-delete_volume" released by "delete_volume" :: held 2.208s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:11:48 devstack sudo[88817]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e2bbc9a7-4c8f-496f-ad02-fb04b73784a0 tempest-VolumesActionsTest-2098528605 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0d7d129c-4636-455d-9a5d-8b16113a4734" returned: 0 in 0.617s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e2bbc9a7-4c8f-496f-ad02-fb04b73784a0 tempest-VolumesActionsTest-2098528605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0d7d129c-4636-455d-9a5d-8b16113a4734 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:48 devstack sudo[88830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0d7d129c-4636-455d-9a5d-8b16113a4734
Apr 15 20:11:48 devstack sudo[88830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:48 devstack sudo[88828]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-267e6e7f-5a4e-4548-b1db-7ab0f1b6b0eb tempest-VolumesSnapshotTestJSON-895312450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-305fd023-9eca-42d8-a381-0877d56ee1dc" returned: 0 in 0.513s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:48 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-267e6e7f-5a4e-4548-b1db-7ab0f1b6b0eb tempest-VolumesSnapshotTestJSON-895312450 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:11:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-267e6e7f-5a4e-4548-b1db-7ab0f1b6b0eb tempest-VolumesSnapshotTestJSON-895312450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-267e6e7f-5a4e-4548-b1db-7ab0f1b6b0eb tempest-VolumesSnapshotTestJSON-895312450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d55e15e-c78c-4a89-9536-94d0d2ee36ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-305fd023-9eca-42d8-a381-0877d56ee1dc', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-267e6e7f-5a4e-4548-b1db-7ab0f1b6b0eb tempest-VolumesSnapshotTestJSON-895312450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f0a0426-5d8f-4e13-ad01-d9868b25b04d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:48 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-267e6e7f-5a4e-4548-b1db-7ab0f1b6b0eb tempest-VolumesSnapshotTestJSON-895312450 None] Volume volume-305fd023-9eca-42d8-a381-0877d56ee1dc (305fd023-9eca-42d8-a381-0877d56ee1dc): created successfully
Apr 15 20:11:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-267e6e7f-5a4e-4548-b1db-7ab0f1b6b0eb tempest-VolumesSnapshotTestJSON-895312450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f0a0426-5d8f-4e13-ad01-d9868b25b04d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-267e6e7f-5a4e-4548-b1db-7ab0f1b6b0eb tempest-VolumesSnapshotTestJSON-895312450 None] Flow 'volume_create_manager' (2aa4e5e9-1016-4360-9073-d1bf9939751e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:11:48 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-f090bb61-41e0-41f8-98e2-e2e729f02c87 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:11:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f090bb61-41e0-41f8-98e2-e2e729f02c87 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Flow 'volume_create_manager' (6cc61666-839e-4f00-8ca7-2fbe3cb0e43d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:11:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f090bb61-41e0-41f8-98e2-e2e729f02c87 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2769d97-a5ae-43d2-ad58-44c162e05216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:48 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-267e6e7f-5a4e-4548-b1db-7ab0f1b6b0eb tempest-VolumesSnapshotTestJSON-895312450 None] Created volume successfully.
Apr 15 20:11:48 devstack sudo[88830]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f090bb61-41e0-41f8-98e2-e2e729f02c87 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2769d97-a5ae-43d2-ad58-44c162e05216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:11:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-47017776',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05c2f78d-752b-4548-9f80-6f881eb8df0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4500f17699b24425b14051ca69e1bd12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:11:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:11:49Z,use_quota=True,user_id='bb0764b340e7406da68d274103fc74e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f090bb61-41e0-41f8-98e2-e2e729f02c87 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3881197-4442-41e8-ad36-42ef25eaf5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f090bb61-41e0-41f8-98e2-e2e729f02c87 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3881197-4442-41e8-ad36-42ef25eaf5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f090bb61-41e0-41f8-98e2-e2e729f02c87 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69ff260f-6185-4c0a-9832-5b5c3bbee654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f090bb61-41e0-41f8-98e2-e2e729f02c87 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69ff260f-6185-4c0a-9832-5b5c3bbee654) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05c2f78d-752b-4548-9f80-6f881eb8df0c', 'volume_name': 'volume-05c2f78d-752b-4548-9f80-6f881eb8df0c', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f090bb61-41e0-41f8-98e2-e2e729f02c87 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3688682-7ebf-4ce7-b62a-aac40237b27f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f090bb61-41e0-41f8-98e2-e2e729f02c87 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3688682-7ebf-4ce7-b62a-aac40237b27f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f090bb61-41e0-41f8-98e2-e2e729f02c87 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (592ae540-0ff3-483f-946a-eb52c90229fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:48 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-f090bb61-41e0-41f8-98e2-e2e729f02c87 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Volume 05c2f78d-752b-4548-9f80-6f881eb8df0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05c2f78d-752b-4548-9f80-6f881eb8df0c', 'volume_size': 1}
Apr 15 20:11:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-f090bb61-41e0-41f8-98e2-e2e729f02c87 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-f090bb61-41e0-41f8-98e2-e2e729f02c87 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:48 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-f090bb61-41e0-41f8-98e2-e2e729f02c87 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:11:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-47017776',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05c2f78d-752b-4548-9f80-6f881eb8df0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4500f17699b24425b14051ca69e1bd12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:11:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:11:49Z,use_quota=True,user_id='bb0764b340e7406da68d274103fc74e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:11:48 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-f090bb61-41e0-41f8-98e2-e2e729f02c87 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Creating volume 05c2f78d-752b-4548-9f80-6f881eb8df0c {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:11:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-f090bb61-41e0-41f8-98e2-e2e729f02c87 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-f090bb61-41e0-41f8-98e2-e2e729f02c87 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:48 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-f090bb61-41e0-41f8-98e2-e2e729f02c87 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:11:48 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-f090bb61-41e0-41f8-98e2-e2e729f02c87 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:11:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-f090bb61-41e0-41f8-98e2-e2e729f02c87 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:48 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-f090bb61-41e0-41f8-98e2-e2e729f02c87 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:11:48 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-f090bb61-41e0-41f8-98e2-e2e729f02c87 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:11:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-f090bb61-41e0-41f8-98e2-e2e729f02c87 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-05c2f78d-752b-4548-9f80-6f881eb8df0c 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e2bbc9a7-4c8f-496f-ad02-fb04b73784a0 tempest-VolumesActionsTest-2098528605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0d7d129c-4636-455d-9a5d-8b16113a4734" returned: 0 in 0.556s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:48 devstack sudo[88834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-05c2f78d-752b-4548-9f80-6f881eb8df0c 1073741824
Apr 15 20:11:48 devstack sudo[88834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:48 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-e2bbc9a7-4c8f-496f-ad02-fb04b73784a0 tempest-VolumesActionsTest-2098528605 None] Lock "cinder-quobyte-0d7d129c-4636-455d-9a5d-8b16113a4734" released by "delete_volume" :: held 1.199s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:11:48 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-e2bbc9a7-4c8f-496f-ad02-fb04b73784a0 tempest-VolumesActionsTest-2098528605 None] Created reservations ['65618ce2-96e9-465c-8b95-da4672f7638e', 'aa454882-c026-44c6-a92b-57ba68e25ca5', 'f2391f4d-8e3b-4b04-9ac0-a108dcfed09a', 'cc14b3d5-655a-4fd1-ac17-49433a73ca07'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:11:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-e2bbc9a7-4c8f-496f-ad02-fb04b73784a0 tempest-VolumesActionsTest-2098528605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-e2bbc9a7-4c8f-496f-ad02-fb04b73784a0 tempest-VolumesActionsTest-2098528605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:48 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-e2bbc9a7-4c8f-496f-ad02-fb04b73784a0 tempest-VolumesActionsTest-2098528605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:11:48 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-e2bbc9a7-4c8f-496f-ad02-fb04b73784a0 tempest-VolumesActionsTest-2098528605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:11:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-e2bbc9a7-4c8f-496f-ad02-fb04b73784a0 tempest-VolumesActionsTest-2098528605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e2bbc9a7-4c8f-496f-ad02-fb04b73784a0 tempest-VolumesActionsTest-2098528605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:48 devstack sudo[88836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:11:48 devstack sudo[88836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:48 devstack cinder-volume[82646]: DEBUG oslo_service.periodic_task [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 15 20:11:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:48 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:11:48 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:11:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:48 devstack sudo[88838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:11:48 devstack sudo[88838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:49 devstack sudo[88836]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:49 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e2bbc9a7-4c8f-496f-ad02-fb04b73784a0 tempest-VolumesActionsTest-2098528605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.505s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:49 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-e2bbc9a7-4c8f-496f-ad02-fb04b73784a0 tempest-VolumesActionsTest-2098528605 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:11:49 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-e2bbc9a7-4c8f-496f-ad02-fb04b73784a0 tempest-VolumesActionsTest-2098528605 None] Deleted volume successfully.
Apr 15 20:11:49 devstack sudo[88834]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:49 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-e2bbc9a7-4c8f-496f-ad02-fb04b73784a0 tempest-VolumesActionsTest-2098528605 None] Lock "cinder-0d7d129c-4636-455d-9a5d-8b16113a4734-delete_volume" released by "delete_volume" :: held 1.871s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:11:49 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-f090bb61-41e0-41f8-98e2-e2e729f02c87 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-05c2f78d-752b-4548-9f80-6f881eb8df0c 1073741824" returned: 0 in 0.636s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:49 devstack cinder-volume[82646]: DEBUG dbcounter [-] [82646] Writing DB stats cinder:UPDATE=293,cinder:SELECT=201,cinder:DELETE=25,cinder:INSERT=72 {{(pid=82646) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 20:11:49 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-f090bb61-41e0-41f8-98e2-e2e729f02c87 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-05c2f78d-752b-4548-9f80-6f881eb8df0c {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:49 devstack sudo[88845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-05c2f78d-752b-4548-9f80-6f881eb8df0c
Apr 15 20:11:49 devstack sudo[88845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:49 devstack sudo[88838]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:49 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.548s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:49 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:11:49 devstack cinder-volume[82646]: DEBUG dbcounter [-] [82646] Writing DB stats cinder:SELECT=211,cinder:UPDATE=260,cinder:INSERT=75,cinder:DELETE=22 {{(pid=82646) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 20:11:49 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-f78aa18a-23a6-4550-8d33-5056234b4232 tempest-VolumesSnapshotTestJSON-895312450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:49 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c1df5f8-7fa2-4bd3-a885-2a16a5e84e28 tempest-VolumesActionsTest-1438461382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:11:49 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-5c1df5f8-7fa2-4bd3-a885-2a16a5e84e28 tempest-VolumesActionsTest-1438461382 None] Flow 'volume_create_manager' (86e6119e-60ef-4184-9e0a-05ea01fe7d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:11:49 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-5c1df5f8-7fa2-4bd3-a885-2a16a5e84e28 tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b13d981-74d2-4fca-a459-46d3cd4181a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:49 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-5c1df5f8-7fa2-4bd3-a885-2a16a5e84e28 tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b13d981-74d2-4fca-a459-46d3cd4181a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:11:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1840340017',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52b0b3d7-3892-456d-abd3-c4170159fac6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df37bd8c7f7a4cea8e7e0beb744ae494',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:11:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:11:50Z,use_quota=True,user_id='51042bd29b7a4a579be7666e3269ba93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:49 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-5c1df5f8-7fa2-4bd3-a885-2a16a5e84e28 tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b0f9152-078d-4522-8ad3-fe6ecd263a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:49 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-5c1df5f8-7fa2-4bd3-a885-2a16a5e84e28 tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b0f9152-078d-4522-8ad3-fe6ecd263a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:49 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-5c1df5f8-7fa2-4bd3-a885-2a16a5e84e28 tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1063620-1075-4baf-aeb8-b797cffd8f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:49 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-5c1df5f8-7fa2-4bd3-a885-2a16a5e84e28 tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1063620-1075-4baf-aeb8-b797cffd8f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52b0b3d7-3892-456d-abd3-c4170159fac6', 'volume_name': 'volume-52b0b3d7-3892-456d-abd3-c4170159fac6', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:49 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-5c1df5f8-7fa2-4bd3-a885-2a16a5e84e28 tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aba767e1-4738-43cf-88e7-bbf95d7c288c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:49 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-5c1df5f8-7fa2-4bd3-a885-2a16a5e84e28 tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aba767e1-4738-43cf-88e7-bbf95d7c288c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:49 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-5c1df5f8-7fa2-4bd3-a885-2a16a5e84e28 tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df450785-b064-4fec-b161-a9bca9633e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:49 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-5c1df5f8-7fa2-4bd3-a885-2a16a5e84e28 tempest-VolumesActionsTest-1438461382 None] Volume 52b0b3d7-3892-456d-abd3-c4170159fac6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52b0b3d7-3892-456d-abd3-c4170159fac6', 'volume_size': 1}
Apr 15 20:11:49 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-5c1df5f8-7fa2-4bd3-a885-2a16a5e84e28 tempest-VolumesActionsTest-1438461382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:49 devstack sudo[88845]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:49 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-f090bb61-41e0-41f8-98e2-e2e729f02c87 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-05c2f78d-752b-4548-9f80-6f881eb8df0c" returned: 0 in 0.614s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:49 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-f090bb61-41e0-41f8-98e2-e2e729f02c87 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] <== create_volume: return (1278ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:11:49 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-f090bb61-41e0-41f8-98e2-e2e729f02c87 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.280s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:49 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-f78aa18a-23a6-4550-8d33-5056234b4232 tempest-VolumesSnapshotTestJSON-895312450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.373s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:49 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-f78aa18a-23a6-4550-8d33-5056234b4232 tempest-VolumesSnapshotTestJSON-895312450 None] Creating offline snapshot db1c72de-68d3-45b5-a700-31191327e3c1 of volume 305fd023-9eca-42d8-a381-0877d56ee1dc {{(pid=82646) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 20:11:50 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f090bb61-41e0-41f8-98e2-e2e729f02c87 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (592ae540-0ff3-483f-946a-eb52c90229fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05c2f78d-752b-4548-9f80-6f881eb8df0c', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:50 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f090bb61-41e0-41f8-98e2-e2e729f02c87 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57627dae-d129-4787-8314-d488a78c4f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:50 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ddd9428-d2d9-41c7-b0c1-3d69079d751a]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:11:50 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-f78aa18a-23a6-4550-8d33-5056234b4232 tempest-VolumesSnapshotTestJSON-895312450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-305fd023-9eca-42d8-a381-0877d56ee1dc {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:50 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-f090bb61-41e0-41f8-98e2-e2e729f02c87 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Volume volume-05c2f78d-752b-4548-9f80-6f881eb8df0c (05c2f78d-752b-4548-9f80-6f881eb8df0c): created successfully
Apr 15 20:11:50 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f090bb61-41e0-41f8-98e2-e2e729f02c87 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57627dae-d129-4787-8314-d488a78c4f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:50 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f090bb61-41e0-41f8-98e2-e2e729f02c87 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Flow 'volume_create_manager' (6cc61666-839e-4f00-8ca7-2fbe3cb0e43d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:11:50 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-f090bb61-41e0-41f8-98e2-e2e729f02c87 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Created volume successfully.
Apr 15 20:11:50 devstack sudo[88848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-305fd023-9eca-42d8-a381-0877d56ee1dc
Apr 15 20:11:50 devstack sudo[88848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:50 devstack sudo[88848]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:50 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-f78aa18a-23a6-4550-8d33-5056234b4232 tempest-VolumesSnapshotTestJSON-895312450 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-305fd023-9eca-42d8-a381-0877d56ee1dc" returned: 0 in 0.546s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:50 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-f78aa18a-23a6-4550-8d33-5056234b4232 tempest-VolumesSnapshotTestJSON-895312450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-305fd023-9eca-42d8-a381-0877d56ee1dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-305fd023-9eca-42d8-a381-0877d56ee1dc.db1c72de-68d3-45b5-a700-31191327e3c1 1G {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:50 devstack sudo[88853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-305fd023-9eca-42d8-a381-0877d56ee1dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-305fd023-9eca-42d8-a381-0877d56ee1dc.db1c72de-68d3-45b5-a700-31191327e3c1 1G
Apr 15 20:11:50 devstack sudo[88853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:51 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-b78cf82e-dae8-4553-b20d-e712bb18b379 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:11:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b78cf82e-dae8-4553-b20d-e712bb18b379 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Flow 'volume_create_manager' (6b1b17d0-2276-4a4d-9f70-c018b2e0a99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:11:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b78cf82e-dae8-4553-b20d-e712bb18b379 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64882ae2-b59f-48ea-8881-426e0cbd24ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b78cf82e-dae8-4553-b20d-e712bb18b379 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64882ae2-b59f-48ea-8881-426e0cbd24ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:11:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-603657444',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=387ee128-dab4-4fff-9af1-bc82b204acff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4500f17699b24425b14051ca69e1bd12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:11:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:11:51Z,use_quota=True,user_id='bb0764b340e7406da68d274103fc74e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:51 devstack sudo[88853]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b78cf82e-dae8-4553-b20d-e712bb18b379 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a41c380-1ed4-40e0-9b37-1d63f57dea05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b78cf82e-dae8-4553-b20d-e712bb18b379 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a41c380-1ed4-40e0-9b37-1d63f57dea05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b78cf82e-dae8-4553-b20d-e712bb18b379 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09a99b2d-786b-4f4d-ae23-bd3e7957aa40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b78cf82e-dae8-4553-b20d-e712bb18b379 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09a99b2d-786b-4f4d-ae23-bd3e7957aa40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '387ee128-dab4-4fff-9af1-bc82b204acff', 'volume_name': 'volume-387ee128-dab4-4fff-9af1-bc82b204acff', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b78cf82e-dae8-4553-b20d-e712bb18b379 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd681804-589e-4057-a129-443ff432bfe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b78cf82e-dae8-4553-b20d-e712bb18b379 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd681804-589e-4057-a129-443ff432bfe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b78cf82e-dae8-4553-b20d-e712bb18b379 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eaa7d09-9ca0-46e4-bfd6-10d2044203fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:51 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-b78cf82e-dae8-4553-b20d-e712bb18b379 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Volume 387ee128-dab4-4fff-9af1-bc82b204acff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-387ee128-dab4-4fff-9af1-bc82b204acff', 'volume_size': 1}
Apr 15 20:11:51 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-b78cf82e-dae8-4553-b20d-e712bb18b379 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:51 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-f78aa18a-23a6-4550-8d33-5056234b4232 tempest-VolumesSnapshotTestJSON-895312450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-305fd023-9eca-42d8-a381-0877d56ee1dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-305fd023-9eca-42d8-a381-0877d56ee1dc.db1c72de-68d3-45b5-a700-31191327e3c1 1G" returned: 0 in 0.626s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:51 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-f78aa18a-23a6-4550-8d33-5056234b4232 tempest-VolumesSnapshotTestJSON-895312450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-305fd023-9eca-42d8-a381-0877d56ee1dc -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-305fd023-9eca-42d8-a381-0877d56ee1dc.db1c72de-68d3-45b5-a700-31191327e3c1 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:51 devstack sudo[88858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-305fd023-9eca-42d8-a381-0877d56ee1dc -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-305fd023-9eca-42d8-a381-0877d56ee1dc.db1c72de-68d3-45b5-a700-31191327e3c1
Apr 15 20:11:51 devstack sudo[88858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:51 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-50e6223b-8e42-40c1-bea0-cf3123ccdf73 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:11:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-50e6223b-8e42-40c1-bea0-cf3123ccdf73 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Flow 'volume_create_manager' (deb1b13e-0513-440b-b621-cee0bb33c4a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:11:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-50e6223b-8e42-40c1-bea0-cf3123ccdf73 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e89c2c2e-4935-4c3b-b505-9a593b975a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-50e6223b-8e42-40c1-bea0-cf3123ccdf73 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e89c2c2e-4935-4c3b-b505-9a593b975a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:11:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-206681198',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f4e3126-4700-45c5-875e-050424c25623,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4500f17699b24425b14051ca69e1bd12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:11:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:11:51Z,use_quota=True,user_id='bb0764b340e7406da68d274103fc74e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-50e6223b-8e42-40c1-bea0-cf3123ccdf73 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af772b8f-d366-4324-88a6-891149a6aea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-50e6223b-8e42-40c1-bea0-cf3123ccdf73 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af772b8f-d366-4324-88a6-891149a6aea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-50e6223b-8e42-40c1-bea0-cf3123ccdf73 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (126c011e-56ce-4339-83d9-23ab29c76e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-50e6223b-8e42-40c1-bea0-cf3123ccdf73 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (126c011e-56ce-4339-83d9-23ab29c76e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f4e3126-4700-45c5-875e-050424c25623', 'volume_name': 'volume-8f4e3126-4700-45c5-875e-050424c25623', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-50e6223b-8e42-40c1-bea0-cf3123ccdf73 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c1aecaa-c9b2-41ae-9936-592114dfcac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-50e6223b-8e42-40c1-bea0-cf3123ccdf73 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c1aecaa-c9b2-41ae-9936-592114dfcac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-50e6223b-8e42-40c1-bea0-cf3123ccdf73 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88b6c87a-047d-4ed6-aff6-32fb2dffbcb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:51 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-50e6223b-8e42-40c1-bea0-cf3123ccdf73 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Volume 8f4e3126-4700-45c5-875e-050424c25623: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f4e3126-4700-45c5-875e-050424c25623', 'volume_size': 1}
Apr 15 20:11:51 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-50e6223b-8e42-40c1-bea0-cf3123ccdf73 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:51 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ae40048-647e-4f17-8d35-ae2684f4ba9c tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:11:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-6ae40048-647e-4f17-8d35-ae2684f4ba9c tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Flow 'volume_create_manager' (bf7ed64a-161a-4847-914a-3a818d74972a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:11:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-6ae40048-647e-4f17-8d35-ae2684f4ba9c tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc8ffa11-712e-4c64-851d-3a86594510db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-6ae40048-647e-4f17-8d35-ae2684f4ba9c tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc8ffa11-712e-4c64-851d-3a86594510db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:11:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1331757274',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fa9427f-78ba-4a7b-9850-5c6dfd36ecea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4500f17699b24425b14051ca69e1bd12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:11:52Z,use_quota=True,user_id='bb0764b340e7406da68d274103fc74e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-6ae40048-647e-4f17-8d35-ae2684f4ba9c tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4cb8f8c-f274-4d9d-8943-8a31a9a9d4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-6ae40048-647e-4f17-8d35-ae2684f4ba9c tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4cb8f8c-f274-4d9d-8943-8a31a9a9d4ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-6ae40048-647e-4f17-8d35-ae2684f4ba9c tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a02c9770-66ad-42ba-8961-12297cb3bcff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-6ae40048-647e-4f17-8d35-ae2684f4ba9c tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a02c9770-66ad-42ba-8961-12297cb3bcff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fa9427f-78ba-4a7b-9850-5c6dfd36ecea', 'volume_name': 'volume-1fa9427f-78ba-4a7b-9850-5c6dfd36ecea', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-6ae40048-647e-4f17-8d35-ae2684f4ba9c tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f26e880-af4c-4277-8efb-66ff21475e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-6ae40048-647e-4f17-8d35-ae2684f4ba9c tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f26e880-af4c-4277-8efb-66ff21475e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-6ae40048-647e-4f17-8d35-ae2684f4ba9c tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6221a126-1c30-4892-9faf-3a7115bcb9d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:51 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-6ae40048-647e-4f17-8d35-ae2684f4ba9c tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Volume 1fa9427f-78ba-4a7b-9850-5c6dfd36ecea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fa9427f-78ba-4a7b-9850-5c6dfd36ecea', 'volume_size': 1}
Apr 15 20:11:51 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-6ae40048-647e-4f17-8d35-ae2684f4ba9c tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:51 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-83b0ad57-99ad-4105-9949-5c9a2db45b59 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:11:51 devstack sudo[88858]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-83b0ad57-99ad-4105-9949-5c9a2db45b59 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Flow 'volume_create_manager' (4ab6e4ea-c119-4fd2-b7af-35e3ed77b0b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:11:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-83b0ad57-99ad-4105-9949-5c9a2db45b59 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1d7c90a-d6f9-4f70-b74e-fe7ff1dcd335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-83b0ad57-99ad-4105-9949-5c9a2db45b59 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1d7c90a-d6f9-4f70-b74e-fe7ff1dcd335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:11:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-616164071',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f39c931-14b7-42f4-9dc3-7382311d60b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4500f17699b24425b14051ca69e1bd12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:11:52Z,use_quota=True,user_id='bb0764b340e7406da68d274103fc74e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-83b0ad57-99ad-4105-9949-5c9a2db45b59 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c70a2a29-c9fc-40f9-86ad-edb189377a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-83b0ad57-99ad-4105-9949-5c9a2db45b59 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c70a2a29-c9fc-40f9-86ad-edb189377a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-83b0ad57-99ad-4105-9949-5c9a2db45b59 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61a3cc03-e632-4116-9328-d52d7c9d6e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-83b0ad57-99ad-4105-9949-5c9a2db45b59 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61a3cc03-e632-4116-9328-d52d7c9d6e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f39c931-14b7-42f4-9dc3-7382311d60b3', 'volume_name': 'volume-0f39c931-14b7-42f4-9dc3-7382311d60b3', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-83b0ad57-99ad-4105-9949-5c9a2db45b59 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df3dc578-70c5-4982-8134-31992bb905f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-83b0ad57-99ad-4105-9949-5c9a2db45b59 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df3dc578-70c5-4982-8134-31992bb905f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-83b0ad57-99ad-4105-9949-5c9a2db45b59 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1857bf58-7b73-4d98-9246-5ce39f993548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:51 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-83b0ad57-99ad-4105-9949-5c9a2db45b59 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Volume 0f39c931-14b7-42f4-9dc3-7382311d60b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f39c931-14b7-42f4-9dc3-7382311d60b3', 'volume_size': 1}
Apr 15 20:11:51 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-83b0ad57-99ad-4105-9949-5c9a2db45b59 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:51 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-f78aa18a-23a6-4550-8d33-5056234b4232 tempest-VolumesSnapshotTestJSON-895312450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-305fd023-9eca-42d8-a381-0877d56ee1dc -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-305fd023-9eca-42d8-a381-0877d56ee1dc.db1c72de-68d3-45b5-a700-31191327e3c1" returned: 0 in 0.703s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:51 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-f78aa18a-23a6-4550-8d33-5056234b4232 tempest-VolumesSnapshotTestJSON-895312450 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-305fd023-9eca-42d8-a381-0877d56ee1dc.db1c72de-68d3-45b5-a700-31191327e3c1 is being set with open permissions: ugo+rw
Apr 15 20:11:51 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-f78aa18a-23a6-4550-8d33-5056234b4232 tempest-VolumesSnapshotTestJSON-895312450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-305fd023-9eca-42d8-a381-0877d56ee1dc.db1c72de-68d3-45b5-a700-31191327e3c1 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:51 devstack sudo[88863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-305fd023-9eca-42d8-a381-0877d56ee1dc.db1c72de-68d3-45b5-a700-31191327e3c1
Apr 15 20:11:51 devstack sudo[88863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:52 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-0996c53d-8866-4870-af02-8fab464ae963 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:11:52 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-0996c53d-8866-4870-af02-8fab464ae963 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Flow 'volume_create_manager' (26a5bed2-80aa-4996-ad23-80d3aace02b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:11:52 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-0996c53d-8866-4870-af02-8fab464ae963 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18025cc4-e0d7-49db-b686-33356107d5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:52 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-0996c53d-8866-4870-af02-8fab464ae963 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18025cc4-e0d7-49db-b686-33356107d5cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:11:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-818226378',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af8aa8c1-75db-46a7-8936-e63604873a85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4500f17699b24425b14051ca69e1bd12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:11:52Z,use_quota=True,user_id='bb0764b340e7406da68d274103fc74e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:52 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-0996c53d-8866-4870-af02-8fab464ae963 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a41a63ef-4566-4611-a63e-f1cbe8477135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:52 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-0996c53d-8866-4870-af02-8fab464ae963 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a41a63ef-4566-4611-a63e-f1cbe8477135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:52 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-0996c53d-8866-4870-af02-8fab464ae963 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c220fd0c-2dfb-4686-9a1f-b0316941f2fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:52 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-0996c53d-8866-4870-af02-8fab464ae963 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c220fd0c-2dfb-4686-9a1f-b0316941f2fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af8aa8c1-75db-46a7-8936-e63604873a85', 'volume_name': 'volume-af8aa8c1-75db-46a7-8936-e63604873a85', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:52 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-0996c53d-8866-4870-af02-8fab464ae963 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cc803d4-c41f-480b-87ae-97c311e6f745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:52 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-0996c53d-8866-4870-af02-8fab464ae963 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cc803d4-c41f-480b-87ae-97c311e6f745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:52 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-0996c53d-8866-4870-af02-8fab464ae963 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (841b7d70-e56a-4b8f-8f41-bb578efae063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:52 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-0996c53d-8866-4870-af02-8fab464ae963 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Volume af8aa8c1-75db-46a7-8936-e63604873a85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af8aa8c1-75db-46a7-8936-e63604873a85', 'volume_size': 1}
Apr 15 20:11:52 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-0996c53d-8866-4870-af02-8fab464ae963 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:52 devstack sudo[88863]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:52 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-f78aa18a-23a6-4550-8d33-5056234b4232 tempest-VolumesSnapshotTestJSON-895312450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-305fd023-9eca-42d8-a381-0877d56ee1dc.db1c72de-68d3-45b5-a700-31191327e3c1" returned: 0 in 0.521s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:52 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-f78aa18a-23a6-4550-8d33-5056234b4232 tempest-VolumesSnapshotTestJSON-895312450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-305fd023-9eca-42d8-a381-0877d56ee1dc.info {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:52 devstack sudo[88866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-305fd023-9eca-42d8-a381-0877d56ee1dc.info
Apr 15 20:11:52 devstack sudo[88866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:52 devstack sudo[88866]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:52 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-f78aa18a-23a6-4550-8d33-5056234b4232 tempest-VolumesSnapshotTestJSON-895312450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-305fd023-9eca-42d8-a381-0877d56ee1dc.info" returned: 0 in 0.514s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:52 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-f78aa18a-23a6-4550-8d33-5056234b4232 tempest-VolumesSnapshotTestJSON-895312450 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-305fd023-9eca-42d8-a381-0877d56ee1dc.info is being set with open permissions: ugo+rw
Apr 15 20:11:52 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-f78aa18a-23a6-4550-8d33-5056234b4232 tempest-VolumesSnapshotTestJSON-895312450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-305fd023-9eca-42d8-a381-0877d56ee1dc.info {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:52 devstack sudo[88869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-305fd023-9eca-42d8-a381-0877d56ee1dc.info
Apr 15 20:11:52 devstack sudo[88869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:53 devstack sudo[88869]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:53 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-f78aa18a-23a6-4550-8d33-5056234b4232 tempest-VolumesSnapshotTestJSON-895312450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-305fd023-9eca-42d8-a381-0877d56ee1dc.info" returned: 0 in 0.423s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:53 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-f78aa18a-23a6-4550-8d33-5056234b4232 tempest-VolumesSnapshotTestJSON-895312450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.432s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:53 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-5c1df5f8-7fa2-4bd3-a885-2a16a5e84e28 tempest-VolumesActionsTest-1438461382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.541s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:53 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-5c1df5f8-7fa2-4bd3-a885-2a16a5e84e28 tempest-VolumesActionsTest-1438461382 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:11:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1840340017',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52b0b3d7-3892-456d-abd3-c4170159fac6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df37bd8c7f7a4cea8e7e0beb744ae494',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:11:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:11:50Z,use_quota=True,user_id='51042bd29b7a4a579be7666e3269ba93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:11:53 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-5c1df5f8-7fa2-4bd3-a885-2a16a5e84e28 tempest-VolumesActionsTest-1438461382 None] Creating volume 52b0b3d7-3892-456d-abd3-c4170159fac6 {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:11:53 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-5c1df5f8-7fa2-4bd3-a885-2a16a5e84e28 tempest-VolumesActionsTest-1438461382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:53 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-5c1df5f8-7fa2-4bd3-a885-2a16a5e84e28 tempest-VolumesActionsTest-1438461382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:53 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-5c1df5f8-7fa2-4bd3-a885-2a16a5e84e28 tempest-VolumesActionsTest-1438461382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:11:53 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-5c1df5f8-7fa2-4bd3-a885-2a16a5e84e28 tempest-VolumesActionsTest-1438461382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:11:53 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-5c1df5f8-7fa2-4bd3-a885-2a16a5e84e28 tempest-VolumesActionsTest-1438461382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:53 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-5c1df5f8-7fa2-4bd3-a885-2a16a5e84e28 tempest-VolumesActionsTest-1438461382 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:11:53 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-5c1df5f8-7fa2-4bd3-a885-2a16a5e84e28 tempest-VolumesActionsTest-1438461382 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:11:53 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5c1df5f8-7fa2-4bd3-a885-2a16a5e84e28 tempest-VolumesActionsTest-1438461382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-52b0b3d7-3892-456d-abd3-c4170159fac6 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:53 devstack sudo[88872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-52b0b3d7-3892-456d-abd3-c4170159fac6 1073741824
Apr 15 20:11:53 devstack sudo[88872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:53 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-f78aa18a-23a6-4550-8d33-5056234b4232 tempest-VolumesSnapshotTestJSON-895312450 None] Create snapshot completed successfully
Apr 15 20:11:53 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-9544a1e9-1842-4d7c-9cce-987ea7ce6571 tempest-VolumesSnapshotTestJSON-895312450 None] Acquiring lock "cinder-db1c72de-68d3-45b5-a700-31191327e3c1-delete_snapshot" by "delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:11:53 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-9544a1e9-1842-4d7c-9cce-987ea7ce6571 tempest-VolumesSnapshotTestJSON-895312450 None] Lock "cinder-db1c72de-68d3-45b5-a700-31191327e3c1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:11:53 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-9544a1e9-1842-4d7c-9cce-987ea7ce6571 tempest-VolumesSnapshotTestJSON-895312450 None] Acquiring lock "cinder-quobyte-305fd023-9eca-42d8-a381-0877d56ee1dc" by "delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:11:53 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-9544a1e9-1842-4d7c-9cce-987ea7ce6571 tempest-VolumesSnapshotTestJSON-895312450 None] Lock "cinder-quobyte-305fd023-9eca-42d8-a381-0877d56ee1dc" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:11:53 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-9544a1e9-1842-4d7c-9cce-987ea7ce6571 tempest-VolumesSnapshotTestJSON-895312450 None] Acquiring lock "cinder-quobyte-db1c72de-68d3-45b5-a700-31191327e3c1" by "_delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:11:53 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-9544a1e9-1842-4d7c-9cce-987ea7ce6571 tempest-VolumesSnapshotTestJSON-895312450 None] Lock "cinder-quobyte-db1c72de-68d3-45b5-a700-31191327e3c1" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:11:53 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-9544a1e9-1842-4d7c-9cce-987ea7ce6571 tempest-VolumesSnapshotTestJSON-895312450 None] Deleting offline snapshot db1c72de-68d3-45b5-a700-31191327e3c1 of volume 305fd023-9eca-42d8-a381-0877d56ee1dc {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 20:11:53 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-9544a1e9-1842-4d7c-9cce-987ea7ce6571 tempest-VolumesSnapshotTestJSON-895312450 None] snapshot_file for this snap is: volume-305fd023-9eca-42d8-a381-0877d56ee1dc.db1c72de-68d3-45b5-a700-31191327e3c1 {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 20:11:53 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2cf537-391f-434a-9eb6-4400a349b9a4]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:11:53 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-9544a1e9-1842-4d7c-9cce-987ea7ce6571 tempest-VolumesSnapshotTestJSON-895312450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-305fd023-9eca-42d8-a381-0877d56ee1dc.db1c72de-68d3-45b5-a700-31191327e3c1 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:54 devstack sudo[88877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-305fd023-9eca-42d8-a381-0877d56ee1dc.db1c72de-68d3-45b5-a700-31191327e3c1
Apr 15 20:11:54 devstack sudo[88877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:54 devstack sudo[88872]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:54 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5c1df5f8-7fa2-4bd3-a885-2a16a5e84e28 tempest-VolumesActionsTest-1438461382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-52b0b3d7-3892-456d-abd3-c4170159fac6 1073741824" returned: 0 in 0.729s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:54 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5c1df5f8-7fa2-4bd3-a885-2a16a5e84e28 tempest-VolumesActionsTest-1438461382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-52b0b3d7-3892-456d-abd3-c4170159fac6 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:54 devstack sudo[88879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-52b0b3d7-3892-456d-abd3-c4170159fac6
Apr 15 20:11:54 devstack sudo[88879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:54 devstack sudo[88877]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:54 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-9544a1e9-1842-4d7c-9cce-987ea7ce6571 tempest-VolumesSnapshotTestJSON-895312450 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-305fd023-9eca-42d8-a381-0877d56ee1dc.db1c72de-68d3-45b5-a700-31191327e3c1" returned: 0 in 0.626s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:54 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-9544a1e9-1842-4d7c-9cce-987ea7ce6571 tempest-VolumesSnapshotTestJSON-895312450 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-305fd023-9eca-42d8-a381-0877d56ee1dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82646) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 20:11:54 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ad079e-fdbd-48b7-b898-41d79d2dd770]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:11:54 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-9544a1e9-1842-4d7c-9cce-987ea7ce6571 tempest-VolumesSnapshotTestJSON-895312450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-305fd023-9eca-42d8-a381-0877d56ee1dc {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:54 devstack sudo[88886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-305fd023-9eca-42d8-a381-0877d56ee1dc
Apr 15 20:11:54 devstack sudo[88886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:54 devstack sudo[88879]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:54 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5c1df5f8-7fa2-4bd3-a885-2a16a5e84e28 tempest-VolumesActionsTest-1438461382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-52b0b3d7-3892-456d-abd3-c4170159fac6" returned: 0 in 0.564s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:54 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-5c1df5f8-7fa2-4bd3-a885-2a16a5e84e28 tempest-VolumesActionsTest-1438461382 None] <== create_volume: return (1325ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:11:54 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-5c1df5f8-7fa2-4bd3-a885-2a16a5e84e28 tempest-VolumesActionsTest-1438461382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.329s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:54 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-b78cf82e-dae8-4553-b20d-e712bb18b379 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.569s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:54 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-b78cf82e-dae8-4553-b20d-e712bb18b379 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:11:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-603657444',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=387ee128-dab4-4fff-9af1-bc82b204acff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4500f17699b24425b14051ca69e1bd12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:11:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:11:51Z,use_quota=True,user_id='bb0764b340e7406da68d274103fc74e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:11:54 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-b78cf82e-dae8-4553-b20d-e712bb18b379 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Creating volume 387ee128-dab4-4fff-9af1-bc82b204acff {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:11:54 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-b78cf82e-dae8-4553-b20d-e712bb18b379 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:54 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-b78cf82e-dae8-4553-b20d-e712bb18b379 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:54 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-b78cf82e-dae8-4553-b20d-e712bb18b379 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:11:54 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-b78cf82e-dae8-4553-b20d-e712bb18b379 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:11:54 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-b78cf82e-dae8-4553-b20d-e712bb18b379 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:54 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-b78cf82e-dae8-4553-b20d-e712bb18b379 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:11:54 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-b78cf82e-dae8-4553-b20d-e712bb18b379 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:11:54 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b78cf82e-dae8-4553-b20d-e712bb18b379 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-387ee128-dab4-4fff-9af1-bc82b204acff 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:54 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-5c1df5f8-7fa2-4bd3-a885-2a16a5e84e28 tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df450785-b064-4fec-b161-a9bca9633e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52b0b3d7-3892-456d-abd3-c4170159fac6', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:54 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-5c1df5f8-7fa2-4bd3-a885-2a16a5e84e28 tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae6eb0d3-7a1b-44ef-8b99-650dc6671182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:54 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-5c1df5f8-7fa2-4bd3-a885-2a16a5e84e28 tempest-VolumesActionsTest-1438461382 None] Volume volume-52b0b3d7-3892-456d-abd3-c4170159fac6 (52b0b3d7-3892-456d-abd3-c4170159fac6): created successfully
Apr 15 20:11:54 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-5c1df5f8-7fa2-4bd3-a885-2a16a5e84e28 tempest-VolumesActionsTest-1438461382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae6eb0d3-7a1b-44ef-8b99-650dc6671182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:54 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-5c1df5f8-7fa2-4bd3-a885-2a16a5e84e28 tempest-VolumesActionsTest-1438461382 None] Flow 'volume_create_manager' (86e6119e-60ef-4184-9e0a-05ea01fe7d78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:11:54 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-5c1df5f8-7fa2-4bd3-a885-2a16a5e84e28 tempest-VolumesActionsTest-1438461382 None] Created volume successfully.
Apr 15 20:11:54 devstack sudo[88888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-387ee128-dab4-4fff-9af1-bc82b204acff 1073741824
Apr 15 20:11:54 devstack sudo[88888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:55 devstack sudo[88886]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:55 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-9544a1e9-1842-4d7c-9cce-987ea7ce6571 tempest-VolumesSnapshotTestJSON-895312450 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-305fd023-9eca-42d8-a381-0877d56ee1dc" returned: 0 in 0.585s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:55 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-9544a1e9-1842-4d7c-9cce-987ea7ce6571 tempest-VolumesSnapshotTestJSON-895312450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-305fd023-9eca-42d8-a381-0877d56ee1dc.db1c72de-68d3-45b5-a700-31191327e3c1 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:55 devstack sudo[88893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-305fd023-9eca-42d8-a381-0877d56ee1dc.db1c72de-68d3-45b5-a700-31191327e3c1
Apr 15 20:11:55 devstack sudo[88893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:55 devstack sudo[88888]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:55 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b78cf82e-dae8-4553-b20d-e712bb18b379 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-387ee128-dab4-4fff-9af1-bc82b204acff 1073741824" returned: 0 in 0.721s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:55 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b78cf82e-dae8-4553-b20d-e712bb18b379 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-387ee128-dab4-4fff-9af1-bc82b204acff {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:55 devstack sudo[88898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-387ee128-dab4-4fff-9af1-bc82b204acff
Apr 15 20:11:55 devstack sudo[88898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:55 devstack sudo[88893]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:55 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-9544a1e9-1842-4d7c-9cce-987ea7ce6571 tempest-VolumesSnapshotTestJSON-895312450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-305fd023-9eca-42d8-a381-0877d56ee1dc.db1c72de-68d3-45b5-a700-31191327e3c1" returned: 0 in 0.658s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:55 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-9544a1e9-1842-4d7c-9cce-987ea7ce6571 tempest-VolumesSnapshotTestJSON-895312450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-305fd023-9eca-42d8-a381-0877d56ee1dc.db1c72de-68d3-45b5-a700-31191327e3c1 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:55 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-64c3085f-a835-4f43-859f-6f827e8e14fe tempest-VolumesActionsTest-1438461382 None] Acquiring lock "cinder-52b0b3d7-3892-456d-abd3-c4170159fac6-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:11:55 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-64c3085f-a835-4f43-859f-6f827e8e14fe tempest-VolumesActionsTest-1438461382 None] Lock "cinder-52b0b3d7-3892-456d-abd3-c4170159fac6-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:11:55 devstack sudo[88903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-305fd023-9eca-42d8-a381-0877d56ee1dc.db1c72de-68d3-45b5-a700-31191327e3c1
Apr 15 20:11:55 devstack sudo[88903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:55 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-64c3085f-a835-4f43-859f-6f827e8e14fe tempest-VolumesActionsTest-1438461382 None] Acquiring lock "cinder-quobyte-52b0b3d7-3892-456d-abd3-c4170159fac6" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:11:55 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-64c3085f-a835-4f43-859f-6f827e8e14fe tempest-VolumesActionsTest-1438461382 None] Lock "cinder-quobyte-52b0b3d7-3892-456d-abd3-c4170159fac6" acquired by "delete_volume" :: waited 0.008s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:11:55 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b728792-b8bc-4b63-b9f5-777c22e07ff6]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:11:55 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-64c3085f-a835-4f43-859f-6f827e8e14fe tempest-VolumesActionsTest-1438461382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-52b0b3d7-3892-456d-abd3-c4170159fac6 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:56 devstack sudo[88905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-52b0b3d7-3892-456d-abd3-c4170159fac6
Apr 15 20:11:56 devstack sudo[88905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:56 devstack sudo[88898]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:56 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b78cf82e-dae8-4553-b20d-e712bb18b379 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-387ee128-dab4-4fff-9af1-bc82b204acff" returned: 0 in 0.611s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:56 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-b78cf82e-dae8-4553-b20d-e712bb18b379 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] <== create_volume: return (1369ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:11:56 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-b78cf82e-dae8-4553-b20d-e712bb18b379 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.372s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:56 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-50e6223b-8e42-40c1-bea0-cf3123ccdf73 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.701s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:56 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-50e6223b-8e42-40c1-bea0-cf3123ccdf73 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:11:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-206681198',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f4e3126-4700-45c5-875e-050424c25623,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4500f17699b24425b14051ca69e1bd12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:11:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:11:51Z,use_quota=True,user_id='bb0764b340e7406da68d274103fc74e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:11:56 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-50e6223b-8e42-40c1-bea0-cf3123ccdf73 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Creating volume 8f4e3126-4700-45c5-875e-050424c25623 {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:11:56 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-50e6223b-8e42-40c1-bea0-cf3123ccdf73 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:56 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-50e6223b-8e42-40c1-bea0-cf3123ccdf73 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:56 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-50e6223b-8e42-40c1-bea0-cf3123ccdf73 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:11:56 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-50e6223b-8e42-40c1-bea0-cf3123ccdf73 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:11:56 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-50e6223b-8e42-40c1-bea0-cf3123ccdf73 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:56 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-50e6223b-8e42-40c1-bea0-cf3123ccdf73 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:11:56 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-50e6223b-8e42-40c1-bea0-cf3123ccdf73 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:11:56 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-50e6223b-8e42-40c1-bea0-cf3123ccdf73 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8f4e3126-4700-45c5-875e-050424c25623 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:56 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b78cf82e-dae8-4553-b20d-e712bb18b379 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eaa7d09-9ca0-46e4-bfd6-10d2044203fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-387ee128-dab4-4fff-9af1-bc82b204acff', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:56 devstack sudo[88909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8f4e3126-4700-45c5-875e-050424c25623 1073741824
Apr 15 20:11:56 devstack sudo[88909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:56 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b78cf82e-dae8-4553-b20d-e712bb18b379 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (291f719f-9e92-4331-a9d4-333b68cf6b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:56 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-b78cf82e-dae8-4553-b20d-e712bb18b379 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Volume volume-387ee128-dab4-4fff-9af1-bc82b204acff (387ee128-dab4-4fff-9af1-bc82b204acff): created successfully
Apr 15 20:11:56 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b78cf82e-dae8-4553-b20d-e712bb18b379 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (291f719f-9e92-4331-a9d4-333b68cf6b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:56 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b78cf82e-dae8-4553-b20d-e712bb18b379 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Flow 'volume_create_manager' (6b1b17d0-2276-4a4d-9f70-c018b2e0a99f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:11:56 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-b78cf82e-dae8-4553-b20d-e712bb18b379 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Created volume successfully.
Apr 15 20:11:56 devstack sudo[88903]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:56 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-9544a1e9-1842-4d7c-9cce-987ea7ce6571 tempest-VolumesSnapshotTestJSON-895312450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-305fd023-9eca-42d8-a381-0877d56ee1dc.db1c72de-68d3-45b5-a700-31191327e3c1" returned: 0 in 0.634s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:56 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-9544a1e9-1842-4d7c-9cce-987ea7ce6571 tempest-VolumesSnapshotTestJSON-895312450 None] Lock "cinder-quobyte-db1c72de-68d3-45b5-a700-31191327e3c1" released by "_delete_snapshot" :: held 2.571s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:11:56 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-9544a1e9-1842-4d7c-9cce-987ea7ce6571 tempest-VolumesSnapshotTestJSON-895312450 None] Lock "cinder-quobyte-305fd023-9eca-42d8-a381-0877d56ee1dc" released by "delete_snapshot" :: held 2.583s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:11:56 devstack sudo[88905]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:56 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-64c3085f-a835-4f43-859f-6f827e8e14fe tempest-VolumesActionsTest-1438461382 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-52b0b3d7-3892-456d-abd3-c4170159fac6" returned: 0 in 0.653s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:56 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-64c3085f-a835-4f43-859f-6f827e8e14fe tempest-VolumesActionsTest-1438461382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-52b0b3d7-3892-456d-abd3-c4170159fac6 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:56 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-9544a1e9-1842-4d7c-9cce-987ea7ce6571 tempest-VolumesSnapshotTestJSON-895312450 None] Created reservations ['a8a720c2-9d7c-4500-ae3a-ac6c027305b4', 'a6af68fe-750a-4601-a983-27954534cf1a', '2f78a83b-2f5c-4a9a-a4ce-255ac1149f54', 'c7e70eb9-2717-4468-9868-b6afc418d089'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:11:56 devstack sudo[88915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-52b0b3d7-3892-456d-abd3-c4170159fac6
Apr 15 20:11:56 devstack sudo[88915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:56 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-9544a1e9-1842-4d7c-9cce-987ea7ce6571 tempest-VolumesSnapshotTestJSON-895312450 None] Delete snapshot completed successfully.
Apr 15 20:11:56 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-9544a1e9-1842-4d7c-9cce-987ea7ce6571 tempest-VolumesSnapshotTestJSON-895312450 None] Lock "cinder-db1c72de-68d3-45b5-a700-31191327e3c1-delete_snapshot" released by "delete_snapshot" :: held 2.744s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:11:56 devstack sudo[88909]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:56 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-50e6223b-8e42-40c1-bea0-cf3123ccdf73 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8f4e3126-4700-45c5-875e-050424c25623 1073741824" returned: 0 in 0.772s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:56 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-50e6223b-8e42-40c1-bea0-cf3123ccdf73 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8f4e3126-4700-45c5-875e-050424c25623 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:56 devstack sudo[88920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8f4e3126-4700-45c5-875e-050424c25623
Apr 15 20:11:56 devstack sudo[88920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:57 devstack sudo[88915]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:57 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-64c3085f-a835-4f43-859f-6f827e8e14fe tempest-VolumesActionsTest-1438461382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-52b0b3d7-3892-456d-abd3-c4170159fac6" returned: 0 in 0.549s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:57 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-64c3085f-a835-4f43-859f-6f827e8e14fe tempest-VolumesActionsTest-1438461382 None] Lock "cinder-quobyte-52b0b3d7-3892-456d-abd3-c4170159fac6" released by "delete_volume" :: held 1.227s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:11:57 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-64c3085f-a835-4f43-859f-6f827e8e14fe tempest-VolumesActionsTest-1438461382 None] Created reservations ['bfdea847-8933-4a3b-900f-2498cb2795ac', 'bce45560-ce8a-4acd-b2a7-d21114a2e41f', 'a5f9e25d-7b73-4a78-8767-c56d9a097ee4', 'aa2497c4-9d56-4d46-afd9-63562d84a90b'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:11:57 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-64c3085f-a835-4f43-859f-6f827e8e14fe tempest-VolumesActionsTest-1438461382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:57 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-64c3085f-a835-4f43-859f-6f827e8e14fe tempest-VolumesActionsTest-1438461382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:57 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-64c3085f-a835-4f43-859f-6f827e8e14fe tempest-VolumesActionsTest-1438461382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:11:57 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-64c3085f-a835-4f43-859f-6f827e8e14fe tempest-VolumesActionsTest-1438461382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:11:57 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-64c3085f-a835-4f43-859f-6f827e8e14fe tempest-VolumesActionsTest-1438461382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:57 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-64c3085f-a835-4f43-859f-6f827e8e14fe tempest-VolumesActionsTest-1438461382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:57 devstack sudo[88923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:11:57 devstack sudo[88923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:57 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7a183b5-c18b-42b9-9a55-2a5595d0073a tempest-VolumesSnapshotTestJSON-895312450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:11:57 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-a7a183b5-c18b-42b9-9a55-2a5595d0073a tempest-VolumesSnapshotTestJSON-895312450 None] Flow 'volume_create_manager' (68361a4a-681a-4b75-87e3-6165d48c73ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:11:57 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-a7a183b5-c18b-42b9-9a55-2a5595d0073a tempest-VolumesSnapshotTestJSON-895312450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94450612-0ed2-485c-b214-b4db5867259a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:57 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-a7a183b5-c18b-42b9-9a55-2a5595d0073a tempest-VolumesSnapshotTestJSON-895312450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94450612-0ed2-485c-b214-b4db5867259a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-713799811',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d55a4f29-42a9-44b1-bb9a-c56a78723af0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='170389fee38140d9bf7a7115672201ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:11:57Z,use_quota=True,user_id='118d321c471c4eb281e6cc3e2bf90691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:57 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-a7a183b5-c18b-42b9-9a55-2a5595d0073a tempest-VolumesSnapshotTestJSON-895312450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (636f4b39-c906-4158-bb98-bb416550ef58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:57 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-a7a183b5-c18b-42b9-9a55-2a5595d0073a tempest-VolumesSnapshotTestJSON-895312450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (636f4b39-c906-4158-bb98-bb416550ef58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:57 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-a7a183b5-c18b-42b9-9a55-2a5595d0073a tempest-VolumesSnapshotTestJSON-895312450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5300c4d2-86eb-42ea-b12f-d45914de84e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:57 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-a7a183b5-c18b-42b9-9a55-2a5595d0073a tempest-VolumesSnapshotTestJSON-895312450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5300c4d2-86eb-42ea-b12f-d45914de84e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd55a4f29-42a9-44b1-bb9a-c56a78723af0', 'volume_name': 'volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:57 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-a7a183b5-c18b-42b9-9a55-2a5595d0073a tempest-VolumesSnapshotTestJSON-895312450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c4cc253-5687-4db3-b76f-fd92c16c39e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:57 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-a7a183b5-c18b-42b9-9a55-2a5595d0073a tempest-VolumesSnapshotTestJSON-895312450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c4cc253-5687-4db3-b76f-fd92c16c39e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:57 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-a7a183b5-c18b-42b9-9a55-2a5595d0073a tempest-VolumesSnapshotTestJSON-895312450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26d31bb8-8251-49fe-a28b-af4642b6921d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:57 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-a7a183b5-c18b-42b9-9a55-2a5595d0073a tempest-VolumesSnapshotTestJSON-895312450 None] Volume d55a4f29-42a9-44b1-bb9a-c56a78723af0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0', 'volume_size': 1}
Apr 15 20:11:57 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-a7a183b5-c18b-42b9-9a55-2a5595d0073a tempest-VolumesSnapshotTestJSON-895312450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:57 devstack sudo[88920]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:57 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-50e6223b-8e42-40c1-bea0-cf3123ccdf73 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8f4e3126-4700-45c5-875e-050424c25623" returned: 0 in 0.656s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:57 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-50e6223b-8e42-40c1-bea0-cf3123ccdf73 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] <== create_volume: return (1454ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:11:57 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-50e6223b-8e42-40c1-bea0-cf3123ccdf73 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.457s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:57 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-6ae40048-647e-4f17-8d35-ae2684f4ba9c tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.899s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:57 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-6ae40048-647e-4f17-8d35-ae2684f4ba9c tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:11:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1331757274',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fa9427f-78ba-4a7b-9850-5c6dfd36ecea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4500f17699b24425b14051ca69e1bd12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:11:52Z,use_quota=True,user_id='bb0764b340e7406da68d274103fc74e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:11:57 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-6ae40048-647e-4f17-8d35-ae2684f4ba9c tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Creating volume 1fa9427f-78ba-4a7b-9850-5c6dfd36ecea {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:11:57 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-6ae40048-647e-4f17-8d35-ae2684f4ba9c tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:57 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-6ae40048-647e-4f17-8d35-ae2684f4ba9c tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:57 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-6ae40048-647e-4f17-8d35-ae2684f4ba9c tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:11:57 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-6ae40048-647e-4f17-8d35-ae2684f4ba9c tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:11:57 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-6ae40048-647e-4f17-8d35-ae2684f4ba9c tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:57 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-6ae40048-647e-4f17-8d35-ae2684f4ba9c tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:11:57 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-6ae40048-647e-4f17-8d35-ae2684f4ba9c tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:11:57 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6ae40048-647e-4f17-8d35-ae2684f4ba9c tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-1fa9427f-78ba-4a7b-9850-5c6dfd36ecea 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:57 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-50e6223b-8e42-40c1-bea0-cf3123ccdf73 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88b6c87a-047d-4ed6-aff6-32fb2dffbcb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f4e3126-4700-45c5-875e-050424c25623', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:57 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-50e6223b-8e42-40c1-bea0-cf3123ccdf73 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62c27507-f141-4974-a41c-5174887483e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:57 devstack sudo[88926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-1fa9427f-78ba-4a7b-9850-5c6dfd36ecea 1073741824
Apr 15 20:11:57 devstack sudo[88926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:57 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-50e6223b-8e42-40c1-bea0-cf3123ccdf73 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Volume volume-8f4e3126-4700-45c5-875e-050424c25623 (8f4e3126-4700-45c5-875e-050424c25623): created successfully
Apr 15 20:11:57 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-50e6223b-8e42-40c1-bea0-cf3123ccdf73 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62c27507-f141-4974-a41c-5174887483e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:57 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-50e6223b-8e42-40c1-bea0-cf3123ccdf73 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Flow 'volume_create_manager' (deb1b13e-0513-440b-b621-cee0bb33c4a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:11:57 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-50e6223b-8e42-40c1-bea0-cf3123ccdf73 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Created volume successfully.
Apr 15 20:11:57 devstack sudo[88923]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:57 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-64c3085f-a835-4f43-859f-6f827e8e14fe tempest-VolumesActionsTest-1438461382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.510s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:57 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-64c3085f-a835-4f43-859f-6f827e8e14fe tempest-VolumesActionsTest-1438461382 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:11:57 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-64c3085f-a835-4f43-859f-6f827e8e14fe tempest-VolumesActionsTest-1438461382 None] Deleted volume successfully.
Apr 15 20:11:57 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-64c3085f-a835-4f43-859f-6f827e8e14fe tempest-VolumesActionsTest-1438461382 None] Lock "cinder-52b0b3d7-3892-456d-abd3-c4170159fac6-delete_volume" released by "delete_volume" :: held 1.872s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:11:58 devstack sudo[88926]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:58 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6ae40048-647e-4f17-8d35-ae2684f4ba9c tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-1fa9427f-78ba-4a7b-9850-5c6dfd36ecea 1073741824" returned: 0 in 0.589s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:58 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6ae40048-647e-4f17-8d35-ae2684f4ba9c tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-1fa9427f-78ba-4a7b-9850-5c6dfd36ecea {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:58 devstack sudo[88932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-1fa9427f-78ba-4a7b-9850-5c6dfd36ecea
Apr 15 20:11:58 devstack sudo[88932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:58 devstack sudo[88932]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:58 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6ae40048-647e-4f17-8d35-ae2684f4ba9c tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-1fa9427f-78ba-4a7b-9850-5c6dfd36ecea" returned: 0 in 0.529s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:58 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-6ae40048-647e-4f17-8d35-ae2684f4ba9c tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:11:58 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-6ae40048-647e-4f17-8d35-ae2684f4ba9c tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:58 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-83b0ad57-99ad-4105-9949-5c9a2db45b59 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.860s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:58 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-83b0ad57-99ad-4105-9949-5c9a2db45b59 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:11:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-616164071',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f39c931-14b7-42f4-9dc3-7382311d60b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4500f17699b24425b14051ca69e1bd12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:11:52Z,use_quota=True,user_id='bb0764b340e7406da68d274103fc74e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:11:58 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-83b0ad57-99ad-4105-9949-5c9a2db45b59 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Creating volume 0f39c931-14b7-42f4-9dc3-7382311d60b3 {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:11:58 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-83b0ad57-99ad-4105-9949-5c9a2db45b59 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:58 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-83b0ad57-99ad-4105-9949-5c9a2db45b59 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:58 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-83b0ad57-99ad-4105-9949-5c9a2db45b59 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:11:58 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-83b0ad57-99ad-4105-9949-5c9a2db45b59 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:11:58 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-83b0ad57-99ad-4105-9949-5c9a2db45b59 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:58 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-83b0ad57-99ad-4105-9949-5c9a2db45b59 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:11:58 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-83b0ad57-99ad-4105-9949-5c9a2db45b59 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:11:58 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-83b0ad57-99ad-4105-9949-5c9a2db45b59 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0f39c931-14b7-42f4-9dc3-7382311d60b3 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:58 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-6ae40048-647e-4f17-8d35-ae2684f4ba9c tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6221a126-1c30-4892-9faf-3a7115bcb9d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fa9427f-78ba-4a7b-9850-5c6dfd36ecea', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:58 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-6ae40048-647e-4f17-8d35-ae2684f4ba9c tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab9e423d-e45f-40ee-9fa9-4c5c498858a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:58 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-6ae40048-647e-4f17-8d35-ae2684f4ba9c tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Volume volume-1fa9427f-78ba-4a7b-9850-5c6dfd36ecea (1fa9427f-78ba-4a7b-9850-5c6dfd36ecea): created successfully
Apr 15 20:11:58 devstack sudo[88935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0f39c931-14b7-42f4-9dc3-7382311d60b3 1073741824
Apr 15 20:11:58 devstack sudo[88935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:58 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-6ae40048-647e-4f17-8d35-ae2684f4ba9c tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab9e423d-e45f-40ee-9fa9-4c5c498858a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:58 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-6ae40048-647e-4f17-8d35-ae2684f4ba9c tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Flow 'volume_create_manager' (bf7ed64a-161a-4847-914a-3a818d74972a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:11:58 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-6ae40048-647e-4f17-8d35-ae2684f4ba9c tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Created volume successfully.
Apr 15 20:11:59 devstack sudo[88935]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:59 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-83b0ad57-99ad-4105-9949-5c9a2db45b59 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0f39c931-14b7-42f4-9dc3-7382311d60b3 1073741824" returned: 0 in 0.542s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:59 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-83b0ad57-99ad-4105-9949-5c9a2db45b59 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0f39c931-14b7-42f4-9dc3-7382311d60b3 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:59 devstack sudo[88941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0f39c931-14b7-42f4-9dc3-7382311d60b3
Apr 15 20:11:59 devstack sudo[88941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:59 devstack sudo[88941]: pam_unix(sudo:session): session closed for user root
Apr 15 20:11:59 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-83b0ad57-99ad-4105-9949-5c9a2db45b59 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0f39c931-14b7-42f4-9dc3-7382311d60b3" returned: 0 in 0.443s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:11:59 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-83b0ad57-99ad-4105-9949-5c9a2db45b59 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:11:59 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-83b0ad57-99ad-4105-9949-5c9a2db45b59 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:59 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-0996c53d-8866-4870-af02-8fab464ae963 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.659s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:59 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-0996c53d-8866-4870-af02-8fab464ae963 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:11:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-818226378',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af8aa8c1-75db-46a7-8936-e63604873a85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4500f17699b24425b14051ca69e1bd12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:11:52Z,use_quota=True,user_id='bb0764b340e7406da68d274103fc74e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:11:59 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-0996c53d-8866-4870-af02-8fab464ae963 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Creating volume af8aa8c1-75db-46a7-8936-e63604873a85 {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:11:59 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-0996c53d-8866-4870-af02-8fab464ae963 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:11:59 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-0996c53d-8866-4870-af02-8fab464ae963 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:11:59 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-0996c53d-8866-4870-af02-8fab464ae963 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:11:59 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-0996c53d-8866-4870-af02-8fab464ae963 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:11:59 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-0996c53d-8866-4870-af02-8fab464ae963 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:11:59 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-0996c53d-8866-4870-af02-8fab464ae963 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:11:59 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-0996c53d-8866-4870-af02-8fab464ae963 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:11:59 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-0996c53d-8866-4870-af02-8fab464ae963 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-af8aa8c1-75db-46a7-8936-e63604873a85 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:11:59 devstack sudo[88944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-af8aa8c1-75db-46a7-8936-e63604873a85 1073741824
Apr 15 20:11:59 devstack sudo[88944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:11:59 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-83b0ad57-99ad-4105-9949-5c9a2db45b59 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1857bf58-7b73-4d98-9246-5ce39f993548) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f39c931-14b7-42f4-9dc3-7382311d60b3', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:59 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-83b0ad57-99ad-4105-9949-5c9a2db45b59 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea6a24a1-bf0d-4caa-9d03-1282028c65df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:11:59 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-83b0ad57-99ad-4105-9949-5c9a2db45b59 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Volume volume-0f39c931-14b7-42f4-9dc3-7382311d60b3 (0f39c931-14b7-42f4-9dc3-7382311d60b3): created successfully
Apr 15 20:11:59 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-83b0ad57-99ad-4105-9949-5c9a2db45b59 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea6a24a1-bf0d-4caa-9d03-1282028c65df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:11:59 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-83b0ad57-99ad-4105-9949-5c9a2db45b59 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Flow 'volume_create_manager' (4ab6e4ea-c119-4fd2-b7af-35e3ed77b0b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:11:59 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-83b0ad57-99ad-4105-9949-5c9a2db45b59 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Created volume successfully.
Apr 15 20:12:00 devstack sudo[88944]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:00 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-0996c53d-8866-4870-af02-8fab464ae963 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-af8aa8c1-75db-46a7-8936-e63604873a85 1073741824" returned: 0 in 0.635s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:00 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-0996c53d-8866-4870-af02-8fab464ae963 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-af8aa8c1-75db-46a7-8936-e63604873a85 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:00 devstack sudo[88949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-af8aa8c1-75db-46a7-8936-e63604873a85
Apr 15 20:12:00 devstack sudo[88949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:00 devstack sudo[88949]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:00 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-0996c53d-8866-4870-af02-8fab464ae963 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-af8aa8c1-75db-46a7-8936-e63604873a85" returned: 0 in 0.545s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:00 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-0996c53d-8866-4870-af02-8fab464ae963 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] <== create_volume: return (1203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:12:00 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-0996c53d-8866-4870-af02-8fab464ae963 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.206s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:12:00 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-a7a183b5-c18b-42b9-9a55-2a5595d0073a tempest-VolumesSnapshotTestJSON-895312450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.432s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:12:00 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-a7a183b5-c18b-42b9-9a55-2a5595d0073a tempest-VolumesSnapshotTestJSON-895312450 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-713799811',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d55a4f29-42a9-44b1-bb9a-c56a78723af0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='170389fee38140d9bf7a7115672201ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:11:57Z,use_quota=True,user_id='118d321c471c4eb281e6cc3e2bf90691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:12:00 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-a7a183b5-c18b-42b9-9a55-2a5595d0073a tempest-VolumesSnapshotTestJSON-895312450 None] Creating volume d55a4f29-42a9-44b1-bb9a-c56a78723af0 {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:12:00 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-a7a183b5-c18b-42b9-9a55-2a5595d0073a tempest-VolumesSnapshotTestJSON-895312450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:12:00 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-a7a183b5-c18b-42b9-9a55-2a5595d0073a tempest-VolumesSnapshotTestJSON-895312450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:12:00 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-a7a183b5-c18b-42b9-9a55-2a5595d0073a tempest-VolumesSnapshotTestJSON-895312450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:12:01 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-a7a183b5-c18b-42b9-9a55-2a5595d0073a tempest-VolumesSnapshotTestJSON-895312450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:12:01 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-a7a183b5-c18b-42b9-9a55-2a5595d0073a tempest-VolumesSnapshotTestJSON-895312450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:12:01 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-a7a183b5-c18b-42b9-9a55-2a5595d0073a tempest-VolumesSnapshotTestJSON-895312450 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:12:01 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-a7a183b5-c18b-42b9-9a55-2a5595d0073a tempest-VolumesSnapshotTestJSON-895312450 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:12:01 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-a7a183b5-c18b-42b9-9a55-2a5595d0073a tempest-VolumesSnapshotTestJSON-895312450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:01 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-0996c53d-8866-4870-af02-8fab464ae963 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (841b7d70-e56a-4b8f-8f41-bb578efae063) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af8aa8c1-75db-46a7-8936-e63604873a85', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:12:01 devstack sudo[88953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0 1073741824
Apr 15 20:12:01 devstack sudo[88953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:01 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-0996c53d-8866-4870-af02-8fab464ae963 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4915765-9c3c-4119-a15b-9fd14185a4e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:12:01 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-0996c53d-8866-4870-af02-8fab464ae963 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Volume volume-af8aa8c1-75db-46a7-8936-e63604873a85 (af8aa8c1-75db-46a7-8936-e63604873a85): created successfully
Apr 15 20:12:01 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-0996c53d-8866-4870-af02-8fab464ae963 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4915765-9c3c-4119-a15b-9fd14185a4e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:12:01 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-0996c53d-8866-4870-af02-8fab464ae963 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Flow 'volume_create_manager' (26a5bed2-80aa-4996-ad23-80d3aace02b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:12:01 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-0996c53d-8866-4870-af02-8fab464ae963 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Created volume successfully.
Apr 15 20:12:01 devstack sudo[88953]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:01 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-a7a183b5-c18b-42b9-9a55-2a5595d0073a tempest-VolumesSnapshotTestJSON-895312450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0 1073741824" returned: 0 in 0.576s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:01 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-a7a183b5-c18b-42b9-9a55-2a5595d0073a tempest-VolumesSnapshotTestJSON-895312450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:01 devstack sudo[88958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0
Apr 15 20:12:01 devstack sudo[88958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:02 devstack sudo[88958]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:02 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-a7a183b5-c18b-42b9-9a55-2a5595d0073a tempest-VolumesSnapshotTestJSON-895312450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0" returned: 0 in 0.519s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:02 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-a7a183b5-c18b-42b9-9a55-2a5595d0073a tempest-VolumesSnapshotTestJSON-895312450 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:12:02 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-a7a183b5-c18b-42b9-9a55-2a5595d0073a tempest-VolumesSnapshotTestJSON-895312450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:12:02 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-a7a183b5-c18b-42b9-9a55-2a5595d0073a tempest-VolumesSnapshotTestJSON-895312450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26d31bb8-8251-49fe-a28b-af4642b6921d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:12:02 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-a7a183b5-c18b-42b9-9a55-2a5595d0073a tempest-VolumesSnapshotTestJSON-895312450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (845f783a-b3dd-4a2d-b6d8-6f5cff2f7fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:12:02 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-95ee665e-38c3-4265-adb6-56fc94d9a9ff tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Acquiring lock "cinder-af8aa8c1-75db-46a7-8936-e63604873a85-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:12:02 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-a7a183b5-c18b-42b9-9a55-2a5595d0073a tempest-VolumesSnapshotTestJSON-895312450 None] Volume volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0 (d55a4f29-42a9-44b1-bb9a-c56a78723af0): created successfully
Apr 15 20:12:02 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-a7a183b5-c18b-42b9-9a55-2a5595d0073a tempest-VolumesSnapshotTestJSON-895312450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (845f783a-b3dd-4a2d-b6d8-6f5cff2f7fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:12:02 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-a7a183b5-c18b-42b9-9a55-2a5595d0073a tempest-VolumesSnapshotTestJSON-895312450 None] Flow 'volume_create_manager' (68361a4a-681a-4b75-87e3-6165d48c73ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:12:02 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-95ee665e-38c3-4265-adb6-56fc94d9a9ff tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Lock "cinder-af8aa8c1-75db-46a7-8936-e63604873a85-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:12:02 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-a7a183b5-c18b-42b9-9a55-2a5595d0073a tempest-VolumesSnapshotTestJSON-895312450 None] Created volume successfully.
Apr 15 20:12:02 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-95ee665e-38c3-4265-adb6-56fc94d9a9ff tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Acquiring lock "cinder-quobyte-af8aa8c1-75db-46a7-8936-e63604873a85" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:12:02 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-95ee665e-38c3-4265-adb6-56fc94d9a9ff tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Lock "cinder-quobyte-af8aa8c1-75db-46a7-8936-e63604873a85" acquired by "delete_volume" :: waited 0.015s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:12:02 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[970a9214-e8f2-4ecb-93c6-d8cb56e42ef7]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:12:02 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-95ee665e-38c3-4265-adb6-56fc94d9a9ff tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-af8aa8c1-75db-46a7-8936-e63604873a85 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:02 devstack sudo[88961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-af8aa8c1-75db-46a7-8936-e63604873a85
Apr 15 20:12:02 devstack sudo[88961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:02 devstack sudo[88961]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:02 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-bdbefe7e-9d02-4df0-b436-fd1b053a89cd tempest-VolumesSnapshotTestJSON-895312450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:12:02 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-bdbefe7e-9d02-4df0-b436-fd1b053a89cd tempest-VolumesSnapshotTestJSON-895312450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:12:02 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-95ee665e-38c3-4265-adb6-56fc94d9a9ff tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-af8aa8c1-75db-46a7-8936-e63604873a85" returned: 0 in 0.607s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:02 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-95ee665e-38c3-4265-adb6-56fc94d9a9ff tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-af8aa8c1-75db-46a7-8936-e63604873a85 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:02 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-bdbefe7e-9d02-4df0-b436-fd1b053a89cd tempest-VolumesSnapshotTestJSON-895312450 None] Creating offline snapshot 23d8d2d4-463f-43fb-a76f-3a6016284e28 of volume d55a4f29-42a9-44b1-bb9a-c56a78723af0 {{(pid=82646) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 20:12:02 devstack sudo[88966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-af8aa8c1-75db-46a7-8936-e63604873a85
Apr 15 20:12:02 devstack sudo[88966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:02 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c898456-068b-412f-b693-ee8ccabb05c7]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:12:02 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bdbefe7e-9d02-4df0-b436-fd1b053a89cd tempest-VolumesSnapshotTestJSON-895312450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:03 devstack sudo[88968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0
Apr 15 20:12:03 devstack sudo[88968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:03 devstack sudo[88968]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:03 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bdbefe7e-9d02-4df0-b436-fd1b053a89cd tempest-VolumesSnapshotTestJSON-895312450 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0" returned: 0 in 0.545s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:03 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bdbefe7e-9d02-4df0-b436-fd1b053a89cd tempest-VolumesSnapshotTestJSON-895312450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0.23d8d2d4-463f-43fb-a76f-3a6016284e28 1G {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:03 devstack sudo[88974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0.23d8d2d4-463f-43fb-a76f-3a6016284e28 1G
Apr 15 20:12:03 devstack sudo[88974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:03 devstack sudo[88966]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:03 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-95ee665e-38c3-4265-adb6-56fc94d9a9ff tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-af8aa8c1-75db-46a7-8936-e63604873a85" returned: 0 in 0.638s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:03 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-95ee665e-38c3-4265-adb6-56fc94d9a9ff tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Lock "cinder-quobyte-af8aa8c1-75db-46a7-8936-e63604873a85" released by "delete_volume" :: held 1.275s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:12:03 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-95ee665e-38c3-4265-adb6-56fc94d9a9ff tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Created reservations ['865789b7-e2ce-445b-a43c-16065753d0e9', 'eb8b1da2-5769-4226-8f0c-06ecaea024ff', '7311c7ef-3f1f-436c-a012-8418cd6b8111', 'c78b8cde-4ccd-47d5-a32b-ddc515204213'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:12:03 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-95ee665e-38c3-4265-adb6-56fc94d9a9ff tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:12:03 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-95ee665e-38c3-4265-adb6-56fc94d9a9ff tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:12:03 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-95ee665e-38c3-4265-adb6-56fc94d9a9ff tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:12:03 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-95ee665e-38c3-4265-adb6-56fc94d9a9ff tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:12:03 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-95ee665e-38c3-4265-adb6-56fc94d9a9ff tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:12:03 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-95ee665e-38c3-4265-adb6-56fc94d9a9ff tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:03 devstack sudo[88976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:12:03 devstack sudo[88976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:04 devstack sudo[88974]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:04 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bdbefe7e-9d02-4df0-b436-fd1b053a89cd tempest-VolumesSnapshotTestJSON-895312450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0.23d8d2d4-463f-43fb-a76f-3a6016284e28 1G" returned: 0 in 0.564s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:04 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bdbefe7e-9d02-4df0-b436-fd1b053a89cd tempest-VolumesSnapshotTestJSON-895312450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0 -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0.23d8d2d4-463f-43fb-a76f-3a6016284e28 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:04 devstack sudo[88981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0 -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0.23d8d2d4-463f-43fb-a76f-3a6016284e28
Apr 15 20:12:04 devstack sudo[88981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:04 devstack sudo[88976]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:04 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-95ee665e-38c3-4265-adb6-56fc94d9a9ff tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.558s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:04 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-95ee665e-38c3-4265-adb6-56fc94d9a9ff tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:12:04 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-95ee665e-38c3-4265-adb6-56fc94d9a9ff tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Deleted volume successfully.
Apr 15 20:12:04 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-95ee665e-38c3-4265-adb6-56fc94d9a9ff tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Lock "cinder-af8aa8c1-75db-46a7-8936-e63604873a85-delete_volume" released by "delete_volume" :: held 2.053s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:12:04 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-37a0e058-6e80-449b-9226-0645fa71f291 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Acquiring lock "cinder-0f39c931-14b7-42f4-9dc3-7382311d60b3-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:12:04 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-37a0e058-6e80-449b-9226-0645fa71f291 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Lock "cinder-0f39c931-14b7-42f4-9dc3-7382311d60b3-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:12:04 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-37a0e058-6e80-449b-9226-0645fa71f291 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Acquiring lock "cinder-quobyte-0f39c931-14b7-42f4-9dc3-7382311d60b3" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:12:04 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-37a0e058-6e80-449b-9226-0645fa71f291 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Lock "cinder-quobyte-0f39c931-14b7-42f4-9dc3-7382311d60b3" acquired by "delete_volume" :: waited 0.010s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:12:04 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[b761f15e-d72c-4b3b-b503-3bffa292cd61]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:12:04 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-37a0e058-6e80-449b-9226-0645fa71f291 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0f39c931-14b7-42f4-9dc3-7382311d60b3 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:04 devstack sudo[88985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0f39c931-14b7-42f4-9dc3-7382311d60b3
Apr 15 20:12:04 devstack sudo[88985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:04 devstack sudo[88981]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:04 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bdbefe7e-9d02-4df0-b436-fd1b053a89cd tempest-VolumesSnapshotTestJSON-895312450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0 -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0.23d8d2d4-463f-43fb-a76f-3a6016284e28" returned: 0 in 0.739s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:04 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-bdbefe7e-9d02-4df0-b436-fd1b053a89cd tempest-VolumesSnapshotTestJSON-895312450 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0.23d8d2d4-463f-43fb-a76f-3a6016284e28 is being set with open permissions: ugo+rw
Apr 15 20:12:04 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bdbefe7e-9d02-4df0-b436-fd1b053a89cd tempest-VolumesSnapshotTestJSON-895312450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0.23d8d2d4-463f-43fb-a76f-3a6016284e28 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:04 devstack sudo[88990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0.23d8d2d4-463f-43fb-a76f-3a6016284e28
Apr 15 20:12:04 devstack sudo[88990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:05 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-36c2fef7-1c13-40c6-bffc-0d7e33e2499e tempest-SnapshotDependencyTests-560057263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:12:05 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-36c2fef7-1c13-40c6-bffc-0d7e33e2499e tempest-SnapshotDependencyTests-560057263 None] Flow 'volume_create_manager' (1625fa43-8a13-4a14-a1ac-919c59ec86eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:12:05 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-36c2fef7-1c13-40c6-bffc-0d7e33e2499e tempest-SnapshotDependencyTests-560057263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7654acb4-b565-4c07-92fc-7766ad329c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:12:05 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-36c2fef7-1c13-40c6-bffc-0d7e33e2499e tempest-SnapshotDependencyTests-560057263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7654acb4-b565-4c07-92fc-7766ad329c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1620182921',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95339c3c-2ac7-4329-83c8-3e0980d3b4fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e7c49c9f36c48f3a4aba15b66508896',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:12:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:12:05Z,use_quota=True,user_id='d056a20eb34a4f34acf4ffea1e76dac1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:12:05 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-36c2fef7-1c13-40c6-bffc-0d7e33e2499e tempest-SnapshotDependencyTests-560057263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5299af4-d6cb-4952-b102-d0eda1eb5754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:12:05 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-36c2fef7-1c13-40c6-bffc-0d7e33e2499e tempest-SnapshotDependencyTests-560057263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5299af4-d6cb-4952-b102-d0eda1eb5754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:12:05 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-36c2fef7-1c13-40c6-bffc-0d7e33e2499e tempest-SnapshotDependencyTests-560057263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a309cce-1613-4560-bf66-9b3dde966b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:12:05 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-36c2fef7-1c13-40c6-bffc-0d7e33e2499e tempest-SnapshotDependencyTests-560057263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a309cce-1613-4560-bf66-9b3dde966b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95339c3c-2ac7-4329-83c8-3e0980d3b4fa', 'volume_name': 'volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:12:05 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-36c2fef7-1c13-40c6-bffc-0d7e33e2499e tempest-SnapshotDependencyTests-560057263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06845362-c0ed-4996-bf8c-2dc67285bad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:12:05 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-36c2fef7-1c13-40c6-bffc-0d7e33e2499e tempest-SnapshotDependencyTests-560057263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06845362-c0ed-4996-bf8c-2dc67285bad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:12:05 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-36c2fef7-1c13-40c6-bffc-0d7e33e2499e tempest-SnapshotDependencyTests-560057263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2b1b425-5a1d-4997-8f0f-1e91283a8a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:12:05 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-36c2fef7-1c13-40c6-bffc-0d7e33e2499e tempest-SnapshotDependencyTests-560057263 None] Volume 95339c3c-2ac7-4329-83c8-3e0980d3b4fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa', 'volume_size': 1}
Apr 15 20:12:05 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-36c2fef7-1c13-40c6-bffc-0d7e33e2499e tempest-SnapshotDependencyTests-560057263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:12:05 devstack sudo[88985]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:05 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-37a0e058-6e80-449b-9226-0645fa71f291 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0f39c931-14b7-42f4-9dc3-7382311d60b3" returned: 0 in 0.790s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:05 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-37a0e058-6e80-449b-9226-0645fa71f291 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0f39c931-14b7-42f4-9dc3-7382311d60b3 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:05 devstack sudo[88995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0f39c931-14b7-42f4-9dc3-7382311d60b3
Apr 15 20:12:05 devstack sudo[88995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:05 devstack sudo[88990]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:05 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bdbefe7e-9d02-4df0-b436-fd1b053a89cd tempest-VolumesSnapshotTestJSON-895312450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0.23d8d2d4-463f-43fb-a76f-3a6016284e28" returned: 0 in 0.752s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:05 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bdbefe7e-9d02-4df0-b436-fd1b053a89cd tempest-VolumesSnapshotTestJSON-895312450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0.info {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:05 devstack sudo[88998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0.info
Apr 15 20:12:05 devstack sudo[88998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:05 devstack sudo[88995]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:05 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-37a0e058-6e80-449b-9226-0645fa71f291 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0f39c931-14b7-42f4-9dc3-7382311d60b3" returned: 0 in 0.446s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:05 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-37a0e058-6e80-449b-9226-0645fa71f291 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Lock "cinder-quobyte-0f39c931-14b7-42f4-9dc3-7382311d60b3" released by "delete_volume" :: held 1.282s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:12:05 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-37a0e058-6e80-449b-9226-0645fa71f291 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Created reservations ['6991a346-08b3-48a1-82bb-d4424eaf5f4b', '8dd794cf-2e53-4b74-87b9-00dfc50bcce0', 'bc8b7cd7-393c-43ee-8beb-40005b24b7c7', 'dfa83ee6-0867-41b8-bf76-b7a5236fe20b'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:12:05 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-37a0e058-6e80-449b-9226-0645fa71f291 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:12:05 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-37a0e058-6e80-449b-9226-0645fa71f291 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:12:05 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-37a0e058-6e80-449b-9226-0645fa71f291 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:12:05 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-37a0e058-6e80-449b-9226-0645fa71f291 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:12:05 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-37a0e058-6e80-449b-9226-0645fa71f291 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:12:05 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-37a0e058-6e80-449b-9226-0645fa71f291 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:05 devstack sudo[89001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:12:05 devstack sudo[89001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:06 devstack sudo[88998]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:06 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bdbefe7e-9d02-4df0-b436-fd1b053a89cd tempest-VolumesSnapshotTestJSON-895312450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0.info" returned: 0 in 0.527s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:06 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-bdbefe7e-9d02-4df0-b436-fd1b053a89cd tempest-VolumesSnapshotTestJSON-895312450 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0.info is being set with open permissions: ugo+rw
Apr 15 20:12:06 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bdbefe7e-9d02-4df0-b436-fd1b053a89cd tempest-VolumesSnapshotTestJSON-895312450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0.info {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:06 devstack sudo[89005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0.info
Apr 15 20:12:06 devstack sudo[89005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:06 devstack sudo[89001]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:06 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-37a0e058-6e80-449b-9226-0645fa71f291 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.511s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:06 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-37a0e058-6e80-449b-9226-0645fa71f291 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:12:06 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-37a0e058-6e80-449b-9226-0645fa71f291 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Deleted volume successfully.
Apr 15 20:12:06 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-37a0e058-6e80-449b-9226-0645fa71f291 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Lock "cinder-0f39c931-14b7-42f4-9dc3-7382311d60b3-delete_volume" released by "delete_volume" :: held 1.950s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:12:06 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-a1788362-b75f-40aa-b46a-74c0efd95344 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Acquiring lock "cinder-1fa9427f-78ba-4a7b-9850-5c6dfd36ecea-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:12:06 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-a1788362-b75f-40aa-b46a-74c0efd95344 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Lock "cinder-1fa9427f-78ba-4a7b-9850-5c6dfd36ecea-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:12:06 devstack sudo[89005]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:06 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-a1788362-b75f-40aa-b46a-74c0efd95344 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Acquiring lock "cinder-quobyte-1fa9427f-78ba-4a7b-9850-5c6dfd36ecea" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:12:06 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bdbefe7e-9d02-4df0-b436-fd1b053a89cd tempest-VolumesSnapshotTestJSON-895312450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0.info" returned: 0 in 0.586s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:06 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-bdbefe7e-9d02-4df0-b436-fd1b053a89cd tempest-VolumesSnapshotTestJSON-895312450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.810s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:12:06 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-36c2fef7-1c13-40c6-bffc-0d7e33e2499e tempest-SnapshotDependencyTests-560057263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.524s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:12:06 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-36c2fef7-1c13-40c6-bffc-0d7e33e2499e tempest-SnapshotDependencyTests-560057263 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1620182921',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95339c3c-2ac7-4329-83c8-3e0980d3b4fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e7c49c9f36c48f3a4aba15b66508896',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:12:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:12:05Z,use_quota=True,user_id='d056a20eb34a4f34acf4ffea1e76dac1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:12:06 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-36c2fef7-1c13-40c6-bffc-0d7e33e2499e tempest-SnapshotDependencyTests-560057263 None] Creating volume 95339c3c-2ac7-4329-83c8-3e0980d3b4fa {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:12:06 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-36c2fef7-1c13-40c6-bffc-0d7e33e2499e tempest-SnapshotDependencyTests-560057263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:12:06 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-36c2fef7-1c13-40c6-bffc-0d7e33e2499e tempest-SnapshotDependencyTests-560057263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:12:06 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-36c2fef7-1c13-40c6-bffc-0d7e33e2499e tempest-SnapshotDependencyTests-560057263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:12:06 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-36c2fef7-1c13-40c6-bffc-0d7e33e2499e tempest-SnapshotDependencyTests-560057263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:12:06 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-36c2fef7-1c13-40c6-bffc-0d7e33e2499e tempest-SnapshotDependencyTests-560057263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:12:06 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-36c2fef7-1c13-40c6-bffc-0d7e33e2499e tempest-SnapshotDependencyTests-560057263 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:12:06 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-36c2fef7-1c13-40c6-bffc-0d7e33e2499e tempest-SnapshotDependencyTests-560057263 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:12:06 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-36c2fef7-1c13-40c6-bffc-0d7e33e2499e tempest-SnapshotDependencyTests-560057263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:06 devstack sudo[89010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa 1073741824
Apr 15 20:12:06 devstack sudo[89010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:06 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-a1788362-b75f-40aa-b46a-74c0efd95344 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Lock "cinder-quobyte-1fa9427f-78ba-4a7b-9850-5c6dfd36ecea" acquired by "delete_volume" :: waited 0.062s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:12:06 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce370f8-0f83-46c2-b2ee-6fa47c636216]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:12:06 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-a1788362-b75f-40aa-b46a-74c0efd95344 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-1fa9427f-78ba-4a7b-9850-5c6dfd36ecea {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:06 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-bdbefe7e-9d02-4df0-b436-fd1b053a89cd tempest-VolumesSnapshotTestJSON-895312450 None] Create snapshot completed successfully
Apr 15 20:12:06 devstack sudo[89012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-1fa9427f-78ba-4a7b-9850-5c6dfd36ecea
Apr 15 20:12:06 devstack sudo[89012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:07 devstack sudo[89012]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:07 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-a1788362-b75f-40aa-b46a-74c0efd95344 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-1fa9427f-78ba-4a7b-9850-5c6dfd36ecea" returned: 0 in 0.601s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:07 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-a1788362-b75f-40aa-b46a-74c0efd95344 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-1fa9427f-78ba-4a7b-9850-5c6dfd36ecea {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:07 devstack sudo[89020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-1fa9427f-78ba-4a7b-9850-5c6dfd36ecea
Apr 15 20:12:07 devstack sudo[89020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:07 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e463904-0e81-468b-9199-1320a834d54d tempest-VolumesSnapshotTestJSON-895312450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:12:07 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-0e463904-0e81-468b-9199-1320a834d54d tempest-VolumesSnapshotTestJSON-895312450 None] Flow 'volume_create_manager' (512b24b6-b031-4512-b3fd-68ed1da14fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:12:07 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-0e463904-0e81-468b-9199-1320a834d54d tempest-VolumesSnapshotTestJSON-895312450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9282bff-f06e-45e3-8c14-e0fdf9895cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:12:07 devstack sudo[89010]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:07 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-36c2fef7-1c13-40c6-bffc-0d7e33e2499e tempest-SnapshotDependencyTests-560057263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa 1073741824" returned: 0 in 0.757s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:07 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-0e463904-0e81-468b-9199-1320a834d54d tempest-VolumesSnapshotTestJSON-895312450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9282bff-f06e-45e3-8c14-e0fdf9895cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:12:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-386055604',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38900eb8-f7b3-48f3-8b8d-93bcb328b285,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='170389fee38140d9bf7a7115672201ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:12:07Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=23d8d2d4-463f-43fb-a76f-3a6016284e28,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:12:07Z,use_quota=True,user_id='118d321c471c4eb281e6cc3e2bf90691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:12:07 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-0e463904-0e81-468b-9199-1320a834d54d tempest-VolumesSnapshotTestJSON-895312450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceccb532-a4f5-48a0-9d12-95ae4ab278a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:12:07 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-0e463904-0e81-468b-9199-1320a834d54d tempest-VolumesSnapshotTestJSON-895312450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceccb532-a4f5-48a0-9d12-95ae4ab278a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:12:07 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-0e463904-0e81-468b-9199-1320a834d54d tempest-VolumesSnapshotTestJSON-895312450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9a90939-fd1b-4744-9d6f-ff3bf509c8e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:12:07 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-0e463904-0e81-468b-9199-1320a834d54d tempest-VolumesSnapshotTestJSON-895312450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9a90939-fd1b-4744-9d6f-ff3bf509c8e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '38900eb8-f7b3-48f3-8b8d-93bcb328b285', 'volume_name': 'volume-38900eb8-f7b3-48f3-8b8d-93bcb328b285', 'volume_size': 2, 'snapshot_id': '23d8d2d4-463f-43fb-a76f-3a6016284e28'}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:12:07 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-0e463904-0e81-468b-9199-1320a834d54d tempest-VolumesSnapshotTestJSON-895312450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f18de3ce-64ae-4bd8-a0d6-3f307c7e5597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:12:07 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-0e463904-0e81-468b-9199-1320a834d54d tempest-VolumesSnapshotTestJSON-895312450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f18de3ce-64ae-4bd8-a0d6-3f307c7e5597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:12:07 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-0e463904-0e81-468b-9199-1320a834d54d tempest-VolumesSnapshotTestJSON-895312450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae19545b-6435-45fa-8de2-6381c353f42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:12:07 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-0e463904-0e81-468b-9199-1320a834d54d tempest-VolumesSnapshotTestJSON-895312450 None] Volume 38900eb8-f7b3-48f3-8b8d-93bcb328b285: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-38900eb8-f7b3-48f3-8b8d-93bcb328b285', 'volume_size': 2, 'snapshot_id': '23d8d2d4-463f-43fb-a76f-3a6016284e28'}
Apr 15 20:12:07 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-0e463904-0e81-468b-9199-1320a834d54d tempest-VolumesSnapshotTestJSON-895312450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:12:07 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-36c2fef7-1c13-40c6-bffc-0d7e33e2499e tempest-SnapshotDependencyTests-560057263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:07 devstack sudo[89022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa
Apr 15 20:12:07 devstack sudo[89022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:07 devstack sudo[89020]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:07 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-a1788362-b75f-40aa-b46a-74c0efd95344 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-1fa9427f-78ba-4a7b-9850-5c6dfd36ecea" returned: 0 in 0.487s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:07 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-a1788362-b75f-40aa-b46a-74c0efd95344 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Lock "cinder-quobyte-1fa9427f-78ba-4a7b-9850-5c6dfd36ecea" released by "delete_volume" :: held 1.115s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:12:07 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-a1788362-b75f-40aa-b46a-74c0efd95344 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Created reservations ['859c93bf-d938-4f2f-8383-2378b99a056f', 'f5f02a52-bfcc-40b1-bb2b-60124ff73cdc', '15f95729-d8d4-4394-8e35-490a493cc85e', '4baa697a-1da0-4958-ac1a-9507b9c6d27d'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:12:07 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-a1788362-b75f-40aa-b46a-74c0efd95344 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:12:07 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-a1788362-b75f-40aa-b46a-74c0efd95344 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:12:07 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-a1788362-b75f-40aa-b46a-74c0efd95344 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:12:07 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-a1788362-b75f-40aa-b46a-74c0efd95344 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:12:07 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-a1788362-b75f-40aa-b46a-74c0efd95344 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:12:07 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-a1788362-b75f-40aa-b46a-74c0efd95344 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:07 devstack sudo[89026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:12:07 devstack sudo[89026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:08 devstack sudo[89022]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:08 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-36c2fef7-1c13-40c6-bffc-0d7e33e2499e tempest-SnapshotDependencyTests-560057263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa" returned: 0 in 0.503s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:08 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-36c2fef7-1c13-40c6-bffc-0d7e33e2499e tempest-SnapshotDependencyTests-560057263 None] <== create_volume: return (1324ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:12:08 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-36c2fef7-1c13-40c6-bffc-0d7e33e2499e tempest-SnapshotDependencyTests-560057263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.327s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:12:08 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-0e463904-0e81-468b-9199-1320a834d54d tempest-VolumesSnapshotTestJSON-895312450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.517s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:12:08 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-0e463904-0e81-468b-9199-1320a834d54d tempest-VolumesSnapshotTestJSON-895312450 None] Acquiring lock "cinder-quobyte-23d8d2d4-463f-43fb-a76f-3a6016284e28-38900eb8-f7b3-48f3-8b8d-93bcb328b285" by "_create_volume_from_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:12:08 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-36c2fef7-1c13-40c6-bffc-0d7e33e2499e tempest-SnapshotDependencyTests-560057263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2b1b425-5a1d-4997-8f0f-1e91283a8a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:12:08 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-36c2fef7-1c13-40c6-bffc-0d7e33e2499e tempest-SnapshotDependencyTests-560057263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ff4f45f-6b63-4139-abca-20f7398a05e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:12:08 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-36c2fef7-1c13-40c6-bffc-0d7e33e2499e tempest-SnapshotDependencyTests-560057263 None] Volume volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa (95339c3c-2ac7-4329-83c8-3e0980d3b4fa): created successfully
Apr 15 20:12:08 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-36c2fef7-1c13-40c6-bffc-0d7e33e2499e tempest-SnapshotDependencyTests-560057263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ff4f45f-6b63-4139-abca-20f7398a05e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:12:08 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-36c2fef7-1c13-40c6-bffc-0d7e33e2499e tempest-SnapshotDependencyTests-560057263 None] Flow 'volume_create_manager' (1625fa43-8a13-4a14-a1ac-919c59ec86eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:12:08 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-0e463904-0e81-468b-9199-1320a834d54d tempest-VolumesSnapshotTestJSON-895312450 None] Lock "cinder-quobyte-23d8d2d4-463f-43fb-a76f-3a6016284e28-38900eb8-f7b3-48f3-8b8d-93bcb328b285" acquired by "_create_volume_from_snapshot" :: waited 0.042s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:12:08 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-0e463904-0e81-468b-9199-1320a834d54d tempest-VolumesSnapshotTestJSON-895312450 None] Creating volume 38900eb8-f7b3-48f3-8b8d-93bcb328b285 from snapshot 23d8d2d4-463f-43fb-a76f-3a6016284e28 {{(pid=82646) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 15 20:12:08 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-0e463904-0e81-468b-9199-1320a834d54d tempest-VolumesSnapshotTestJSON-895312450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:12:08 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-0e463904-0e81-468b-9199-1320a834d54d tempest-VolumesSnapshotTestJSON-895312450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:12:08 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-0e463904-0e81-468b-9199-1320a834d54d tempest-VolumesSnapshotTestJSON-895312450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:12:08 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-0e463904-0e81-468b-9199-1320a834d54d tempest-VolumesSnapshotTestJSON-895312450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:12:08 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-0e463904-0e81-468b-9199-1320a834d54d tempest-VolumesSnapshotTestJSON-895312450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:12:08 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-0e463904-0e81-468b-9199-1320a834d54d tempest-VolumesSnapshotTestJSON-895312450 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:12:08 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-0e463904-0e81-468b-9199-1320a834d54d tempest-VolumesSnapshotTestJSON-895312450 None] Acquiring lock "cinder-quobyte-38900eb8-f7b3-48f3-8b8d-93bcb328b285" by "_copy_volume_from_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:12:08 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-36c2fef7-1c13-40c6-bffc-0d7e33e2499e tempest-SnapshotDependencyTests-560057263 None] Created volume successfully.
Apr 15 20:12:08 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-0e463904-0e81-468b-9199-1320a834d54d tempest-VolumesSnapshotTestJSON-895312450 None] Lock "cinder-quobyte-38900eb8-f7b3-48f3-8b8d-93bcb328b285" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:12:08 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-0e463904-0e81-468b-9199-1320a834d54d tempest-VolumesSnapshotTestJSON-895312450 None] snapshot: 23d8d2d4-463f-43fb-a76f-3a6016284e28, volume: 38900eb8-f7b3-48f3-8b8d-93bcb328b285,  {{(pid=82646) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 15 20:12:08 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-0e463904-0e81-468b-9199-1320a834d54d tempest-VolumesSnapshotTestJSON-895312450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:12:08 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-0e463904-0e81-468b-9199-1320a834d54d tempest-VolumesSnapshotTestJSON-895312450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:12:08 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-0e463904-0e81-468b-9199-1320a834d54d tempest-VolumesSnapshotTestJSON-895312450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:12:08 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-0e463904-0e81-468b-9199-1320a834d54d tempest-VolumesSnapshotTestJSON-895312450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:12:08 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-0e463904-0e81-468b-9199-1320a834d54d tempest-VolumesSnapshotTestJSON-895312450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:12:08 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[9389e16b-fa9f-4050-b8b6-cde3e74701cc]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:12:08 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-0e463904-0e81-468b-9199-1320a834d54d tempest-VolumesSnapshotTestJSON-895312450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0.23d8d2d4-463f-43fb-a76f-3a6016284e28 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:08 devstack sudo[89028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0.23d8d2d4-463f-43fb-a76f-3a6016284e28
Apr 15 20:12:08 devstack sudo[89028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:08 devstack sudo[89026]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:08 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-a1788362-b75f-40aa-b46a-74c0efd95344 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.589s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:08 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-a1788362-b75f-40aa-b46a-74c0efd95344 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:12:08 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-a1788362-b75f-40aa-b46a-74c0efd95344 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Deleted volume successfully.
Apr 15 20:12:08 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-878d5a33-d9b3-478d-a103-6d496cc99e4b tempest-SnapshotDependencyTests-560057263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:12:08 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-a1788362-b75f-40aa-b46a-74c0efd95344 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Lock "cinder-1fa9427f-78ba-4a7b-9850-5c6dfd36ecea-delete_volume" released by "delete_volume" :: held 1.903s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:12:08 devstack sudo[89028]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:08 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-0e463904-0e81-468b-9199-1320a834d54d tempest-VolumesSnapshotTestJSON-895312450 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0.23d8d2d4-463f-43fb-a76f-3a6016284e28" returned: 0 in 0.563s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:08 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-0e463904-0e81-468b-9199-1320a834d54d tempest-VolumesSnapshotTestJSON-895312450 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82646) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 20:12:08 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-0e463904-0e81-468b-9199-1320a834d54d tempest-VolumesSnapshotTestJSON-895312450 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0 {{(pid=82646) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 15 20:12:08 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-0e463904-0e81-468b-9199-1320a834d54d tempest-VolumesSnapshotTestJSON-895312450 None] Creating direct copy from snapshot {{(pid=82646) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 15 20:12:08 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[393f4403-9c8c-4ef5-9c4a-445120fb2e3f]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:12:08 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-0e463904-0e81-468b-9199-1320a834d54d tempest-VolumesSnapshotTestJSON-895312450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:08 devstack sudo[89034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0
Apr 15 20:12:08 devstack sudo[89034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:08 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-7d59f76d-d752-4e60-801e-324bdebb72da tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Acquiring lock "cinder-8f4e3126-4700-45c5-875e-050424c25623-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:12:08 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-7d59f76d-d752-4e60-801e-324bdebb72da tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Lock "cinder-8f4e3126-4700-45c5-875e-050424c25623-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:12:08 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-4563408e-e788-4c39-8f3d-61ba7263ac61 tempest-VolumesDeleteCascade-471708485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:12:08 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-4563408e-e788-4c39-8f3d-61ba7263ac61 tempest-VolumesDeleteCascade-471708485 None] Flow 'volume_create_manager' (0c2bb275-fd60-4efc-8acc-c9b991fa5d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:12:08 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-4563408e-e788-4c39-8f3d-61ba7263ac61 tempest-VolumesDeleteCascade-471708485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5edce87e-6576-4822-b746-002b78289e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:12:08 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-4563408e-e788-4c39-8f3d-61ba7263ac61 tempest-VolumesDeleteCascade-471708485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5edce87e-6576-4822-b746-002b78289e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:12:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1457912065',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90e72c65-f4f8-4869-bc50-7e6eb499d3cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f919b8f096f94caea0384c696ad5fe05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:12:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:12:09Z,use_quota=True,user_id='25ff392f9e124c02be4e3f1e89015334',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:12:08 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-4563408e-e788-4c39-8f3d-61ba7263ac61 tempest-VolumesDeleteCascade-471708485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4adb7392-ce6e-41a5-aeb1-f95edf8c4ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:12:08 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-4563408e-e788-4c39-8f3d-61ba7263ac61 tempest-VolumesDeleteCascade-471708485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4adb7392-ce6e-41a5-aeb1-f95edf8c4ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:12:08 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-4563408e-e788-4c39-8f3d-61ba7263ac61 tempest-VolumesDeleteCascade-471708485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5413e608-ab35-475e-beac-cf9694420873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:12:08 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-4563408e-e788-4c39-8f3d-61ba7263ac61 tempest-VolumesDeleteCascade-471708485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5413e608-ab35-475e-beac-cf9694420873) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90e72c65-f4f8-4869-bc50-7e6eb499d3cf', 'volume_name': 'volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:12:08 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-4563408e-e788-4c39-8f3d-61ba7263ac61 tempest-VolumesDeleteCascade-471708485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b6ba721-0386-4665-837d-707650020a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:12:08 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-4563408e-e788-4c39-8f3d-61ba7263ac61 tempest-VolumesDeleteCascade-471708485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b6ba721-0386-4665-837d-707650020a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:12:08 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-4563408e-e788-4c39-8f3d-61ba7263ac61 tempest-VolumesDeleteCascade-471708485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64d5462c-fe0d-41af-a938-6e7816a08df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:12:08 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-4563408e-e788-4c39-8f3d-61ba7263ac61 tempest-VolumesDeleteCascade-471708485 None] Volume 90e72c65-f4f8-4869-bc50-7e6eb499d3cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf', 'volume_size': 1}
Apr 15 20:12:08 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-4563408e-e788-4c39-8f3d-61ba7263ac61 tempest-VolumesDeleteCascade-471708485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:12:08 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-7d59f76d-d752-4e60-801e-324bdebb72da tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Acquiring lock "cinder-quobyte-8f4e3126-4700-45c5-875e-050424c25623" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:12:08 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-7d59f76d-d752-4e60-801e-324bdebb72da tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Lock "cinder-quobyte-8f4e3126-4700-45c5-875e-050424c25623" acquired by "delete_volume" :: waited 0.006s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:12:08 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a4748b-f2fc-4796-8a68-f592a0cddbad]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:12:08 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-7d59f76d-d752-4e60-801e-324bdebb72da tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8f4e3126-4700-45c5-875e-050424c25623 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:09 devstack sudo[89036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8f4e3126-4700-45c5-875e-050424c25623
Apr 15 20:12:09 devstack sudo[89036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:09 devstack sudo[89034]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-0e463904-0e81-468b-9199-1320a834d54d tempest-VolumesSnapshotTestJSON-895312450 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0" returned: 0 in 0.485s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:09 devstack cinder-volume[82646]: DEBUG cinder.utils [None req-0e463904-0e81-468b-9199-1320a834d54d tempest-VolumesSnapshotTestJSON-895312450 None] Path /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-38900eb8-f7b3-48f3-8b8d-93bcb328b285 not found in is_blk_device check {{(pid=82646) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 15 20:12:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-0e463904-0e81-468b-9199-1320a834d54d tempest-VolumesSnapshotTestJSON-895312450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-38900eb8-f7b3-48f3-8b8d-93bcb328b285 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:09 devstack sudo[89041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-38900eb8-f7b3-48f3-8b8d-93bcb328b285
Apr 15 20:12:09 devstack sudo[89041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:09 devstack sudo[89036]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-7d59f76d-d752-4e60-801e-324bdebb72da tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8f4e3126-4700-45c5-875e-050424c25623" returned: 0 in 0.469s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-7d59f76d-d752-4e60-801e-324bdebb72da tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8f4e3126-4700-45c5-875e-050424c25623 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:09 devstack sudo[89046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8f4e3126-4700-45c5-875e-050424c25623
Apr 15 20:12:09 devstack sudo[89046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:10 devstack sudo[89046]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:10 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-7d59f76d-d752-4e60-801e-324bdebb72da tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8f4e3126-4700-45c5-875e-050424c25623" returned: 0 in 0.789s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:10 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-7d59f76d-d752-4e60-801e-324bdebb72da tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Lock "cinder-quobyte-8f4e3126-4700-45c5-875e-050424c25623" released by "delete_volume" :: held 1.293s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:12:10 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-7d59f76d-d752-4e60-801e-324bdebb72da tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Created reservations ['e26103c0-2277-468e-b368-654b2a643d44', 'ede52946-e355-4c56-a892-adbd351f8577', 'cafaad0d-b7a8-41e8-9e89-67d48952815d', 'a9a379cf-c025-4a3c-97ed-6e0c170cc951'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:12:10 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-7d59f76d-d752-4e60-801e-324bdebb72da tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:12:10 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-7d59f76d-d752-4e60-801e-324bdebb72da tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:12:10 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-7d59f76d-d752-4e60-801e-324bdebb72da tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:12:10 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-7d59f76d-d752-4e60-801e-324bdebb72da tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:12:10 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-7d59f76d-d752-4e60-801e-324bdebb72da tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:12:10 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-7d59f76d-d752-4e60-801e-324bdebb72da tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:10 devstack sudo[89059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:12:10 devstack sudo[89059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:11 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-f512fed5-16f5-41d7-8127-abd3a923a5a9 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Acquiring lock "cinder-387ee128-dab4-4fff-9af1-bc82b204acff-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:12:11 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-f512fed5-16f5-41d7-8127-abd3a923a5a9 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Lock "cinder-387ee128-dab4-4fff-9af1-bc82b204acff-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:12:11 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-f512fed5-16f5-41d7-8127-abd3a923a5a9 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Acquiring lock "cinder-quobyte-387ee128-dab4-4fff-9af1-bc82b204acff" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:12:11 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-f512fed5-16f5-41d7-8127-abd3a923a5a9 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Lock "cinder-quobyte-387ee128-dab4-4fff-9af1-bc82b204acff" acquired by "delete_volume" :: waited 0.006s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:12:11 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b23fed-7736-4145-b4c5-be086d9cc9ef]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:12:11 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-f512fed5-16f5-41d7-8127-abd3a923a5a9 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-387ee128-dab4-4fff-9af1-bc82b204acff {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:11 devstack sudo[89062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-387ee128-dab4-4fff-9af1-bc82b204acff
Apr 15 20:12:11 devstack sudo[89062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:11 devstack sudo[89059]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:11 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-7d59f76d-d752-4e60-801e-324bdebb72da tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 1.131s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:11 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-7d59f76d-d752-4e60-801e-324bdebb72da tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:12:11 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-7d59f76d-d752-4e60-801e-324bdebb72da tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Deleted volume successfully.
Apr 15 20:12:11 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-7d59f76d-d752-4e60-801e-324bdebb72da tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Lock "cinder-8f4e3126-4700-45c5-875e-050424c25623-delete_volume" released by "delete_volume" :: held 2.866s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:12:11 devstack sudo[89041]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:11 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-0e463904-0e81-468b-9199-1320a834d54d tempest-VolumesSnapshotTestJSON-895312450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-38900eb8-f7b3-48f3-8b8d-93bcb328b285" returned: 0 in 2.543s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:11 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb489d87-c279-4753-9512-d5baff314f52]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:12:11 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-0e463904-0e81-468b-9199-1320a834d54d tempest-VolumesSnapshotTestJSON-895312450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:11 devstack sudo[89064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0
Apr 15 20:12:11 devstack sudo[89064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:12 devstack sudo[89062]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:12 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-f512fed5-16f5-41d7-8127-abd3a923a5a9 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-387ee128-dab4-4fff-9af1-bc82b204acff" returned: 0 in 0.679s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:12 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-f512fed5-16f5-41d7-8127-abd3a923a5a9 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-387ee128-dab4-4fff-9af1-bc82b204acff {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:12 devstack sudo[89072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-387ee128-dab4-4fff-9af1-bc82b204acff
Apr 15 20:12:12 devstack sudo[89072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:12 devstack sudo[89064]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:12 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-0e463904-0e81-468b-9199-1320a834d54d tempest-VolumesSnapshotTestJSON-895312450 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0" returned: 0 in 0.595s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:12 devstack cinder-volume[82646]: DEBUG cinder.image.image_utils [None req-0e463904-0e81-468b-9199-1320a834d54d tempest-VolumesSnapshotTestJSON-895312450 None] Image conversion details: src /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0, size 1024.00 MB, duration 2.54 sec, destination /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-38900eb8-f7b3-48f3-8b8d-93bcb328b285 {{(pid=82646) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 20:12:12 devstack cinder-volume[82646]: INFO cinder.image.image_utils [None req-0e463904-0e81-468b-9199-1320a834d54d tempest-VolumesSnapshotTestJSON-895312450 None] Converted 1024.00 MB image at 402.52 MB/s
Apr 15 20:12:12 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-0e463904-0e81-468b-9199-1320a834d54d tempest-VolumesSnapshotTestJSON-895312450 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-38900eb8-f7b3-48f3-8b8d-93bcb328b285 is being set with open permissions: ugo+rw
Apr 15 20:12:12 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-0e463904-0e81-468b-9199-1320a834d54d tempest-VolumesSnapshotTestJSON-895312450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-38900eb8-f7b3-48f3-8b8d-93bcb328b285 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:12 devstack sudo[89076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-38900eb8-f7b3-48f3-8b8d-93bcb328b285
Apr 15 20:12:12 devstack sudo[89076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:12 devstack sudo[89072]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:12 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-f512fed5-16f5-41d7-8127-abd3a923a5a9 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-387ee128-dab4-4fff-9af1-bc82b204acff" returned: 0 in 0.419s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:12 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-f512fed5-16f5-41d7-8127-abd3a923a5a9 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Lock "cinder-quobyte-387ee128-dab4-4fff-9af1-bc82b204acff" released by "delete_volume" :: held 1.148s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:12:12 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-f512fed5-16f5-41d7-8127-abd3a923a5a9 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Created reservations ['c2f49c19-75dd-42c5-976b-9d3ec7f4a3e0', 'ef351408-5903-4b0b-a8f9-a7f776df0bf3', 'c880be87-39a2-481a-86ab-78ba5502cc8c', '8d710f28-f980-4f30-9b3a-2b0b5b402489'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:12:12 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-f512fed5-16f5-41d7-8127-abd3a923a5a9 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:12:12 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-f512fed5-16f5-41d7-8127-abd3a923a5a9 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:12:12 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-f512fed5-16f5-41d7-8127-abd3a923a5a9 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:12:12 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-f512fed5-16f5-41d7-8127-abd3a923a5a9 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:12:12 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-f512fed5-16f5-41d7-8127-abd3a923a5a9 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:12:12 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-f512fed5-16f5-41d7-8127-abd3a923a5a9 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:12 devstack sudo[89079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:12:12 devstack sudo[89079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:12 devstack sudo[89076]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:12 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-0e463904-0e81-468b-9199-1320a834d54d tempest-VolumesSnapshotTestJSON-895312450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-38900eb8-f7b3-48f3-8b8d-93bcb328b285" returned: 0 in 0.442s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:12 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-0e463904-0e81-468b-9199-1320a834d54d tempest-VolumesSnapshotTestJSON-895312450 None] Lock "cinder-quobyte-38900eb8-f7b3-48f3-8b8d-93bcb328b285" released by "_copy_volume_from_snapshot" :: held 4.687s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:12:12 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-0e463904-0e81-468b-9199-1320a834d54d tempest-VolumesSnapshotTestJSON-895312450 None] Lock "cinder-quobyte-23d8d2d4-463f-43fb-a76f-3a6016284e28-38900eb8-f7b3-48f3-8b8d-93bcb328b285" released by "_create_volume_from_snapshot" :: held 4.715s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:12:12 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-0e463904-0e81-468b-9199-1320a834d54d tempest-VolumesSnapshotTestJSON-895312450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.758s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:12:12 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-878d5a33-d9b3-478d-a103-6d496cc99e4b tempest-SnapshotDependencyTests-560057263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.260s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:12:12 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-878d5a33-d9b3-478d-a103-6d496cc99e4b tempest-SnapshotDependencyTests-560057263 None] Creating offline snapshot 97d319a1-505a-45f3-9276-125a14d08ea8 of volume 95339c3c-2ac7-4329-83c8-3e0980d3b4fa {{(pid=82646) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 20:12:12 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-0e463904-0e81-468b-9199-1320a834d54d tempest-VolumesSnapshotTestJSON-895312450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae19545b-6435-45fa-8de2-6381c353f42b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38900eb8-f7b3-48f3-8b8d-93bcb328b285', 'volume_size': 2, 'snapshot_id': '23d8d2d4-463f-43fb-a76f-3a6016284e28'}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:12:12 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-0e463904-0e81-468b-9199-1320a834d54d tempest-VolumesSnapshotTestJSON-895312450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1dab042-51f9-4b1d-ab5e-27764f85fa0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:12:12 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[7faad8ae-0c9a-4adf-8176-b832733823df]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:12:12 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-878d5a33-d9b3-478d-a103-6d496cc99e4b tempest-SnapshotDependencyTests-560057263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:12 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-0e463904-0e81-468b-9199-1320a834d54d tempest-VolumesSnapshotTestJSON-895312450 None] Volume volume-38900eb8-f7b3-48f3-8b8d-93bcb328b285 (38900eb8-f7b3-48f3-8b8d-93bcb328b285): created successfully
Apr 15 20:12:12 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-0e463904-0e81-468b-9199-1320a834d54d tempest-VolumesSnapshotTestJSON-895312450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1dab042-51f9-4b1d-ab5e-27764f85fa0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:12:12 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-0e463904-0e81-468b-9199-1320a834d54d tempest-VolumesSnapshotTestJSON-895312450 None] Flow 'volume_create_manager' (512b24b6-b031-4512-b3fd-68ed1da14fe8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:12:12 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-0e463904-0e81-468b-9199-1320a834d54d tempest-VolumesSnapshotTestJSON-895312450 None] Created volume successfully.
Apr 15 20:12:12 devstack sudo[89082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa
Apr 15 20:12:12 devstack sudo[89082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:13 devstack sudo[89079]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:13 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-f512fed5-16f5-41d7-8127-abd3a923a5a9 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.418s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:13 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-f512fed5-16f5-41d7-8127-abd3a923a5a9 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:12:13 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-f512fed5-16f5-41d7-8127-abd3a923a5a9 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Deleted volume successfully.
Apr 15 20:12:13 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-f512fed5-16f5-41d7-8127-abd3a923a5a9 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Lock "cinder-387ee128-dab4-4fff-9af1-bc82b204acff-delete_volume" released by "delete_volume" :: held 1.796s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:12:13 devstack sudo[89082]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:13 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-878d5a33-d9b3-478d-a103-6d496cc99e4b tempest-SnapshotDependencyTests-560057263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa" returned: 0 in 0.457s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:13 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-878d5a33-d9b3-478d-a103-6d496cc99e4b tempest-SnapshotDependencyTests-560057263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa.97d319a1-505a-45f3-9276-125a14d08ea8 1G {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:13 devstack sudo[89088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa.97d319a1-505a-45f3-9276-125a14d08ea8 1G
Apr 15 20:12:13 devstack sudo[89088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:13 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-105b15bc-7778-4c2e-9bcc-5b4cf9b58fd8 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Acquiring lock "cinder-05c2f78d-752b-4548-9f80-6f881eb8df0c-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:12:13 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-105b15bc-7778-4c2e-9bcc-5b4cf9b58fd8 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Lock "cinder-05c2f78d-752b-4548-9f80-6f881eb8df0c-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:12:13 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-105b15bc-7778-4c2e-9bcc-5b4cf9b58fd8 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Acquiring lock "cinder-quobyte-05c2f78d-752b-4548-9f80-6f881eb8df0c" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:12:13 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-105b15bc-7778-4c2e-9bcc-5b4cf9b58fd8 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Lock "cinder-quobyte-05c2f78d-752b-4548-9f80-6f881eb8df0c" acquired by "delete_volume" :: waited 0.011s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:12:13 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f1330e-6d23-402b-8713-82257fd8b981]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:12:13 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-105b15bc-7778-4c2e-9bcc-5b4cf9b58fd8 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-05c2f78d-752b-4548-9f80-6f881eb8df0c {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:13 devstack sudo[89090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-05c2f78d-752b-4548-9f80-6f881eb8df0c
Apr 15 20:12:13 devstack sudo[89090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:13 devstack sudo[89088]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:13 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-878d5a33-d9b3-478d-a103-6d496cc99e4b tempest-SnapshotDependencyTests-560057263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa.97d319a1-505a-45f3-9276-125a14d08ea8 1G" returned: 0 in 0.481s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:13 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-878d5a33-d9b3-478d-a103-6d496cc99e4b tempest-SnapshotDependencyTests-560057263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa.97d319a1-505a-45f3-9276-125a14d08ea8 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:13 devstack sudo[89095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa.97d319a1-505a-45f3-9276-125a14d08ea8
Apr 15 20:12:13 devstack sudo[89095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:13 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-e670b2ce-183e-4b56-83f0-cb4b2e35c7c0 tempest-VolumesSnapshotTestJSON-895312450 None] Acquiring lock "cinder-38900eb8-f7b3-48f3-8b8d-93bcb328b285-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:12:13 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-e670b2ce-183e-4b56-83f0-cb4b2e35c7c0 tempest-VolumesSnapshotTestJSON-895312450 None] Lock "cinder-38900eb8-f7b3-48f3-8b8d-93bcb328b285-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:12:13 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-e670b2ce-183e-4b56-83f0-cb4b2e35c7c0 tempest-VolumesSnapshotTestJSON-895312450 None] Acquiring lock "cinder-quobyte-38900eb8-f7b3-48f3-8b8d-93bcb328b285" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:12:13 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-e670b2ce-183e-4b56-83f0-cb4b2e35c7c0 tempest-VolumesSnapshotTestJSON-895312450 None] Lock "cinder-quobyte-38900eb8-f7b3-48f3-8b8d-93bcb328b285" acquired by "delete_volume" :: waited 0.010s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:12:13 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f6bcbe-dbfd-44ee-b061-b80b1ddd7457]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:12:13 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e670b2ce-183e-4b56-83f0-cb4b2e35c7c0 tempest-VolumesSnapshotTestJSON-895312450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-38900eb8-f7b3-48f3-8b8d-93bcb328b285 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:14 devstack sudo[89097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-38900eb8-f7b3-48f3-8b8d-93bcb328b285
Apr 15 20:12:14 devstack sudo[89097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:14 devstack sudo[89090]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:14 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-105b15bc-7778-4c2e-9bcc-5b4cf9b58fd8 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-05c2f78d-752b-4548-9f80-6f881eb8df0c" returned: 0 in 0.528s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:14 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-105b15bc-7778-4c2e-9bcc-5b4cf9b58fd8 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-05c2f78d-752b-4548-9f80-6f881eb8df0c {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:14 devstack sudo[89102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-05c2f78d-752b-4548-9f80-6f881eb8df0c
Apr 15 20:12:14 devstack sudo[89102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:14 devstack sudo[89095]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:14 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-878d5a33-d9b3-478d-a103-6d496cc99e4b tempest-SnapshotDependencyTests-560057263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa.97d319a1-505a-45f3-9276-125a14d08ea8" returned: 0 in 0.497s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:14 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-878d5a33-d9b3-478d-a103-6d496cc99e4b tempest-SnapshotDependencyTests-560057263 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa.97d319a1-505a-45f3-9276-125a14d08ea8 is being set with open permissions: ugo+rw
Apr 15 20:12:14 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-878d5a33-d9b3-478d-a103-6d496cc99e4b tempest-SnapshotDependencyTests-560057263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa.97d319a1-505a-45f3-9276-125a14d08ea8 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:14 devstack sudo[89107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa.97d319a1-505a-45f3-9276-125a14d08ea8
Apr 15 20:12:14 devstack sudo[89107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:14 devstack sudo[89097]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:14 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e670b2ce-183e-4b56-83f0-cb4b2e35c7c0 tempest-VolumesSnapshotTestJSON-895312450 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-38900eb8-f7b3-48f3-8b8d-93bcb328b285" returned: 0 in 0.454s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:14 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e670b2ce-183e-4b56-83f0-cb4b2e35c7c0 tempest-VolumesSnapshotTestJSON-895312450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-38900eb8-f7b3-48f3-8b8d-93bcb328b285 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:14 devstack sudo[89112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-38900eb8-f7b3-48f3-8b8d-93bcb328b285
Apr 15 20:12:14 devstack sudo[89112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:14 devstack sudo[89102]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:14 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-105b15bc-7778-4c2e-9bcc-5b4cf9b58fd8 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-05c2f78d-752b-4548-9f80-6f881eb8df0c" returned: 0 in 0.414s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:14 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-105b15bc-7778-4c2e-9bcc-5b4cf9b58fd8 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Lock "cinder-quobyte-05c2f78d-752b-4548-9f80-6f881eb8df0c" released by "delete_volume" :: held 0.962s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:12:14 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-105b15bc-7778-4c2e-9bcc-5b4cf9b58fd8 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Created reservations ['d854decd-4975-477b-8f27-1a2bbe034faf', '838ca332-9a75-4ca7-b0ee-a868d2b45d8f', '119e3318-44df-4120-afe3-9e9315fd6e7e', 'e44f2c27-257f-460c-800a-aa24d1c447c5'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:12:14 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-105b15bc-7778-4c2e-9bcc-5b4cf9b58fd8 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:12:14 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-105b15bc-7778-4c2e-9bcc-5b4cf9b58fd8 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:12:14 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-105b15bc-7778-4c2e-9bcc-5b4cf9b58fd8 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:12:14 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-105b15bc-7778-4c2e-9bcc-5b4cf9b58fd8 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:12:14 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-105b15bc-7778-4c2e-9bcc-5b4cf9b58fd8 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:12:14 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-105b15bc-7778-4c2e-9bcc-5b4cf9b58fd8 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:14 devstack sudo[89116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:12:14 devstack sudo[89116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:14 devstack sudo[89107]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:14 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-878d5a33-d9b3-478d-a103-6d496cc99e4b tempest-SnapshotDependencyTests-560057263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa.97d319a1-505a-45f3-9276-125a14d08ea8" returned: 0 in 0.444s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:14 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-878d5a33-d9b3-478d-a103-6d496cc99e4b tempest-SnapshotDependencyTests-560057263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa.info {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:14 devstack sudo[89118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa.info
Apr 15 20:12:14 devstack sudo[89118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:14 devstack sudo[89112]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:14 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e670b2ce-183e-4b56-83f0-cb4b2e35c7c0 tempest-VolumesSnapshotTestJSON-895312450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-38900eb8-f7b3-48f3-8b8d-93bcb328b285" returned: 0 in 0.479s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:14 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-e670b2ce-183e-4b56-83f0-cb4b2e35c7c0 tempest-VolumesSnapshotTestJSON-895312450 None] Lock "cinder-quobyte-38900eb8-f7b3-48f3-8b8d-93bcb328b285" released by "delete_volume" :: held 0.965s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:12:14 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-e670b2ce-183e-4b56-83f0-cb4b2e35c7c0 tempest-VolumesSnapshotTestJSON-895312450 None] Created reservations ['7e77661a-8564-458f-8cd7-c70769e81cb5', '147a7751-fa97-4ef2-9689-6ba37a976144', 'ead5ccd0-8ae0-416b-a64e-ff98bdf3e5e8', 'ae032639-b911-43ad-951b-4224c57bd25e'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:12:15 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-e670b2ce-183e-4b56-83f0-cb4b2e35c7c0 tempest-VolumesSnapshotTestJSON-895312450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:12:15 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-e670b2ce-183e-4b56-83f0-cb4b2e35c7c0 tempest-VolumesSnapshotTestJSON-895312450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:12:15 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-e670b2ce-183e-4b56-83f0-cb4b2e35c7c0 tempest-VolumesSnapshotTestJSON-895312450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:12:15 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-e670b2ce-183e-4b56-83f0-cb4b2e35c7c0 tempest-VolumesSnapshotTestJSON-895312450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:12:15 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-e670b2ce-183e-4b56-83f0-cb4b2e35c7c0 tempest-VolumesSnapshotTestJSON-895312450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:12:15 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e670b2ce-183e-4b56-83f0-cb4b2e35c7c0 tempest-VolumesSnapshotTestJSON-895312450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:15 devstack sudo[89122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:12:15 devstack sudo[89122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:15 devstack sudo[89116]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:15 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-105b15bc-7778-4c2e-9bcc-5b4cf9b58fd8 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.471s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:15 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-105b15bc-7778-4c2e-9bcc-5b4cf9b58fd8 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:12:15 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-105b15bc-7778-4c2e-9bcc-5b4cf9b58fd8 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Deleted volume successfully.
Apr 15 20:12:15 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-aba1c3a9-732c-417b-8d5b-f41903b8e180 tempest-VolumesSnapshotTestJSON-895312450 None] Acquiring lock "cinder-23d8d2d4-463f-43fb-a76f-3a6016284e28-delete_snapshot" by "delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:12:15 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-105b15bc-7778-4c2e-9bcc-5b4cf9b58fd8 tempest-CreateVolumesFromSourceVolumeTest-1893968298 None] Lock "cinder-05c2f78d-752b-4548-9f80-6f881eb8df0c-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:12:15 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-aba1c3a9-732c-417b-8d5b-f41903b8e180 tempest-VolumesSnapshotTestJSON-895312450 None] Lock "cinder-23d8d2d4-463f-43fb-a76f-3a6016284e28-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:12:15 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-aba1c3a9-732c-417b-8d5b-f41903b8e180 tempest-VolumesSnapshotTestJSON-895312450 None] Acquiring lock "cinder-quobyte-d55a4f29-42a9-44b1-bb9a-c56a78723af0" by "delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:12:15 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-aba1c3a9-732c-417b-8d5b-f41903b8e180 tempest-VolumesSnapshotTestJSON-895312450 None] Lock "cinder-quobyte-d55a4f29-42a9-44b1-bb9a-c56a78723af0" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:12:15 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-aba1c3a9-732c-417b-8d5b-f41903b8e180 tempest-VolumesSnapshotTestJSON-895312450 None] Acquiring lock "cinder-quobyte-23d8d2d4-463f-43fb-a76f-3a6016284e28" by "_delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:12:15 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-aba1c3a9-732c-417b-8d5b-f41903b8e180 tempest-VolumesSnapshotTestJSON-895312450 None] Lock "cinder-quobyte-23d8d2d4-463f-43fb-a76f-3a6016284e28" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:12:15 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-aba1c3a9-732c-417b-8d5b-f41903b8e180 tempest-VolumesSnapshotTestJSON-895312450 None] Deleting offline snapshot 23d8d2d4-463f-43fb-a76f-3a6016284e28 of volume d55a4f29-42a9-44b1-bb9a-c56a78723af0 {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 20:12:15 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-aba1c3a9-732c-417b-8d5b-f41903b8e180 tempest-VolumesSnapshotTestJSON-895312450 None] snapshot_file for this snap is: volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0.23d8d2d4-463f-43fb-a76f-3a6016284e28 {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 20:12:15 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f77961-e143-4513-9231-b26b68e952be]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:12:15 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-aba1c3a9-732c-417b-8d5b-f41903b8e180 tempest-VolumesSnapshotTestJSON-895312450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0.23d8d2d4-463f-43fb-a76f-3a6016284e28 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:15 devstack sudo[89124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0.23d8d2d4-463f-43fb-a76f-3a6016284e28
Apr 15 20:12:15 devstack sudo[89124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:15 devstack sudo[89118]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:15 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-878d5a33-d9b3-478d-a103-6d496cc99e4b tempest-SnapshotDependencyTests-560057263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa.info" returned: 0 in 0.582s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:15 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-878d5a33-d9b3-478d-a103-6d496cc99e4b tempest-SnapshotDependencyTests-560057263 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa.info is being set with open permissions: ugo+rw
Apr 15 20:12:15 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-878d5a33-d9b3-478d-a103-6d496cc99e4b tempest-SnapshotDependencyTests-560057263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa.info {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:15 devstack sudo[89127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa.info
Apr 15 20:12:15 devstack sudo[89127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:15 devstack sudo[89122]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:15 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e670b2ce-183e-4b56-83f0-cb4b2e35c7c0 tempest-VolumesSnapshotTestJSON-895312450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.532s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:15 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-e670b2ce-183e-4b56-83f0-cb4b2e35c7c0 tempest-VolumesSnapshotTestJSON-895312450 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:12:15 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-e670b2ce-183e-4b56-83f0-cb4b2e35c7c0 tempest-VolumesSnapshotTestJSON-895312450 None] Deleted volume successfully.
Apr 15 20:12:15 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-e670b2ce-183e-4b56-83f0-cb4b2e35c7c0 tempest-VolumesSnapshotTestJSON-895312450 None] Lock "cinder-38900eb8-f7b3-48f3-8b8d-93bcb328b285-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:12:15 devstack sudo[89127]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:15 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-878d5a33-d9b3-478d-a103-6d496cc99e4b tempest-SnapshotDependencyTests-560057263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa.info" returned: 0 in 0.425s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:15 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-878d5a33-d9b3-478d-a103-6d496cc99e4b tempest-SnapshotDependencyTests-560057263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.958s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:12:15 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-4563408e-e788-4c39-8f3d-61ba7263ac61 tempest-VolumesDeleteCascade-471708485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.809s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:12:15 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-4563408e-e788-4c39-8f3d-61ba7263ac61 tempest-VolumesDeleteCascade-471708485 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:12:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1457912065',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90e72c65-f4f8-4869-bc50-7e6eb499d3cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f919b8f096f94caea0384c696ad5fe05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:12:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:12:09Z,use_quota=True,user_id='25ff392f9e124c02be4e3f1e89015334',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:12:15 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-4563408e-e788-4c39-8f3d-61ba7263ac61 tempest-VolumesDeleteCascade-471708485 None] Creating volume 90e72c65-f4f8-4869-bc50-7e6eb499d3cf {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:12:15 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-4563408e-e788-4c39-8f3d-61ba7263ac61 tempest-VolumesDeleteCascade-471708485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:12:15 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-4563408e-e788-4c39-8f3d-61ba7263ac61 tempest-VolumesDeleteCascade-471708485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:12:15 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-4563408e-e788-4c39-8f3d-61ba7263ac61 tempest-VolumesDeleteCascade-471708485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:12:15 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-4563408e-e788-4c39-8f3d-61ba7263ac61 tempest-VolumesDeleteCascade-471708485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:12:15 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-4563408e-e788-4c39-8f3d-61ba7263ac61 tempest-VolumesDeleteCascade-471708485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:12:15 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-4563408e-e788-4c39-8f3d-61ba7263ac61 tempest-VolumesDeleteCascade-471708485 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:12:15 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-4563408e-e788-4c39-8f3d-61ba7263ac61 tempest-VolumesDeleteCascade-471708485 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:12:15 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-4563408e-e788-4c39-8f3d-61ba7263ac61 tempest-VolumesDeleteCascade-471708485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:15 devstack sudo[89134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf 1073741824
Apr 15 20:12:15 devstack sudo[89134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:15 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-878d5a33-d9b3-478d-a103-6d496cc99e4b tempest-SnapshotDependencyTests-560057263 None] Create snapshot completed successfully
Apr 15 20:12:15 devstack sudo[89124]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:15 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-aba1c3a9-732c-417b-8d5b-f41903b8e180 tempest-VolumesSnapshotTestJSON-895312450 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0.23d8d2d4-463f-43fb-a76f-3a6016284e28" returned: 0 in 0.675s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:15 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-aba1c3a9-732c-417b-8d5b-f41903b8e180 tempest-VolumesSnapshotTestJSON-895312450 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82646) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 20:12:15 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3742e6-ce84-4f98-9e35-8b30828a7a0f]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:12:15 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-aba1c3a9-732c-417b-8d5b-f41903b8e180 tempest-VolumesSnapshotTestJSON-895312450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:15 devstack sudo[89136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0
Apr 15 20:12:15 devstack sudo[89136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:16 devstack sudo[89134]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:16 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-4563408e-e788-4c39-8f3d-61ba7263ac61 tempest-VolumesDeleteCascade-471708485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf 1073741824" returned: 0 in 0.610s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:16 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-4563408e-e788-4c39-8f3d-61ba7263ac61 tempest-VolumesDeleteCascade-471708485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:16 devstack sudo[89145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf
Apr 15 20:12:16 devstack sudo[89145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:16 devstack sudo[89136]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:16 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-aba1c3a9-732c-417b-8d5b-f41903b8e180 tempest-VolumesSnapshotTestJSON-895312450 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0" returned: 0 in 0.596s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:16 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-aba1c3a9-732c-417b-8d5b-f41903b8e180 tempest-VolumesSnapshotTestJSON-895312450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0.23d8d2d4-463f-43fb-a76f-3a6016284e28 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:16 devstack sudo[89147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0.23d8d2d4-463f-43fb-a76f-3a6016284e28
Apr 15 20:12:16 devstack sudo[89147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:16 devstack sudo[89145]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:16 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-4563408e-e788-4c39-8f3d-61ba7263ac61 tempest-VolumesDeleteCascade-471708485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf" returned: 0 in 0.470s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:16 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-4563408e-e788-4c39-8f3d-61ba7263ac61 tempest-VolumesDeleteCascade-471708485 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:12:16 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-4563408e-e788-4c39-8f3d-61ba7263ac61 tempest-VolumesDeleteCascade-471708485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:12:16 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-4563408e-e788-4c39-8f3d-61ba7263ac61 tempest-VolumesDeleteCascade-471708485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64d5462c-fe0d-41af-a938-6e7816a08df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:12:16 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-4563408e-e788-4c39-8f3d-61ba7263ac61 tempest-VolumesDeleteCascade-471708485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (723ed423-7ea7-481d-b03a-35c5be80ce59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:12:16 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-4563408e-e788-4c39-8f3d-61ba7263ac61 tempest-VolumesDeleteCascade-471708485 None] Volume volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf (90e72c65-f4f8-4869-bc50-7e6eb499d3cf): created successfully
Apr 15 20:12:16 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-4563408e-e788-4c39-8f3d-61ba7263ac61 tempest-VolumesDeleteCascade-471708485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (723ed423-7ea7-481d-b03a-35c5be80ce59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:12:16 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-4563408e-e788-4c39-8f3d-61ba7263ac61 tempest-VolumesDeleteCascade-471708485 None] Flow 'volume_create_manager' (0c2bb275-fd60-4efc-8acc-c9b991fa5d8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:12:16 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-4563408e-e788-4c39-8f3d-61ba7263ac61 tempest-VolumesDeleteCascade-471708485 None] Created volume successfully.
Apr 15 20:12:16 devstack sudo[89147]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:16 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-aba1c3a9-732c-417b-8d5b-f41903b8e180 tempest-VolumesSnapshotTestJSON-895312450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0.23d8d2d4-463f-43fb-a76f-3a6016284e28" returned: 0 in 0.476s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:16 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-aba1c3a9-732c-417b-8d5b-f41903b8e180 tempest-VolumesSnapshotTestJSON-895312450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0.23d8d2d4-463f-43fb-a76f-3a6016284e28 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:16 devstack sudo[89153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0.23d8d2d4-463f-43fb-a76f-3a6016284e28
Apr 15 20:12:16 devstack sudo[89153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:17 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-64e67250-96fc-4b5a-a345-3e5eaa02dadf tempest-SnapshotDependencyTests-560057263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:12:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-64e67250-96fc-4b5a-a345-3e5eaa02dadf tempest-SnapshotDependencyTests-560057263 None] Flow 'volume_create_manager' (80e6f266-08d2-499b-b478-000345a5f6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:12:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-64e67250-96fc-4b5a-a345-3e5eaa02dadf tempest-SnapshotDependencyTests-560057263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ef5b407-dcdd-448e-b3b1-9000cf03a9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:12:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-64e67250-96fc-4b5a-a345-3e5eaa02dadf tempest-SnapshotDependencyTests-560057263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ef5b407-dcdd-448e-b3b1-9000cf03a9ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:12:17Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0df7931-153b-4187-9d99-8c5386c8b271,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e7c49c9f36c48f3a4aba15b66508896',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:12:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=97d319a1-505a-45f3-9276-125a14d08ea8,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:12:17Z,use_quota=True,user_id='d056a20eb34a4f34acf4ffea1e76dac1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:12:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-64e67250-96fc-4b5a-a345-3e5eaa02dadf tempest-SnapshotDependencyTests-560057263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4b22111-b440-48b4-8afb-1656e2e77891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:12:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-64e67250-96fc-4b5a-a345-3e5eaa02dadf tempest-SnapshotDependencyTests-560057263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4b22111-b440-48b4-8afb-1656e2e77891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:12:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-64e67250-96fc-4b5a-a345-3e5eaa02dadf tempest-SnapshotDependencyTests-560057263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (713c42fe-381e-4452-aacb-57475168ce41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:12:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-64e67250-96fc-4b5a-a345-3e5eaa02dadf tempest-SnapshotDependencyTests-560057263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (713c42fe-381e-4452-aacb-57475168ce41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c0df7931-153b-4187-9d99-8c5386c8b271', 'volume_name': 'volume-c0df7931-153b-4187-9d99-8c5386c8b271', 'volume_size': 1, 'snapshot_id': '97d319a1-505a-45f3-9276-125a14d08ea8'}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:12:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-64e67250-96fc-4b5a-a345-3e5eaa02dadf tempest-SnapshotDependencyTests-560057263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8876f802-6891-4792-8c0c-b89ddf46875c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:12:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-64e67250-96fc-4b5a-a345-3e5eaa02dadf tempest-SnapshotDependencyTests-560057263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8876f802-6891-4792-8c0c-b89ddf46875c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:12:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-64e67250-96fc-4b5a-a345-3e5eaa02dadf tempest-SnapshotDependencyTests-560057263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2518a79-d863-473e-8e2f-7ab4769cc897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:12:17 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-64e67250-96fc-4b5a-a345-3e5eaa02dadf tempest-SnapshotDependencyTests-560057263 None] Volume c0df7931-153b-4187-9d99-8c5386c8b271: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c0df7931-153b-4187-9d99-8c5386c8b271', 'volume_size': 1, 'snapshot_id': '97d319a1-505a-45f3-9276-125a14d08ea8'}
Apr 15 20:12:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-64e67250-96fc-4b5a-a345-3e5eaa02dadf tempest-SnapshotDependencyTests-560057263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:12:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-64e67250-96fc-4b5a-a345-3e5eaa02dadf tempest-SnapshotDependencyTests-560057263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:12:17 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-64e67250-96fc-4b5a-a345-3e5eaa02dadf tempest-SnapshotDependencyTests-560057263 None] Acquiring lock "cinder-quobyte-97d319a1-505a-45f3-9276-125a14d08ea8-c0df7931-153b-4187-9d99-8c5386c8b271" by "_create_volume_from_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:12:17 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-64e67250-96fc-4b5a-a345-3e5eaa02dadf tempest-SnapshotDependencyTests-560057263 None] Lock "cinder-quobyte-97d319a1-505a-45f3-9276-125a14d08ea8-c0df7931-153b-4187-9d99-8c5386c8b271" acquired by "_create_volume_from_snapshot" :: waited 0.009s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:12:17 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-64e67250-96fc-4b5a-a345-3e5eaa02dadf tempest-SnapshotDependencyTests-560057263 None] Creating volume c0df7931-153b-4187-9d99-8c5386c8b271 from snapshot 97d319a1-505a-45f3-9276-125a14d08ea8 {{(pid=82646) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 15 20:12:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-64e67250-96fc-4b5a-a345-3e5eaa02dadf tempest-SnapshotDependencyTests-560057263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:12:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-64e67250-96fc-4b5a-a345-3e5eaa02dadf tempest-SnapshotDependencyTests-560057263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:12:17 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-64e67250-96fc-4b5a-a345-3e5eaa02dadf tempest-SnapshotDependencyTests-560057263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:12:17 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-64e67250-96fc-4b5a-a345-3e5eaa02dadf tempest-SnapshotDependencyTests-560057263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:12:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-64e67250-96fc-4b5a-a345-3e5eaa02dadf tempest-SnapshotDependencyTests-560057263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:12:17 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-64e67250-96fc-4b5a-a345-3e5eaa02dadf tempest-SnapshotDependencyTests-560057263 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:12:17 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-64e67250-96fc-4b5a-a345-3e5eaa02dadf tempest-SnapshotDependencyTests-560057263 None] Acquiring lock "cinder-quobyte-c0df7931-153b-4187-9d99-8c5386c8b271" by "_copy_volume_from_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:12:17 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-64e67250-96fc-4b5a-a345-3e5eaa02dadf tempest-SnapshotDependencyTests-560057263 None] Lock "cinder-quobyte-c0df7931-153b-4187-9d99-8c5386c8b271" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:12:17 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-64e67250-96fc-4b5a-a345-3e5eaa02dadf tempest-SnapshotDependencyTests-560057263 None] snapshot: 97d319a1-505a-45f3-9276-125a14d08ea8, volume: c0df7931-153b-4187-9d99-8c5386c8b271,  {{(pid=82646) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 15 20:12:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-64e67250-96fc-4b5a-a345-3e5eaa02dadf tempest-SnapshotDependencyTests-560057263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:12:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-64e67250-96fc-4b5a-a345-3e5eaa02dadf tempest-SnapshotDependencyTests-560057263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:12:17 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-64e67250-96fc-4b5a-a345-3e5eaa02dadf tempest-SnapshotDependencyTests-560057263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:12:17 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-64e67250-96fc-4b5a-a345-3e5eaa02dadf tempest-SnapshotDependencyTests-560057263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:12:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-64e67250-96fc-4b5a-a345-3e5eaa02dadf tempest-SnapshotDependencyTests-560057263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:12:17 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c050b8-5246-45b9-9eef-f3b876c4e084]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:12:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-64e67250-96fc-4b5a-a345-3e5eaa02dadf tempest-SnapshotDependencyTests-560057263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa.97d319a1-505a-45f3-9276-125a14d08ea8 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:17 devstack sudo[89153]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-aba1c3a9-732c-417b-8d5b-f41903b8e180 tempest-VolumesSnapshotTestJSON-895312450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0.23d8d2d4-463f-43fb-a76f-3a6016284e28" returned: 0 in 0.409s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:17 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-aba1c3a9-732c-417b-8d5b-f41903b8e180 tempest-VolumesSnapshotTestJSON-895312450 None] Lock "cinder-quobyte-23d8d2d4-463f-43fb-a76f-3a6016284e28" released by "_delete_snapshot" :: held 2.225s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:12:17 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-aba1c3a9-732c-417b-8d5b-f41903b8e180 tempest-VolumesSnapshotTestJSON-895312450 None] Lock "cinder-quobyte-d55a4f29-42a9-44b1-bb9a-c56a78723af0" released by "delete_snapshot" :: held 2.238s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:12:17 devstack sudo[89156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa.97d319a1-505a-45f3-9276-125a14d08ea8
Apr 15 20:12:17 devstack sudo[89156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:17 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-aba1c3a9-732c-417b-8d5b-f41903b8e180 tempest-VolumesSnapshotTestJSON-895312450 None] Created reservations ['46eef287-b084-4517-b33e-b37fd3503d5b', '9f6d0277-66e6-4c69-9e58-678ac93370e4', '39ee408a-f05a-4e58-a2d3-7f8894c58607', 'f661e79f-9590-49da-912f-93bd138d609c'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:12:17 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-aba1c3a9-732c-417b-8d5b-f41903b8e180 tempest-VolumesSnapshotTestJSON-895312450 None] Delete snapshot completed successfully.
Apr 15 20:12:17 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-aba1c3a9-732c-417b-8d5b-f41903b8e180 tempest-VolumesSnapshotTestJSON-895312450 None] Lock "cinder-23d8d2d4-463f-43fb-a76f-3a6016284e28-delete_snapshot" released by "delete_snapshot" :: held 2.342s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:12:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-2eea5ddb-2095-4fee-bd67-3eb34a3e3e72 tempest-VolumesDeleteCascade-471708485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:12:17 devstack sudo[89156]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-64e67250-96fc-4b5a-a345-3e5eaa02dadf tempest-SnapshotDependencyTests-560057263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa.97d319a1-505a-45f3-9276-125a14d08ea8" returned: 0 in 0.512s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:17 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-64e67250-96fc-4b5a-a345-3e5eaa02dadf tempest-SnapshotDependencyTests-560057263 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82646) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 20:12:17 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-64e67250-96fc-4b5a-a345-3e5eaa02dadf tempest-SnapshotDependencyTests-560057263 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa {{(pid=82646) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 15 20:12:17 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-64e67250-96fc-4b5a-a345-3e5eaa02dadf tempest-SnapshotDependencyTests-560057263 None] Creating direct copy from snapshot {{(pid=82646) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 15 20:12:17 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[206a06c2-0fff-4ad8-b59a-5248a6275cfb]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:12:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-64e67250-96fc-4b5a-a345-3e5eaa02dadf tempest-SnapshotDependencyTests-560057263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:17 devstack sudo[89161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa
Apr 15 20:12:17 devstack sudo[89161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:18 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-cafa8bcf-eddb-43a1-9a4f-09bf264abeef tempest-VolumesSnapshotTestJSON-895312450 None] Acquiring lock "cinder-d55a4f29-42a9-44b1-bb9a-c56a78723af0-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:12:18 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-cafa8bcf-eddb-43a1-9a4f-09bf264abeef tempest-VolumesSnapshotTestJSON-895312450 None] Lock "cinder-d55a4f29-42a9-44b1-bb9a-c56a78723af0-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:12:18 devstack sudo[89161]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-64e67250-96fc-4b5a-a345-3e5eaa02dadf tempest-SnapshotDependencyTests-560057263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa" returned: 0 in 0.492s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:18 devstack cinder-volume[82646]: DEBUG cinder.utils [None req-64e67250-96fc-4b5a-a345-3e5eaa02dadf tempest-SnapshotDependencyTests-560057263 None] Path /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c0df7931-153b-4187-9d99-8c5386c8b271 not found in is_blk_device check {{(pid=82646) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 15 20:12:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-64e67250-96fc-4b5a-a345-3e5eaa02dadf tempest-SnapshotDependencyTests-560057263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c0df7931-153b-4187-9d99-8c5386c8b271 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:18 devstack sudo[89166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c0df7931-153b-4187-9d99-8c5386c8b271
Apr 15 20:12:18 devstack sudo[89166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:18 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-cafa8bcf-eddb-43a1-9a4f-09bf264abeef tempest-VolumesSnapshotTestJSON-895312450 None] Acquiring lock "cinder-quobyte-d55a4f29-42a9-44b1-bb9a-c56a78723af0" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:12:18 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-cafa8bcf-eddb-43a1-9a4f-09bf264abeef tempest-VolumesSnapshotTestJSON-895312450 None] Lock "cinder-quobyte-d55a4f29-42a9-44b1-bb9a-c56a78723af0" acquired by "delete_volume" :: waited 0.008s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:12:18 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8c98c2-d12a-4cdc-a218-dd832612f585]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:12:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-cafa8bcf-eddb-43a1-9a4f-09bf264abeef tempest-VolumesSnapshotTestJSON-895312450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:18 devstack sudo[89168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0
Apr 15 20:12:18 devstack sudo[89168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:19 devstack sudo[89168]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:19 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-cafa8bcf-eddb-43a1-9a4f-09bf264abeef tempest-VolumesSnapshotTestJSON-895312450 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0" returned: 0 in 0.846s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:19 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-cafa8bcf-eddb-43a1-9a4f-09bf264abeef tempest-VolumesSnapshotTestJSON-895312450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:19 devstack sudo[89183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0
Apr 15 20:12:19 devstack sudo[89183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:20 devstack sudo[89183]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-cafa8bcf-eddb-43a1-9a4f-09bf264abeef tempest-VolumesSnapshotTestJSON-895312450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d55a4f29-42a9-44b1-bb9a-c56a78723af0" returned: 0 in 0.991s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:20 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-cafa8bcf-eddb-43a1-9a4f-09bf264abeef tempest-VolumesSnapshotTestJSON-895312450 None] Lock "cinder-quobyte-d55a4f29-42a9-44b1-bb9a-c56a78723af0" released by "delete_volume" :: held 1.879s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:12:20 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-cafa8bcf-eddb-43a1-9a4f-09bf264abeef tempest-VolumesSnapshotTestJSON-895312450 None] Created reservations ['654b08d9-b4bb-4ad3-90ff-7a3e8892244e', '815343b2-49df-404b-bfea-26cd211c8cbf', '630e198f-1a07-457e-883c-13b914faa4c0', '30e0cced-d91f-4b85-94a0-3459893c882d'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:12:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-cafa8bcf-eddb-43a1-9a4f-09bf264abeef tempest-VolumesSnapshotTestJSON-895312450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:12:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-cafa8bcf-eddb-43a1-9a4f-09bf264abeef tempest-VolumesSnapshotTestJSON-895312450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:12:20 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-cafa8bcf-eddb-43a1-9a4f-09bf264abeef tempest-VolumesSnapshotTestJSON-895312450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:12:20 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-cafa8bcf-eddb-43a1-9a4f-09bf264abeef tempest-VolumesSnapshotTestJSON-895312450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:12:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-cafa8bcf-eddb-43a1-9a4f-09bf264abeef tempest-VolumesSnapshotTestJSON-895312450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:12:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-cafa8bcf-eddb-43a1-9a4f-09bf264abeef tempest-VolumesSnapshotTestJSON-895312450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:20 devstack sudo[89186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:12:20 devstack sudo[89186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:20 devstack sudo[89166]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-64e67250-96fc-4b5a-a345-3e5eaa02dadf tempest-SnapshotDependencyTests-560057263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c0df7931-153b-4187-9d99-8c5386c8b271" returned: 0 in 2.228s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:20 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d537166-889b-43c3-b01d-26f6574969c9]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:12:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-64e67250-96fc-4b5a-a345-3e5eaa02dadf tempest-SnapshotDependencyTests-560057263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:20 devstack sudo[89188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa
Apr 15 20:12:20 devstack sudo[89188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:20 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cecc952-4fa3-4127-9264-1f9e12367123 tempest-VolumesSnapshotTestJSON-895312450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:12:20 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-3cecc952-4fa3-4127-9264-1f9e12367123 tempest-VolumesSnapshotTestJSON-895312450 None] Flow 'volume_create_manager' (453a273a-bb34-4fee-9248-d5b320de6520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:12:20 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-3cecc952-4fa3-4127-9264-1f9e12367123 tempest-VolumesSnapshotTestJSON-895312450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00421841-b3e2-4dcc-9db7-9c9e42814d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:12:20 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-3cecc952-4fa3-4127-9264-1f9e12367123 tempest-VolumesSnapshotTestJSON-895312450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00421841-b3e2-4dcc-9db7-9c9e42814d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:12:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1174043929',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f93c5be4-d9c7-48b9-98f4-478b48926ed9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='170389fee38140d9bf7a7115672201ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:12:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:12:21Z,use_quota=True,user_id='118d321c471c4eb281e6cc3e2bf90691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:12:20 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-3cecc952-4fa3-4127-9264-1f9e12367123 tempest-VolumesSnapshotTestJSON-895312450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba1112c1-0995-4281-a77d-eda86fe074fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:12:20 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-3cecc952-4fa3-4127-9264-1f9e12367123 tempest-VolumesSnapshotTestJSON-895312450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba1112c1-0995-4281-a77d-eda86fe074fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:12:20 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-3cecc952-4fa3-4127-9264-1f9e12367123 tempest-VolumesSnapshotTestJSON-895312450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5779d4e5-dede-4437-b701-1327eb49a80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:12:20 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-3cecc952-4fa3-4127-9264-1f9e12367123 tempest-VolumesSnapshotTestJSON-895312450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5779d4e5-dede-4437-b701-1327eb49a80a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f93c5be4-d9c7-48b9-98f4-478b48926ed9', 'volume_name': 'volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:12:20 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-3cecc952-4fa3-4127-9264-1f9e12367123 tempest-VolumesSnapshotTestJSON-895312450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31945e96-19a8-4df1-99e8-9993cb91fce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:12:20 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-3cecc952-4fa3-4127-9264-1f9e12367123 tempest-VolumesSnapshotTestJSON-895312450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31945e96-19a8-4df1-99e8-9993cb91fce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:12:20 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-3cecc952-4fa3-4127-9264-1f9e12367123 tempest-VolumesSnapshotTestJSON-895312450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4f1852f-8965-4058-b5ef-9b5ddcf7f98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:12:20 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-3cecc952-4fa3-4127-9264-1f9e12367123 tempest-VolumesSnapshotTestJSON-895312450 None] Volume f93c5be4-d9c7-48b9-98f4-478b48926ed9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9', 'volume_size': 1}
Apr 15 20:12:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-3cecc952-4fa3-4127-9264-1f9e12367123 tempest-VolumesSnapshotTestJSON-895312450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:12:20 devstack sudo[89186]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-cafa8bcf-eddb-43a1-9a4f-09bf264abeef tempest-VolumesSnapshotTestJSON-895312450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.482s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:20 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-cafa8bcf-eddb-43a1-9a4f-09bf264abeef tempest-VolumesSnapshotTestJSON-895312450 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:12:20 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-cafa8bcf-eddb-43a1-9a4f-09bf264abeef tempest-VolumesSnapshotTestJSON-895312450 None] Deleted volume successfully.
Apr 15 20:12:21 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-cafa8bcf-eddb-43a1-9a4f-09bf264abeef tempest-VolumesSnapshotTestJSON-895312450 None] Lock "cinder-d55a4f29-42a9-44b1-bb9a-c56a78723af0-delete_volume" released by "delete_volume" :: held 2.721s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:12:21 devstack sudo[89188]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-64e67250-96fc-4b5a-a345-3e5eaa02dadf tempest-SnapshotDependencyTests-560057263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa" returned: 0 in 0.671s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:21 devstack cinder-volume[82646]: DEBUG cinder.image.image_utils [None req-64e67250-96fc-4b5a-a345-3e5eaa02dadf tempest-SnapshotDependencyTests-560057263 None] Image conversion details: src /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa, size 1024.00 MB, duration 2.23 sec, destination /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c0df7931-153b-4187-9d99-8c5386c8b271 {{(pid=82646) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 20:12:21 devstack cinder-volume[82646]: INFO cinder.image.image_utils [None req-64e67250-96fc-4b5a-a345-3e5eaa02dadf tempest-SnapshotDependencyTests-560057263 None] Converted 1024.00 MB image at 459.39 MB/s
Apr 15 20:12:21 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-64e67250-96fc-4b5a-a345-3e5eaa02dadf tempest-SnapshotDependencyTests-560057263 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c0df7931-153b-4187-9d99-8c5386c8b271 is being set with open permissions: ugo+rw
Apr 15 20:12:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-64e67250-96fc-4b5a-a345-3e5eaa02dadf tempest-SnapshotDependencyTests-560057263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c0df7931-153b-4187-9d99-8c5386c8b271 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:21 devstack sudo[89194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c0df7931-153b-4187-9d99-8c5386c8b271
Apr 15 20:12:21 devstack sudo[89194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:21 devstack sudo[89194]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-64e67250-96fc-4b5a-a345-3e5eaa02dadf tempest-SnapshotDependencyTests-560057263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c0df7931-153b-4187-9d99-8c5386c8b271" returned: 0 in 0.477s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:21 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-64e67250-96fc-4b5a-a345-3e5eaa02dadf tempest-SnapshotDependencyTests-560057263 None] Lock "cinder-quobyte-c0df7931-153b-4187-9d99-8c5386c8b271" released by "_copy_volume_from_snapshot" :: held 4.439s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:12:21 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-64e67250-96fc-4b5a-a345-3e5eaa02dadf tempest-SnapshotDependencyTests-560057263 None] Lock "cinder-quobyte-97d319a1-505a-45f3-9276-125a14d08ea8-c0df7931-153b-4187-9d99-8c5386c8b271" released by "_create_volume_from_snapshot" :: held 4.457s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:12:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-64e67250-96fc-4b5a-a345-3e5eaa02dadf tempest-SnapshotDependencyTests-560057263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.467s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:12:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-2eea5ddb-2095-4fee-bd67-3eb34a3e3e72 tempest-VolumesDeleteCascade-471708485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.207s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:12:21 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-2eea5ddb-2095-4fee-bd67-3eb34a3e3e72 tempest-VolumesDeleteCascade-471708485 None] Creating offline snapshot 78e01ba4-3f20-40fc-9c3a-d77c5dc4fb2b of volume 90e72c65-f4f8-4869-bc50-7e6eb499d3cf {{(pid=82646) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 20:12:21 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-64e67250-96fc-4b5a-a345-3e5eaa02dadf tempest-SnapshotDependencyTests-560057263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2518a79-d863-473e-8e2f-7ab4769cc897) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0df7931-153b-4187-9d99-8c5386c8b271', 'volume_size': 1, 'snapshot_id': '97d319a1-505a-45f3-9276-125a14d08ea8'}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:12:21 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-64e67250-96fc-4b5a-a345-3e5eaa02dadf tempest-SnapshotDependencyTests-560057263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d0b321b-b224-4f55-a8f2-c5913009345a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:12:21 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9b9aa3-134c-4ec4-b896-de557bbeb4d7]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:12:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-2eea5ddb-2095-4fee-bd67-3eb34a3e3e72 tempest-VolumesDeleteCascade-471708485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:21 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-64e67250-96fc-4b5a-a345-3e5eaa02dadf tempest-SnapshotDependencyTests-560057263 None] Volume volume-c0df7931-153b-4187-9d99-8c5386c8b271 (c0df7931-153b-4187-9d99-8c5386c8b271): created successfully
Apr 15 20:12:21 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-64e67250-96fc-4b5a-a345-3e5eaa02dadf tempest-SnapshotDependencyTests-560057263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d0b321b-b224-4f55-a8f2-c5913009345a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:12:21 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-64e67250-96fc-4b5a-a345-3e5eaa02dadf tempest-SnapshotDependencyTests-560057263 None] Flow 'volume_create_manager' (80e6f266-08d2-499b-b478-000345a5f6ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:12:21 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-64e67250-96fc-4b5a-a345-3e5eaa02dadf tempest-SnapshotDependencyTests-560057263 None] Created volume successfully.
Apr 15 20:12:21 devstack sudo[89197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf
Apr 15 20:12:21 devstack sudo[89197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:22 devstack sudo[89197]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-2eea5ddb-2095-4fee-bd67-3eb34a3e3e72 tempest-VolumesDeleteCascade-471708485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf" returned: 0 in 0.487s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-2eea5ddb-2095-4fee-bd67-3eb34a3e3e72 tempest-VolumesDeleteCascade-471708485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf.78e01ba4-3f20-40fc-9c3a-d77c5dc4fb2b 1G {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:22 devstack sudo[89202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf.78e01ba4-3f20-40fc-9c3a-d77c5dc4fb2b 1G
Apr 15 20:12:22 devstack sudo[89202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:22 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-8e08ea0a-1da8-4f5e-8ec2-82823bf1a6a9 tempest-SnapshotDependencyTests-560057263 None] Acquiring lock "cinder-97d319a1-505a-45f3-9276-125a14d08ea8-delete_snapshot" by "delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:12:22 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-8e08ea0a-1da8-4f5e-8ec2-82823bf1a6a9 tempest-SnapshotDependencyTests-560057263 None] Lock "cinder-97d319a1-505a-45f3-9276-125a14d08ea8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:12:22 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-8e08ea0a-1da8-4f5e-8ec2-82823bf1a6a9 tempest-SnapshotDependencyTests-560057263 None] Acquiring lock "cinder-quobyte-95339c3c-2ac7-4329-83c8-3e0980d3b4fa" by "delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:12:22 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-8e08ea0a-1da8-4f5e-8ec2-82823bf1a6a9 tempest-SnapshotDependencyTests-560057263 None] Lock "cinder-quobyte-95339c3c-2ac7-4329-83c8-3e0980d3b4fa" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:12:22 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-8e08ea0a-1da8-4f5e-8ec2-82823bf1a6a9 tempest-SnapshotDependencyTests-560057263 None] Acquiring lock "cinder-quobyte-97d319a1-505a-45f3-9276-125a14d08ea8" by "_delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:12:22 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-8e08ea0a-1da8-4f5e-8ec2-82823bf1a6a9 tempest-SnapshotDependencyTests-560057263 None] Lock "cinder-quobyte-97d319a1-505a-45f3-9276-125a14d08ea8" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:12:22 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-8e08ea0a-1da8-4f5e-8ec2-82823bf1a6a9 tempest-SnapshotDependencyTests-560057263 None] Deleting offline snapshot 97d319a1-505a-45f3-9276-125a14d08ea8 of volume 95339c3c-2ac7-4329-83c8-3e0980d3b4fa {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 20:12:22 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-8e08ea0a-1da8-4f5e-8ec2-82823bf1a6a9 tempest-SnapshotDependencyTests-560057263 None] snapshot_file for this snap is: volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa.97d319a1-505a-45f3-9276-125a14d08ea8 {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 20:12:22 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[3291e2b5-4853-406c-85fe-c8fd48a854c2]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:12:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-8e08ea0a-1da8-4f5e-8ec2-82823bf1a6a9 tempest-SnapshotDependencyTests-560057263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa.97d319a1-505a-45f3-9276-125a14d08ea8 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:22 devstack sudo[89207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa.97d319a1-505a-45f3-9276-125a14d08ea8
Apr 15 20:12:22 devstack sudo[89207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:22 devstack sudo[89202]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-2eea5ddb-2095-4fee-bd67-3eb34a3e3e72 tempest-VolumesDeleteCascade-471708485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf.78e01ba4-3f20-40fc-9c3a-d77c5dc4fb2b 1G" returned: 0 in 0.622s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-2eea5ddb-2095-4fee-bd67-3eb34a3e3e72 tempest-VolumesDeleteCascade-471708485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf.78e01ba4-3f20-40fc-9c3a-d77c5dc4fb2b {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:22 devstack sudo[89209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf.78e01ba4-3f20-40fc-9c3a-d77c5dc4fb2b
Apr 15 20:12:22 devstack sudo[89209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:23 devstack sudo[89207]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:23 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-8e08ea0a-1da8-4f5e-8ec2-82823bf1a6a9 tempest-SnapshotDependencyTests-560057263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa.97d319a1-505a-45f3-9276-125a14d08ea8" returned: 0 in 0.564s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:23 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-8e08ea0a-1da8-4f5e-8ec2-82823bf1a6a9 tempest-SnapshotDependencyTests-560057263 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82646) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 20:12:23 devstack sudo[89209]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:23 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-2eea5ddb-2095-4fee-bd67-3eb34a3e3e72 tempest-VolumesDeleteCascade-471708485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf.78e01ba4-3f20-40fc-9c3a-d77c5dc4fb2b" returned: 0 in 0.429s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:23 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-2eea5ddb-2095-4fee-bd67-3eb34a3e3e72 tempest-VolumesDeleteCascade-471708485 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf.78e01ba4-3f20-40fc-9c3a-d77c5dc4fb2b is being set with open permissions: ugo+rw
Apr 15 20:12:23 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-2eea5ddb-2095-4fee-bd67-3eb34a3e3e72 tempest-VolumesDeleteCascade-471708485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf.78e01ba4-3f20-40fc-9c3a-d77c5dc4fb2b {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:23 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a246945-69eb-484d-9149-1aa6058c7e10]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:12:23 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-8e08ea0a-1da8-4f5e-8ec2-82823bf1a6a9 tempest-SnapshotDependencyTests-560057263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:23 devstack sudo[89217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf.78e01ba4-3f20-40fc-9c3a-d77c5dc4fb2b
Apr 15 20:12:23 devstack sudo[89217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:23 devstack sudo[89218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa
Apr 15 20:12:23 devstack sudo[89218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:23 devstack sudo[89217]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:23 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-2eea5ddb-2095-4fee-bd67-3eb34a3e3e72 tempest-VolumesDeleteCascade-471708485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf.78e01ba4-3f20-40fc-9c3a-d77c5dc4fb2b" returned: 0 in 0.496s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:23 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-2eea5ddb-2095-4fee-bd67-3eb34a3e3e72 tempest-VolumesDeleteCascade-471708485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf.info {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:23 devstack sudo[89225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf.info
Apr 15 20:12:23 devstack sudo[89225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:23 devstack sudo[89218]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:23 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-8e08ea0a-1da8-4f5e-8ec2-82823bf1a6a9 tempest-SnapshotDependencyTests-560057263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa" returned: 0 in 0.548s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:23 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-8e08ea0a-1da8-4f5e-8ec2-82823bf1a6a9 tempest-SnapshotDependencyTests-560057263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa.97d319a1-505a-45f3-9276-125a14d08ea8 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:23 devstack sudo[89227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa.97d319a1-505a-45f3-9276-125a14d08ea8
Apr 15 20:12:23 devstack sudo[89227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:24 devstack sudo[89225]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-2eea5ddb-2095-4fee-bd67-3eb34a3e3e72 tempest-VolumesDeleteCascade-471708485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf.info" returned: 0 in 0.484s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:24 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-2eea5ddb-2095-4fee-bd67-3eb34a3e3e72 tempest-VolumesDeleteCascade-471708485 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf.info is being set with open permissions: ugo+rw
Apr 15 20:12:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-2eea5ddb-2095-4fee-bd67-3eb34a3e3e72 tempest-VolumesDeleteCascade-471708485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf.info {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:24 devstack sudo[89233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf.info
Apr 15 20:12:24 devstack sudo[89233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:24 devstack sudo[89227]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-8e08ea0a-1da8-4f5e-8ec2-82823bf1a6a9 tempest-SnapshotDependencyTests-560057263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa.97d319a1-505a-45f3-9276-125a14d08ea8" returned: 0 in 0.513s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-8e08ea0a-1da8-4f5e-8ec2-82823bf1a6a9 tempest-SnapshotDependencyTests-560057263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa.97d319a1-505a-45f3-9276-125a14d08ea8 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:24 devstack sudo[89235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa.97d319a1-505a-45f3-9276-125a14d08ea8
Apr 15 20:12:24 devstack sudo[89235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:24 devstack sudo[89233]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-2eea5ddb-2095-4fee-bd67-3eb34a3e3e72 tempest-VolumesDeleteCascade-471708485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf.info" returned: 0 in 0.488s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-2eea5ddb-2095-4fee-bd67-3eb34a3e3e72 tempest-VolumesDeleteCascade-471708485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.099s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:12:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-3cecc952-4fa3-4127-9264-1f9e12367123 tempest-VolumesSnapshotTestJSON-895312450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.952s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:12:24 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-3cecc952-4fa3-4127-9264-1f9e12367123 tempest-VolumesSnapshotTestJSON-895312450 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:12:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1174043929',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f93c5be4-d9c7-48b9-98f4-478b48926ed9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='170389fee38140d9bf7a7115672201ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:12:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:12:21Z,use_quota=True,user_id='118d321c471c4eb281e6cc3e2bf90691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:12:24 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-3cecc952-4fa3-4127-9264-1f9e12367123 tempest-VolumesSnapshotTestJSON-895312450 None] Creating volume f93c5be4-d9c7-48b9-98f4-478b48926ed9 {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:12:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-3cecc952-4fa3-4127-9264-1f9e12367123 tempest-VolumesSnapshotTestJSON-895312450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:12:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-3cecc952-4fa3-4127-9264-1f9e12367123 tempest-VolumesSnapshotTestJSON-895312450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:12:24 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-3cecc952-4fa3-4127-9264-1f9e12367123 tempest-VolumesSnapshotTestJSON-895312450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:12:24 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-3cecc952-4fa3-4127-9264-1f9e12367123 tempest-VolumesSnapshotTestJSON-895312450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:12:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-3cecc952-4fa3-4127-9264-1f9e12367123 tempest-VolumesSnapshotTestJSON-895312450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:12:24 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-3cecc952-4fa3-4127-9264-1f9e12367123 tempest-VolumesSnapshotTestJSON-895312450 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:12:24 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-3cecc952-4fa3-4127-9264-1f9e12367123 tempest-VolumesSnapshotTestJSON-895312450 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:12:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-3cecc952-4fa3-4127-9264-1f9e12367123 tempest-VolumesSnapshotTestJSON-895312450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:24 devstack sudo[89235]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:24 devstack sudo[89239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9 1073741824
Apr 15 20:12:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-8e08ea0a-1da8-4f5e-8ec2-82823bf1a6a9 tempest-SnapshotDependencyTests-560057263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa.97d319a1-505a-45f3-9276-125a14d08ea8" returned: 0 in 0.477s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:24 devstack sudo[89239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:24 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-2eea5ddb-2095-4fee-bd67-3eb34a3e3e72 tempest-VolumesDeleteCascade-471708485 None] Create snapshot completed successfully
Apr 15 20:12:24 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-8e08ea0a-1da8-4f5e-8ec2-82823bf1a6a9 tempest-SnapshotDependencyTests-560057263 None] Lock "cinder-quobyte-97d319a1-505a-45f3-9276-125a14d08ea8" released by "_delete_snapshot" :: held 2.178s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:12:24 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-8e08ea0a-1da8-4f5e-8ec2-82823bf1a6a9 tempest-SnapshotDependencyTests-560057263 None] Lock "cinder-quobyte-95339c3c-2ac7-4329-83c8-3e0980d3b4fa" released by "delete_snapshot" :: held 2.200s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:12:24 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-8e08ea0a-1da8-4f5e-8ec2-82823bf1a6a9 tempest-SnapshotDependencyTests-560057263 None] Created reservations ['0776e82a-b6e8-4022-ab67-7382d114d81f', '183758c6-c7b9-4978-9343-e23ba4e8bb16', 'ad7a7ebf-d184-478f-9800-9fe7a044a0ed', '61d452e0-b99c-4305-9fee-3bb698d15fff'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:12:25 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-8e08ea0a-1da8-4f5e-8ec2-82823bf1a6a9 tempest-SnapshotDependencyTests-560057263 None] Delete snapshot completed successfully.
Apr 15 20:12:25 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-8e08ea0a-1da8-4f5e-8ec2-82823bf1a6a9 tempest-SnapshotDependencyTests-560057263 None] Lock "cinder-97d319a1-505a-45f3-9276-125a14d08ea8-delete_snapshot" released by "delete_snapshot" :: held 2.300s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:12:25 devstack sudo[89239]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:25 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-3cecc952-4fa3-4127-9264-1f9e12367123 tempest-VolumesSnapshotTestJSON-895312450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9 1073741824" returned: 0 in 0.533s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:25 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-3cecc952-4fa3-4127-9264-1f9e12367123 tempest-VolumesSnapshotTestJSON-895312450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:25 devstack sudo[89244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9
Apr 15 20:12:25 devstack sudo[89244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:25 devstack sudo[89244]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:25 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-3cecc952-4fa3-4127-9264-1f9e12367123 tempest-VolumesSnapshotTestJSON-895312450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9" returned: 0 in 0.476s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:25 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-3cecc952-4fa3-4127-9264-1f9e12367123 tempest-VolumesSnapshotTestJSON-895312450 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:12:25 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-3cecc952-4fa3-4127-9264-1f9e12367123 tempest-VolumesSnapshotTestJSON-895312450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:12:26 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-3cecc952-4fa3-4127-9264-1f9e12367123 tempest-VolumesSnapshotTestJSON-895312450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4f1852f-8965-4058-b5ef-9b5ddcf7f98d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:12:26 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-3cecc952-4fa3-4127-9264-1f9e12367123 tempest-VolumesSnapshotTestJSON-895312450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54a5dd82-991a-4eae-a727-b89df1948cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:12:26 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-c4d3c84e-a9f1-43ae-99ea-305f035cd382 tempest-SnapshotDependencyTests-560057263 None] Acquiring lock "cinder-95339c3c-2ac7-4329-83c8-3e0980d3b4fa-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:12:26 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-c4d3c84e-a9f1-43ae-99ea-305f035cd382 tempest-SnapshotDependencyTests-560057263 None] Lock "cinder-95339c3c-2ac7-4329-83c8-3e0980d3b4fa-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:12:26 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-3cecc952-4fa3-4127-9264-1f9e12367123 tempest-VolumesSnapshotTestJSON-895312450 None] Volume volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9 (f93c5be4-d9c7-48b9-98f4-478b48926ed9): created successfully
Apr 15 20:12:26 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-3cecc952-4fa3-4127-9264-1f9e12367123 tempest-VolumesSnapshotTestJSON-895312450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54a5dd82-991a-4eae-a727-b89df1948cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:12:26 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-3cecc952-4fa3-4127-9264-1f9e12367123 tempest-VolumesSnapshotTestJSON-895312450 None] Flow 'volume_create_manager' (453a273a-bb34-4fee-9248-d5b320de6520) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:12:26 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-3cecc952-4fa3-4127-9264-1f9e12367123 tempest-VolumesSnapshotTestJSON-895312450 None] Created volume successfully.
Apr 15 20:12:26 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-c4d3c84e-a9f1-43ae-99ea-305f035cd382 tempest-SnapshotDependencyTests-560057263 None] Acquiring lock "cinder-quobyte-95339c3c-2ac7-4329-83c8-3e0980d3b4fa" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:12:26 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-c4d3c84e-a9f1-43ae-99ea-305f035cd382 tempest-SnapshotDependencyTests-560057263 None] Lock "cinder-quobyte-95339c3c-2ac7-4329-83c8-3e0980d3b4fa" acquired by "delete_volume" :: waited 0.011s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:12:26 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c90f0d-f956-4671-8c4a-fcbfdebeaee1]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:12:26 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c4d3c84e-a9f1-43ae-99ea-305f035cd382 tempest-SnapshotDependencyTests-560057263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:26 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-8f0c5d34-ab2f-4a0f-a246-a5cb795d096a tempest-VolumesDeleteCascade-471708485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:12:26 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-8f0c5d34-ab2f-4a0f-a246-a5cb795d096a tempest-VolumesDeleteCascade-471708485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:12:26 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-8f0c5d34-ab2f-4a0f-a246-a5cb795d096a tempest-VolumesDeleteCascade-471708485 None] Creating offline snapshot a0855b94-c7d3-442b-accb-aa7fad68ff9b of volume 90e72c65-f4f8-4869-bc50-7e6eb499d3cf {{(pid=82646) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 20:12:26 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3caa59-4128-442f-9670-6fa01d7ae3ca]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:12:26 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-8f0c5d34-ab2f-4a0f-a246-a5cb795d096a tempest-VolumesDeleteCascade-471708485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf.78e01ba4-3f20-40fc-9c3a-d77c5dc4fb2b {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:26 devstack sudo[89248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa
Apr 15 20:12:26 devstack sudo[89248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:26 devstack sudo[89249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf.78e01ba4-3f20-40fc-9c3a-d77c5dc4fb2b
Apr 15 20:12:26 devstack sudo[89249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:26 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-b616aaf5-93f8-4f69-b25d-f1cee7d55343 tempest-VolumesSnapshotTestJSON-895312450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:12:26 devstack sudo[89248]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:26 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c4d3c84e-a9f1-43ae-99ea-305f035cd382 tempest-SnapshotDependencyTests-560057263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa" returned: 0 in 0.596s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:26 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c4d3c84e-a9f1-43ae-99ea-305f035cd382 tempest-SnapshotDependencyTests-560057263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:26 devstack sudo[89249]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:26 devstack sudo[89258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa
Apr 15 20:12:26 devstack sudo[89258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:26 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-8f0c5d34-ab2f-4a0f-a246-a5cb795d096a tempest-VolumesDeleteCascade-471708485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf.78e01ba4-3f20-40fc-9c3a-d77c5dc4fb2b" returned: 0 in 0.536s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:26 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-8f0c5d34-ab2f-4a0f-a246-a5cb795d096a tempest-VolumesDeleteCascade-471708485 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82646) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 20:12:26 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-8f0c5d34-ab2f-4a0f-a246-a5cb795d096a tempest-VolumesDeleteCascade-471708485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf.78e01ba4-3f20-40fc-9c3a-d77c5dc4fb2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf.a0855b94-c7d3-442b-accb-aa7fad68ff9b 1G {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:26 devstack sudo[89260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf.78e01ba4-3f20-40fc-9c3a-d77c5dc4fb2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf.a0855b94-c7d3-442b-accb-aa7fad68ff9b 1G
Apr 15 20:12:26 devstack sudo[89260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:27 devstack sudo[89258]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:27 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c4d3c84e-a9f1-43ae-99ea-305f035cd382 tempest-SnapshotDependencyTests-560057263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-95339c3c-2ac7-4329-83c8-3e0980d3b4fa" returned: 0 in 0.396s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:27 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-c4d3c84e-a9f1-43ae-99ea-305f035cd382 tempest-SnapshotDependencyTests-560057263 None] Lock "cinder-quobyte-95339c3c-2ac7-4329-83c8-3e0980d3b4fa" released by "delete_volume" :: held 1.023s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:12:27 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-c4d3c84e-a9f1-43ae-99ea-305f035cd382 tempest-SnapshotDependencyTests-560057263 None] Created reservations ['8ac7adf8-eae0-4bc1-b338-003c6c936b1d', '86ac9946-fa1e-4443-8252-94f7fc16052a', '14cda2e4-3798-47c6-a69f-5cfcbbc80f0c', '7fbb2d07-22f3-4ad7-af48-4a58e89c3eb1'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:12:27 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-c4d3c84e-a9f1-43ae-99ea-305f035cd382 tempest-SnapshotDependencyTests-560057263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:12:27 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-c4d3c84e-a9f1-43ae-99ea-305f035cd382 tempest-SnapshotDependencyTests-560057263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:12:27 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-c4d3c84e-a9f1-43ae-99ea-305f035cd382 tempest-SnapshotDependencyTests-560057263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:12:27 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-c4d3c84e-a9f1-43ae-99ea-305f035cd382 tempest-SnapshotDependencyTests-560057263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:12:27 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-c4d3c84e-a9f1-43ae-99ea-305f035cd382 tempest-SnapshotDependencyTests-560057263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:12:27 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c4d3c84e-a9f1-43ae-99ea-305f035cd382 tempest-SnapshotDependencyTests-560057263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:27 devstack sudo[89266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:12:27 devstack sudo[89266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:27 devstack sudo[89260]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:27 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-8f0c5d34-ab2f-4a0f-a246-a5cb795d096a tempest-VolumesDeleteCascade-471708485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf.78e01ba4-3f20-40fc-9c3a-d77c5dc4fb2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf.a0855b94-c7d3-442b-accb-aa7fad68ff9b 1G" returned: 0 in 0.561s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:27 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-8f0c5d34-ab2f-4a0f-a246-a5cb795d096a tempest-VolumesDeleteCascade-471708485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf.78e01ba4-3f20-40fc-9c3a-d77c5dc4fb2b -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf.a0855b94-c7d3-442b-accb-aa7fad68ff9b {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:27 devstack sudo[89268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf.78e01ba4-3f20-40fc-9c3a-d77c5dc4fb2b -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf.a0855b94-c7d3-442b-accb-aa7fad68ff9b
Apr 15 20:12:27 devstack sudo[89268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:27 devstack sudo[89266]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:27 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c4d3c84e-a9f1-43ae-99ea-305f035cd382 tempest-SnapshotDependencyTests-560057263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.454s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:27 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-c4d3c84e-a9f1-43ae-99ea-305f035cd382 tempest-SnapshotDependencyTests-560057263 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:12:27 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-c4d3c84e-a9f1-43ae-99ea-305f035cd382 tempest-SnapshotDependencyTests-560057263 None] Deleted volume successfully.
Apr 15 20:12:27 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-c4d3c84e-a9f1-43ae-99ea-305f035cd382 tempest-SnapshotDependencyTests-560057263 None] Lock "cinder-95339c3c-2ac7-4329-83c8-3e0980d3b4fa-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:12:27 devstack sudo[89268]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:27 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-8f0c5d34-ab2f-4a0f-a246-a5cb795d096a tempest-VolumesDeleteCascade-471708485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf.78e01ba4-3f20-40fc-9c3a-d77c5dc4fb2b -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf.a0855b94-c7d3-442b-accb-aa7fad68ff9b" returned: 0 in 0.484s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:27 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-8f0c5d34-ab2f-4a0f-a246-a5cb795d096a tempest-VolumesDeleteCascade-471708485 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf.a0855b94-c7d3-442b-accb-aa7fad68ff9b is being set with open permissions: ugo+rw
Apr 15 20:12:27 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-8f0c5d34-ab2f-4a0f-a246-a5cb795d096a tempest-VolumesDeleteCascade-471708485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf.a0855b94-c7d3-442b-accb-aa7fad68ff9b {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:27 devstack sudo[89274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf.a0855b94-c7d3-442b-accb-aa7fad68ff9b
Apr 15 20:12:27 devstack sudo[89274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:28 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-8678cc8f-a116-462b-b5e2-d4f3f9fe4436 tempest-SnapshotDependencyTests-560057263 None] Acquiring lock "cinder-c0df7931-153b-4187-9d99-8c5386c8b271-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:12:28 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-8678cc8f-a116-462b-b5e2-d4f3f9fe4436 tempest-SnapshotDependencyTests-560057263 None] Lock "cinder-c0df7931-153b-4187-9d99-8c5386c8b271-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:12:28 devstack sudo[89274]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:28 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-8f0c5d34-ab2f-4a0f-a246-a5cb795d096a tempest-VolumesDeleteCascade-471708485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf.a0855b94-c7d3-442b-accb-aa7fad68ff9b" returned: 0 in 0.414s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:28 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-8678cc8f-a116-462b-b5e2-d4f3f9fe4436 tempest-SnapshotDependencyTests-560057263 None] Acquiring lock "cinder-quobyte-c0df7931-153b-4187-9d99-8c5386c8b271" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:12:28 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-8f0c5d34-ab2f-4a0f-a246-a5cb795d096a tempest-VolumesDeleteCascade-471708485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.064s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:12:28 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-b616aaf5-93f8-4f69-b25d-f1cee7d55343 tempest-VolumesSnapshotTestJSON-895312450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.732s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:12:28 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-8678cc8f-a116-462b-b5e2-d4f3f9fe4436 tempest-SnapshotDependencyTests-560057263 None] Lock "cinder-quobyte-c0df7931-153b-4187-9d99-8c5386c8b271" acquired by "delete_volume" :: waited 0.042s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:12:28 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-8f0c5d34-ab2f-4a0f-a246-a5cb795d096a tempest-VolumesDeleteCascade-471708485 None] Create snapshot completed successfully
Apr 15 20:12:28 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0e25af-aa1e-4b47-8d51-3185359f6683]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:12:28 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-8678cc8f-a116-462b-b5e2-d4f3f9fe4436 tempest-SnapshotDependencyTests-560057263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c0df7931-153b-4187-9d99-8c5386c8b271 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:28 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-b616aaf5-93f8-4f69-b25d-f1cee7d55343 tempest-VolumesSnapshotTestJSON-895312450 None] Creating offline snapshot 733e2f26-a422-4dbb-839f-95d80d43c302 of volume f93c5be4-d9c7-48b9-98f4-478b48926ed9 {{(pid=82646) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 20:12:28 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf60822-eea7-4801-b419-9463c43a91a3]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:12:28 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b616aaf5-93f8-4f69-b25d-f1cee7d55343 tempest-VolumesSnapshotTestJSON-895312450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:28 devstack sudo[89277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c0df7931-153b-4187-9d99-8c5386c8b271
Apr 15 20:12:28 devstack sudo[89277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:28 devstack sudo[89278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9
Apr 15 20:12:28 devstack sudo[89278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:28 devstack sudo[89277]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:28 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-8678cc8f-a116-462b-b5e2-d4f3f9fe4436 tempest-SnapshotDependencyTests-560057263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c0df7931-153b-4187-9d99-8c5386c8b271" returned: 0 in 0.534s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:28 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-8678cc8f-a116-462b-b5e2-d4f3f9fe4436 tempest-SnapshotDependencyTests-560057263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c0df7931-153b-4187-9d99-8c5386c8b271 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:28 devstack sudo[89287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c0df7931-153b-4187-9d99-8c5386c8b271
Apr 15 20:12:28 devstack sudo[89278]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:28 devstack sudo[89287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:28 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b616aaf5-93f8-4f69-b25d-f1cee7d55343 tempest-VolumesSnapshotTestJSON-895312450 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9" returned: 0 in 0.551s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:28 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b616aaf5-93f8-4f69-b25d-f1cee7d55343 tempest-VolumesSnapshotTestJSON-895312450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9.733e2f26-a422-4dbb-839f-95d80d43c302 1G {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:28 devstack sudo[89290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9.733e2f26-a422-4dbb-839f-95d80d43c302 1G
Apr 15 20:12:28 devstack sudo[89290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:29 devstack sudo[89287]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-8678cc8f-a116-462b-b5e2-d4f3f9fe4436 tempest-SnapshotDependencyTests-560057263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-c0df7931-153b-4187-9d99-8c5386c8b271" returned: 0 in 0.508s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:29 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-8678cc8f-a116-462b-b5e2-d4f3f9fe4436 tempest-SnapshotDependencyTests-560057263 None] Lock "cinder-quobyte-c0df7931-153b-4187-9d99-8c5386c8b271" released by "delete_volume" :: held 1.068s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:12:29 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] Acquiring lock "cinder-90e72c65-f4f8-4869-bc50-7e6eb499d3cf-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:12:29 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] Lock "cinder-90e72c65-f4f8-4869-bc50-7e6eb499d3cf-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:12:29 devstack sudo[89290]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b616aaf5-93f8-4f69-b25d-f1cee7d55343 tempest-VolumesSnapshotTestJSON-895312450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9.733e2f26-a422-4dbb-839f-95d80d43c302 1G" returned: 0 in 0.561s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:29 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] Performing cascade delete. {{(pid=82646) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 15 20:12:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b616aaf5-93f8-4f69-b25d-f1cee7d55343 tempest-VolumesSnapshotTestJSON-895312450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9 -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9.733e2f26-a422-4dbb-839f-95d80d43c302 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:29 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] Acquiring lock "cinder-78e01ba4-3f20-40fc-9c3a-d77c5dc4fb2b-delete_snapshot" by "delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:12:29 devstack sudo[89296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9 -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9.733e2f26-a422-4dbb-839f-95d80d43c302
Apr 15 20:12:29 devstack sudo[89296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:29 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-8678cc8f-a116-462b-b5e2-d4f3f9fe4436 tempest-SnapshotDependencyTests-560057263 None] Created reservations ['cc92258e-5469-40bb-b595-9528481fca51', 'df65890b-c164-457b-bbfa-252959aea580', '500357e7-66bd-4d5e-accb-b8cd165e52f1', '69672379-dcfd-4c2a-b673-872d114c115d'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:12:29 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] Lock "cinder-78e01ba4-3f20-40fc-9c3a-d77c5dc4fb2b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:12:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-8678cc8f-a116-462b-b5e2-d4f3f9fe4436 tempest-SnapshotDependencyTests-560057263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:12:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-8678cc8f-a116-462b-b5e2-d4f3f9fe4436 tempest-SnapshotDependencyTests-560057263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:12:29 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-8678cc8f-a116-462b-b5e2-d4f3f9fe4436 tempest-SnapshotDependencyTests-560057263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:12:29 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-8678cc8f-a116-462b-b5e2-d4f3f9fe4436 tempest-SnapshotDependencyTests-560057263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:12:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-8678cc8f-a116-462b-b5e2-d4f3f9fe4436 tempest-SnapshotDependencyTests-560057263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:12:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-8678cc8f-a116-462b-b5e2-d4f3f9fe4436 tempest-SnapshotDependencyTests-560057263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:29 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] Acquiring lock "cinder-quobyte-90e72c65-f4f8-4869-bc50-7e6eb499d3cf" by "delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:12:29 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] Lock "cinder-quobyte-90e72c65-f4f8-4869-bc50-7e6eb499d3cf" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:12:29 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] Acquiring lock "cinder-quobyte-78e01ba4-3f20-40fc-9c3a-d77c5dc4fb2b" by "_delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:12:29 devstack sudo[89298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:12:29 devstack sudo[89298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:29 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] Lock "cinder-quobyte-78e01ba4-3f20-40fc-9c3a-d77c5dc4fb2b" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:12:29 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] Deleting offline snapshot 78e01ba4-3f20-40fc-9c3a-d77c5dc4fb2b of volume 90e72c65-f4f8-4869-bc50-7e6eb499d3cf {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 20:12:29 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] snapshot_file for this snap is: volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf.78e01ba4-3f20-40fc-9c3a-d77c5dc4fb2b {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 20:12:29 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[78589043-d78d-4d51-8643-4284e65f89c2]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:12:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf.78e01ba4-3f20-40fc-9c3a-d77c5dc4fb2b {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:29 devstack sudo[89300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf.78e01ba4-3f20-40fc-9c3a-d77c5dc4fb2b
Apr 15 20:12:29 devstack sudo[89300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:29 devstack sudo[89296]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b616aaf5-93f8-4f69-b25d-f1cee7d55343 tempest-VolumesSnapshotTestJSON-895312450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9 -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9.733e2f26-a422-4dbb-839f-95d80d43c302" returned: 0 in 0.507s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:29 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-b616aaf5-93f8-4f69-b25d-f1cee7d55343 tempest-VolumesSnapshotTestJSON-895312450 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9.733e2f26-a422-4dbb-839f-95d80d43c302 is being set with open permissions: ugo+rw
Apr 15 20:12:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b616aaf5-93f8-4f69-b25d-f1cee7d55343 tempest-VolumesSnapshotTestJSON-895312450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9.733e2f26-a422-4dbb-839f-95d80d43c302 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:30 devstack sudo[89298]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-8678cc8f-a116-462b-b5e2-d4f3f9fe4436 tempest-SnapshotDependencyTests-560057263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.441s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:30 devstack sudo[89306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9.733e2f26-a422-4dbb-839f-95d80d43c302
Apr 15 20:12:30 devstack sudo[89306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:30 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-8678cc8f-a116-462b-b5e2-d4f3f9fe4436 tempest-SnapshotDependencyTests-560057263 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:12:30 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-8678cc8f-a116-462b-b5e2-d4f3f9fe4436 tempest-SnapshotDependencyTests-560057263 None] Deleted volume successfully.
Apr 15 20:12:30 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-8678cc8f-a116-462b-b5e2-d4f3f9fe4436 tempest-SnapshotDependencyTests-560057263 None] Lock "cinder-c0df7931-153b-4187-9d99-8c5386c8b271-delete_volume" released by "delete_volume" :: held 1.825s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:12:30 devstack sudo[89300]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf.78e01ba4-3f20-40fc-9c3a-d77c5dc4fb2b" returned: 0 in 0.550s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:30 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82646) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 20:12:30 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35b5be4-cbc9-428d-a26c-cd9dc615ef38]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:12:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:30 devstack sudo[89311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf
Apr 15 20:12:30 devstack sudo[89311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:30 devstack sudo[89306]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b616aaf5-93f8-4f69-b25d-f1cee7d55343 tempest-VolumesSnapshotTestJSON-895312450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9.733e2f26-a422-4dbb-839f-95d80d43c302" returned: 0 in 0.542s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b616aaf5-93f8-4f69-b25d-f1cee7d55343 tempest-VolumesSnapshotTestJSON-895312450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9.info {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:30 devstack sudo[89314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9.info
Apr 15 20:12:30 devstack sudo[89314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:30 devstack sudo[89311]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf" returned: 0 in 0.599s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:30 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4d2766-b3d8-49e0-926c-bf9185377280]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:12:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf.a0855b94-c7d3-442b-accb-aa7fad68ff9b {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:30 devstack sudo[89319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf.a0855b94-c7d3-442b-accb-aa7fad68ff9b
Apr 15 20:12:30 devstack sudo[89319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:31 devstack sudo[89314]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b616aaf5-93f8-4f69-b25d-f1cee7d55343 tempest-VolumesSnapshotTestJSON-895312450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9.info" returned: 0 in 0.473s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:31 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-b616aaf5-93f8-4f69-b25d-f1cee7d55343 tempest-VolumesSnapshotTestJSON-895312450 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9.info is being set with open permissions: ugo+rw
Apr 15 20:12:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b616aaf5-93f8-4f69-b25d-f1cee7d55343 tempest-VolumesSnapshotTestJSON-895312450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9.info {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:31 devstack sudo[89322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9.info
Apr 15 20:12:31 devstack sudo[89322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:31 devstack sudo[89319]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf.a0855b94-c7d3-442b-accb-aa7fad68ff9b" returned: 0 in 0.572s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:31 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82646) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 20:12:31 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2bd227-9975-430c-b98d-c01018266067]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:12:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf.78e01ba4-3f20-40fc-9c3a-d77c5dc4fb2b {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:31 devstack sudo[89327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf.78e01ba4-3f20-40fc-9c3a-d77c5dc4fb2b
Apr 15 20:12:31 devstack sudo[89327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:31 devstack sudo[89322]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b616aaf5-93f8-4f69-b25d-f1cee7d55343 tempest-VolumesSnapshotTestJSON-895312450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9.info" returned: 0 in 0.447s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-b616aaf5-93f8-4f69-b25d-f1cee7d55343 tempest-VolumesSnapshotTestJSON-895312450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.200s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:12:31 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-b616aaf5-93f8-4f69-b25d-f1cee7d55343 tempest-VolumesSnapshotTestJSON-895312450 None] Create snapshot completed successfully
Apr 15 20:12:31 devstack sudo[89327]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf.78e01ba4-3f20-40fc-9c3a-d77c5dc4fb2b" returned: 0 in 0.575s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:31 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82646) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 20:12:31 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c63efd4-96dc-4c1a-abd9-5c57f73b9df8]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:12:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:32 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-adb7f475-5f55-4f6f-932f-f2215d376db7 tempest-VolumesSnapshotTestJSON-895312450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:12:32 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-adb7f475-5f55-4f6f-932f-f2215d376db7 tempest-VolumesSnapshotTestJSON-895312450 None] Flow 'volume_create_manager' (6c555a76-aee8-4229-a7b4-2142786b138d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:12:32 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-adb7f475-5f55-4f6f-932f-f2215d376db7 tempest-VolumesSnapshotTestJSON-895312450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b00910a-cc49-4d4c-b168-05f9137ff190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:12:32 devstack sudo[89334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf
Apr 15 20:12:32 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-adb7f475-5f55-4f6f-932f-f2215d376db7 tempest-VolumesSnapshotTestJSON-895312450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b00910a-cc49-4d4c-b168-05f9137ff190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:12:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1139825849',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76886b8c-7920-4c61-8aaf-9a331937ff1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='170389fee38140d9bf7a7115672201ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:12:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=733e2f26-a422-4dbb-839f-95d80d43c302,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:12:32Z,use_quota=True,user_id='118d321c471c4eb281e6cc3e2bf90691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:12:32 devstack sudo[89334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:32 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-adb7f475-5f55-4f6f-932f-f2215d376db7 tempest-VolumesSnapshotTestJSON-895312450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afa53b47-53be-4a66-bd13-c9e0e793553a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:12:32 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-adb7f475-5f55-4f6f-932f-f2215d376db7 tempest-VolumesSnapshotTestJSON-895312450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afa53b47-53be-4a66-bd13-c9e0e793553a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:12:32 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-adb7f475-5f55-4f6f-932f-f2215d376db7 tempest-VolumesSnapshotTestJSON-895312450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8970ae9d-3fbf-4b20-910d-41f0fd96f069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:12:32 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-adb7f475-5f55-4f6f-932f-f2215d376db7 tempest-VolumesSnapshotTestJSON-895312450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8970ae9d-3fbf-4b20-910d-41f0fd96f069) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '76886b8c-7920-4c61-8aaf-9a331937ff1b', 'volume_name': 'volume-76886b8c-7920-4c61-8aaf-9a331937ff1b', 'volume_size': 1, 'snapshot_id': '733e2f26-a422-4dbb-839f-95d80d43c302'}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:12:32 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-adb7f475-5f55-4f6f-932f-f2215d376db7 tempest-VolumesSnapshotTestJSON-895312450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb65ea14-9d35-4651-ab2d-9740371e8550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:12:32 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-adb7f475-5f55-4f6f-932f-f2215d376db7 tempest-VolumesSnapshotTestJSON-895312450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb65ea14-9d35-4651-ab2d-9740371e8550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:12:32 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-adb7f475-5f55-4f6f-932f-f2215d376db7 tempest-VolumesSnapshotTestJSON-895312450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10ca94c6-168d-427d-a4bc-252da15ae63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:12:32 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-adb7f475-5f55-4f6f-932f-f2215d376db7 tempest-VolumesSnapshotTestJSON-895312450 None] Volume 76886b8c-7920-4c61-8aaf-9a331937ff1b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-76886b8c-7920-4c61-8aaf-9a331937ff1b', 'volume_size': 1, 'snapshot_id': '733e2f26-a422-4dbb-839f-95d80d43c302'}
Apr 15 20:12:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-adb7f475-5f55-4f6f-932f-f2215d376db7 tempest-VolumesSnapshotTestJSON-895312450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:12:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-adb7f475-5f55-4f6f-932f-f2215d376db7 tempest-VolumesSnapshotTestJSON-895312450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:12:32 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-adb7f475-5f55-4f6f-932f-f2215d376db7 tempest-VolumesSnapshotTestJSON-895312450 None] Acquiring lock "cinder-quobyte-733e2f26-a422-4dbb-839f-95d80d43c302-76886b8c-7920-4c61-8aaf-9a331937ff1b" by "_create_volume_from_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:12:32 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-adb7f475-5f55-4f6f-932f-f2215d376db7 tempest-VolumesSnapshotTestJSON-895312450 None] Lock "cinder-quobyte-733e2f26-a422-4dbb-839f-95d80d43c302-76886b8c-7920-4c61-8aaf-9a331937ff1b" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:12:32 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-adb7f475-5f55-4f6f-932f-f2215d376db7 tempest-VolumesSnapshotTestJSON-895312450 None] Creating volume 76886b8c-7920-4c61-8aaf-9a331937ff1b from snapshot 733e2f26-a422-4dbb-839f-95d80d43c302 {{(pid=82646) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 15 20:12:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-adb7f475-5f55-4f6f-932f-f2215d376db7 tempest-VolumesSnapshotTestJSON-895312450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:12:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-adb7f475-5f55-4f6f-932f-f2215d376db7 tempest-VolumesSnapshotTestJSON-895312450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:12:32 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-adb7f475-5f55-4f6f-932f-f2215d376db7 tempest-VolumesSnapshotTestJSON-895312450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:12:32 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-adb7f475-5f55-4f6f-932f-f2215d376db7 tempest-VolumesSnapshotTestJSON-895312450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:12:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-adb7f475-5f55-4f6f-932f-f2215d376db7 tempest-VolumesSnapshotTestJSON-895312450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:12:32 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-adb7f475-5f55-4f6f-932f-f2215d376db7 tempest-VolumesSnapshotTestJSON-895312450 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:12:32 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-adb7f475-5f55-4f6f-932f-f2215d376db7 tempest-VolumesSnapshotTestJSON-895312450 None] Acquiring lock "cinder-quobyte-76886b8c-7920-4c61-8aaf-9a331937ff1b" by "_copy_volume_from_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:12:32 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-adb7f475-5f55-4f6f-932f-f2215d376db7 tempest-VolumesSnapshotTestJSON-895312450 None] Lock "cinder-quobyte-76886b8c-7920-4c61-8aaf-9a331937ff1b" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:12:32 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-adb7f475-5f55-4f6f-932f-f2215d376db7 tempest-VolumesSnapshotTestJSON-895312450 None] snapshot: 733e2f26-a422-4dbb-839f-95d80d43c302, volume: 76886b8c-7920-4c61-8aaf-9a331937ff1b,  {{(pid=82646) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 15 20:12:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-adb7f475-5f55-4f6f-932f-f2215d376db7 tempest-VolumesSnapshotTestJSON-895312450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:12:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-adb7f475-5f55-4f6f-932f-f2215d376db7 tempest-VolumesSnapshotTestJSON-895312450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:12:32 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-adb7f475-5f55-4f6f-932f-f2215d376db7 tempest-VolumesSnapshotTestJSON-895312450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:12:32 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-adb7f475-5f55-4f6f-932f-f2215d376db7 tempest-VolumesSnapshotTestJSON-895312450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:12:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-adb7f475-5f55-4f6f-932f-f2215d376db7 tempest-VolumesSnapshotTestJSON-895312450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:12:32 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[87eec603-93cc-462c-abc5-41b5537dc56c]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:12:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-adb7f475-5f55-4f6f-932f-f2215d376db7 tempest-VolumesSnapshotTestJSON-895312450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9.733e2f26-a422-4dbb-839f-95d80d43c302 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:32 devstack sudo[89336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9.733e2f26-a422-4dbb-839f-95d80d43c302
Apr 15 20:12:32 devstack sudo[89336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:32 devstack sudo[89334]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf" returned: 0 in 0.688s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf.78e01ba4-3f20-40fc-9c3a-d77c5dc4fb2b {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:32 devstack sudo[89341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf.78e01ba4-3f20-40fc-9c3a-d77c5dc4fb2b
Apr 15 20:12:32 devstack sudo[89341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:32 devstack sudo[89336]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-adb7f475-5f55-4f6f-932f-f2215d376db7 tempest-VolumesSnapshotTestJSON-895312450 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9.733e2f26-a422-4dbb-839f-95d80d43c302" returned: 0 in 0.635s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:32 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-adb7f475-5f55-4f6f-932f-f2215d376db7 tempest-VolumesSnapshotTestJSON-895312450 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82646) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 20:12:32 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-adb7f475-5f55-4f6f-932f-f2215d376db7 tempest-VolumesSnapshotTestJSON-895312450 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9 {{(pid=82646) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 15 20:12:32 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-adb7f475-5f55-4f6f-932f-f2215d376db7 tempest-VolumesSnapshotTestJSON-895312450 None] Creating direct copy from snapshot {{(pid=82646) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 15 20:12:32 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6084340-0089-4480-8fb7-c0a533396997]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:12:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-adb7f475-5f55-4f6f-932f-f2215d376db7 tempest-VolumesSnapshotTestJSON-895312450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:32 devstack sudo[89346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9
Apr 15 20:12:32 devstack sudo[89346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:33 devstack sudo[89341]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:33 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf.78e01ba4-3f20-40fc-9c3a-d77c5dc4fb2b" returned: 0 in 0.606s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:33 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf.78e01ba4-3f20-40fc-9c3a-d77c5dc4fb2b {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:33 devstack sudo[89357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf.78e01ba4-3f20-40fc-9c3a-d77c5dc4fb2b
Apr 15 20:12:33 devstack sudo[89357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:33 devstack sudo[89346]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:33 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-adb7f475-5f55-4f6f-932f-f2215d376db7 tempest-VolumesSnapshotTestJSON-895312450 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9" returned: 0 in 0.611s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:33 devstack cinder-volume[82646]: DEBUG cinder.utils [None req-adb7f475-5f55-4f6f-932f-f2215d376db7 tempest-VolumesSnapshotTestJSON-895312450 None] Path /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-76886b8c-7920-4c61-8aaf-9a331937ff1b not found in is_blk_device check {{(pid=82646) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 15 20:12:33 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-adb7f475-5f55-4f6f-932f-f2215d376db7 tempest-VolumesSnapshotTestJSON-895312450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-76886b8c-7920-4c61-8aaf-9a331937ff1b {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:33 devstack sudo[89362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-76886b8c-7920-4c61-8aaf-9a331937ff1b
Apr 15 20:12:33 devstack sudo[89362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:33 devstack sudo[89357]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:33 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf.78e01ba4-3f20-40fc-9c3a-d77c5dc4fb2b" returned: 0 in 0.530s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:33 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf.a0855b94-c7d3-442b-accb-aa7fad68ff9b -F qcow2 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:33 devstack sudo[89366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf.a0855b94-c7d3-442b-accb-aa7fad68ff9b -F qcow2
Apr 15 20:12:33 devstack sudo[89366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:34 devstack sudo[89366]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:34 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf.a0855b94-c7d3-442b-accb-aa7fad68ff9b -F qcow2" returned: 0 in 0.747s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:34 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] Lock "cinder-quobyte-78e01ba4-3f20-40fc-9c3a-d77c5dc4fb2b" released by "_delete_snapshot" :: held 5.001s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:12:34 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] Lock "cinder-quobyte-90e72c65-f4f8-4869-bc50-7e6eb499d3cf" released by "delete_snapshot" :: held 5.018s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:12:34 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] Created reservations ['b42e0b47-ac8a-4169-9587-488460be798d', 'dc93d5bb-b240-4588-97dd-a25673c6951d', 'c5e73c7d-b79a-456a-936b-803fdcbf7da5', 'cb888d78-3727-4f64-8f25-e7fe1eb7ae72'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:12:35 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] Delete snapshot completed successfully.
Apr 15 20:12:35 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] Lock "cinder-78e01ba4-3f20-40fc-9c3a-d77c5dc4fb2b-delete_snapshot" released by "delete_snapshot" :: held 5.480s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:12:35 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] Acquiring lock "cinder-a0855b94-c7d3-442b-accb-aa7fad68ff9b-delete_snapshot" by "delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:12:35 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] Lock "cinder-a0855b94-c7d3-442b-accb-aa7fad68ff9b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:12:35 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] Acquiring lock "cinder-quobyte-90e72c65-f4f8-4869-bc50-7e6eb499d3cf" by "delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:12:35 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] Lock "cinder-quobyte-90e72c65-f4f8-4869-bc50-7e6eb499d3cf" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:12:35 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] Acquiring lock "cinder-quobyte-a0855b94-c7d3-442b-accb-aa7fad68ff9b" by "_delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:12:35 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] Lock "cinder-quobyte-a0855b94-c7d3-442b-accb-aa7fad68ff9b" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:12:35 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] Deleting offline snapshot a0855b94-c7d3-442b-accb-aa7fad68ff9b of volume 90e72c65-f4f8-4869-bc50-7e6eb499d3cf {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 20:12:35 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] snapshot_file for this snap is: volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf.a0855b94-c7d3-442b-accb-aa7fad68ff9b {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 20:12:35 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c2f492-63ab-41bf-9a60-40c56f701446]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:12:35 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf.a0855b94-c7d3-442b-accb-aa7fad68ff9b {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:35 devstack sudo[89385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf.a0855b94-c7d3-442b-accb-aa7fad68ff9b
Apr 15 20:12:35 devstack sudo[89385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:36 devstack sudo[89362]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:36 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-adb7f475-5f55-4f6f-932f-f2215d376db7 tempest-VolumesSnapshotTestJSON-895312450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-76886b8c-7920-4c61-8aaf-9a331937ff1b" returned: 0 in 2.621s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:36 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f5748f-f8e7-4f3b-895b-3d3ac0b38daf]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:12:36 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-adb7f475-5f55-4f6f-932f-f2215d376db7 tempest-VolumesSnapshotTestJSON-895312450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:36 devstack sudo[89388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9
Apr 15 20:12:36 devstack sudo[89388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:36 devstack sudo[89385]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:36 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf.a0855b94-c7d3-442b-accb-aa7fad68ff9b" returned: 0 in 1.229s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:36 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82646) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 20:12:36 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[4302f80b-cdff-46cf-a774-99418a82a2ba]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:12:36 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:36 devstack sudo[89394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf
Apr 15 20:12:36 devstack sudo[89394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:36 devstack sudo[89388]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:36 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-adb7f475-5f55-4f6f-932f-f2215d376db7 tempest-VolumesSnapshotTestJSON-895312450 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9" returned: 0 in 0.686s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:36 devstack cinder-volume[82646]: DEBUG cinder.image.image_utils [None req-adb7f475-5f55-4f6f-932f-f2215d376db7 tempest-VolumesSnapshotTestJSON-895312450 None] Image conversion details: src /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9, size 1024.00 MB, duration 2.62 sec, destination /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-76886b8c-7920-4c61-8aaf-9a331937ff1b {{(pid=82646) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 20:12:36 devstack cinder-volume[82646]: INFO cinder.image.image_utils [None req-adb7f475-5f55-4f6f-932f-f2215d376db7 tempest-VolumesSnapshotTestJSON-895312450 None] Converted 1024.00 MB image at 390.48 MB/s
Apr 15 20:12:36 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-adb7f475-5f55-4f6f-932f-f2215d376db7 tempest-VolumesSnapshotTestJSON-895312450 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-76886b8c-7920-4c61-8aaf-9a331937ff1b is being set with open permissions: ugo+rw
Apr 15 20:12:36 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-adb7f475-5f55-4f6f-932f-f2215d376db7 tempest-VolumesSnapshotTestJSON-895312450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-76886b8c-7920-4c61-8aaf-9a331937ff1b {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:36 devstack sudo[89399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-76886b8c-7920-4c61-8aaf-9a331937ff1b
Apr 15 20:12:36 devstack sudo[89399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:36 devstack sudo[89394]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:36 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf" returned: 0 in 0.572s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:36 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf.a0855b94-c7d3-442b-accb-aa7fad68ff9b {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:36 devstack sudo[89404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf.a0855b94-c7d3-442b-accb-aa7fad68ff9b
Apr 15 20:12:36 devstack sudo[89404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:37 devstack sudo[89399]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:37 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-adb7f475-5f55-4f6f-932f-f2215d376db7 tempest-VolumesSnapshotTestJSON-895312450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-76886b8c-7920-4c61-8aaf-9a331937ff1b" returned: 0 in 0.487s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:37 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-adb7f475-5f55-4f6f-932f-f2215d376db7 tempest-VolumesSnapshotTestJSON-895312450 None] Lock "cinder-quobyte-76886b8c-7920-4c61-8aaf-9a331937ff1b" released by "_copy_volume_from_snapshot" :: held 5.104s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:12:37 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-adb7f475-5f55-4f6f-932f-f2215d376db7 tempest-VolumesSnapshotTestJSON-895312450 None] Lock "cinder-quobyte-733e2f26-a422-4dbb-839f-95d80d43c302-76886b8c-7920-4c61-8aaf-9a331937ff1b" released by "_create_volume_from_snapshot" :: held 5.123s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:12:37 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-adb7f475-5f55-4f6f-932f-f2215d376db7 tempest-VolumesSnapshotTestJSON-895312450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.132s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:12:37 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-adb7f475-5f55-4f6f-932f-f2215d376db7 tempest-VolumesSnapshotTestJSON-895312450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10ca94c6-168d-427d-a4bc-252da15ae63f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76886b8c-7920-4c61-8aaf-9a331937ff1b', 'volume_size': 1, 'snapshot_id': '733e2f26-a422-4dbb-839f-95d80d43c302'}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:12:37 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-adb7f475-5f55-4f6f-932f-f2215d376db7 tempest-VolumesSnapshotTestJSON-895312450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5de5b59-9870-410e-b4bd-c415ef208392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:12:37 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-adb7f475-5f55-4f6f-932f-f2215d376db7 tempest-VolumesSnapshotTestJSON-895312450 None] Volume volume-76886b8c-7920-4c61-8aaf-9a331937ff1b (76886b8c-7920-4c61-8aaf-9a331937ff1b): created successfully
Apr 15 20:12:37 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-adb7f475-5f55-4f6f-932f-f2215d376db7 tempest-VolumesSnapshotTestJSON-895312450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5de5b59-9870-410e-b4bd-c415ef208392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:12:37 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-adb7f475-5f55-4f6f-932f-f2215d376db7 tempest-VolumesSnapshotTestJSON-895312450 None] Flow 'volume_create_manager' (6c555a76-aee8-4229-a7b4-2142786b138d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:12:37 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-adb7f475-5f55-4f6f-932f-f2215d376db7 tempest-VolumesSnapshotTestJSON-895312450 None] Created volume successfully.
Apr 15 20:12:37 devstack sudo[89404]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:37 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf.a0855b94-c7d3-442b-accb-aa7fad68ff9b" returned: 0 in 0.549s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:37 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf.a0855b94-c7d3-442b-accb-aa7fad68ff9b {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:37 devstack sudo[89410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf.a0855b94-c7d3-442b-accb-aa7fad68ff9b
Apr 15 20:12:37 devstack sudo[89410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:37 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-f2590c01-3cbb-47f4-8c6b-210058d179c0 tempest-VolumesSnapshotTestJSON-895312450 None] Acquiring lock "cinder-76886b8c-7920-4c61-8aaf-9a331937ff1b-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:12:37 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-f2590c01-3cbb-47f4-8c6b-210058d179c0 tempest-VolumesSnapshotTestJSON-895312450 None] Lock "cinder-76886b8c-7920-4c61-8aaf-9a331937ff1b-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:12:37 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-f2590c01-3cbb-47f4-8c6b-210058d179c0 tempest-VolumesSnapshotTestJSON-895312450 None] Acquiring lock "cinder-quobyte-76886b8c-7920-4c61-8aaf-9a331937ff1b" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:12:37 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-f2590c01-3cbb-47f4-8c6b-210058d179c0 tempest-VolumesSnapshotTestJSON-895312450 None] Lock "cinder-quobyte-76886b8c-7920-4c61-8aaf-9a331937ff1b" acquired by "delete_volume" :: waited 0.012s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:12:37 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[4532a16b-7d7c-410d-a182-c527260ee56e]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:12:37 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-f2590c01-3cbb-47f4-8c6b-210058d179c0 tempest-VolumesSnapshotTestJSON-895312450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-76886b8c-7920-4c61-8aaf-9a331937ff1b {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:37 devstack sudo[89412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-76886b8c-7920-4c61-8aaf-9a331937ff1b
Apr 15 20:12:37 devstack sudo[89412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:38 devstack sudo[89410]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:38 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf.a0855b94-c7d3-442b-accb-aa7fad68ff9b" returned: 0 in 0.547s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:38 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] Lock "cinder-quobyte-a0855b94-c7d3-442b-accb-aa7fad68ff9b" released by "_delete_snapshot" :: held 2.970s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:12:38 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] Lock "cinder-quobyte-90e72c65-f4f8-4869-bc50-7e6eb499d3cf" released by "delete_snapshot" :: held 2.988s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:12:38 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] Created reservations ['9c597f7c-cf20-4350-83a9-b568d2ab6cf6', '97c336db-3354-4750-a889-14a522a3c056', '8b413b56-3976-495c-a26f-61f343ad477b', '1c7b35d9-7f7e-4ff3-bdc1-f59e69c32183'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:12:38 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] Delete snapshot completed successfully.
Apr 15 20:12:38 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] Lock "cinder-a0855b94-c7d3-442b-accb-aa7fad68ff9b-delete_snapshot" released by "delete_snapshot" :: held 3.246s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:12:38 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] Snapshots deleted, issuing volume delete {{(pid=82646) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 15 20:12:38 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] Acquiring lock "cinder-quobyte-90e72c65-f4f8-4869-bc50-7e6eb499d3cf" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:12:38 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] Lock "cinder-quobyte-90e72c65-f4f8-4869-bc50-7e6eb499d3cf" acquired by "delete_volume" :: waited 0.010s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:12:38 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d804b51-e638-44af-b1df-9da726734986]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:12:38 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:38 devstack sudo[89412]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:38 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-f2590c01-3cbb-47f4-8c6b-210058d179c0 tempest-VolumesSnapshotTestJSON-895312450 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-76886b8c-7920-4c61-8aaf-9a331937ff1b" returned: 0 in 0.574s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:38 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-f2590c01-3cbb-47f4-8c6b-210058d179c0 tempest-VolumesSnapshotTestJSON-895312450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-76886b8c-7920-4c61-8aaf-9a331937ff1b {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:38 devstack sudo[89420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-76886b8c-7920-4c61-8aaf-9a331937ff1b
Apr 15 20:12:38 devstack sudo[89420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:38 devstack sudo[89419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf
Apr 15 20:12:38 devstack sudo[89419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:38 devstack sudo[89420]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:38 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-f2590c01-3cbb-47f4-8c6b-210058d179c0 tempest-VolumesSnapshotTestJSON-895312450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-76886b8c-7920-4c61-8aaf-9a331937ff1b" returned: 0 in 0.454s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:38 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-f2590c01-3cbb-47f4-8c6b-210058d179c0 tempest-VolumesSnapshotTestJSON-895312450 None] Lock "cinder-quobyte-76886b8c-7920-4c61-8aaf-9a331937ff1b" released by "delete_volume" :: held 1.056s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:12:38 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-f2590c01-3cbb-47f4-8c6b-210058d179c0 tempest-VolumesSnapshotTestJSON-895312450 None] Created reservations ['847c087e-919d-4d6a-92ee-b2835970a31a', 'a197bd1f-0f93-4df4-9cf6-c39f5f1a409a', '5199ec28-5160-4356-9c76-5d6cf764ed7e', '5103893b-13ba-403b-a638-96e02a97aabf'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:12:38 devstack sudo[89419]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:38 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf" returned: 0 in 0.586s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:38 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:38 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-f2590c01-3cbb-47f4-8c6b-210058d179c0 tempest-VolumesSnapshotTestJSON-895312450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:12:38 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-f2590c01-3cbb-47f4-8c6b-210058d179c0 tempest-VolumesSnapshotTestJSON-895312450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:12:38 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-f2590c01-3cbb-47f4-8c6b-210058d179c0 tempest-VolumesSnapshotTestJSON-895312450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:12:38 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-f2590c01-3cbb-47f4-8c6b-210058d179c0 tempest-VolumesSnapshotTestJSON-895312450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:12:38 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-f2590c01-3cbb-47f4-8c6b-210058d179c0 tempest-VolumesSnapshotTestJSON-895312450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:12:38 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-f2590c01-3cbb-47f4-8c6b-210058d179c0 tempest-VolumesSnapshotTestJSON-895312450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:38 devstack sudo[89427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf
Apr 15 20:12:38 devstack sudo[89427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:38 devstack sudo[89429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:12:38 devstack sudo[89429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:39 devstack sudo[89427]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:39 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-90e72c65-f4f8-4869-bc50-7e6eb499d3cf" returned: 0 in 0.486s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:39 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] Lock "cinder-quobyte-90e72c65-f4f8-4869-bc50-7e6eb499d3cf" released by "delete_volume" :: held 1.108s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:12:39 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] Created reservations ['5ec42d1e-7365-4c1a-af34-ec62d901dc4c', '078b6795-18d8-4b68-8782-01bf72e75aeb', '3de87cc1-eff5-436a-916b-07ffe7a2d301', '3b8bd4da-dde0-444a-ae4f-5db2dad8777f'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:12:39 devstack sudo[89429]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:39 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-f2590c01-3cbb-47f4-8c6b-210058d179c0 tempest-VolumesSnapshotTestJSON-895312450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.530s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:39 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-f2590c01-3cbb-47f4-8c6b-210058d179c0 tempest-VolumesSnapshotTestJSON-895312450 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:12:39 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-f2590c01-3cbb-47f4-8c6b-210058d179c0 tempest-VolumesSnapshotTestJSON-895312450 None] Deleted volume successfully.
Apr 15 20:12:39 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-f2590c01-3cbb-47f4-8c6b-210058d179c0 tempest-VolumesSnapshotTestJSON-895312450 None] Lock "cinder-76886b8c-7920-4c61-8aaf-9a331937ff1b-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:12:39 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:12:39 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:12:39 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:12:39 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:12:39 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:12:39 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:39 devstack sudo[89433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:12:39 devstack sudo[89433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:39 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-82dd6d5e-e21c-497e-8868-77839f2634a5 tempest-VolumesSnapshotTestJSON-895312450 None] Acquiring lock "cinder-733e2f26-a422-4dbb-839f-95d80d43c302-delete_snapshot" by "delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:12:39 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-82dd6d5e-e21c-497e-8868-77839f2634a5 tempest-VolumesSnapshotTestJSON-895312450 None] Lock "cinder-733e2f26-a422-4dbb-839f-95d80d43c302-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:12:39 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-82dd6d5e-e21c-497e-8868-77839f2634a5 tempest-VolumesSnapshotTestJSON-895312450 None] Acquiring lock "cinder-quobyte-f93c5be4-d9c7-48b9-98f4-478b48926ed9" by "delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:12:39 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-82dd6d5e-e21c-497e-8868-77839f2634a5 tempest-VolumesSnapshotTestJSON-895312450 None] Lock "cinder-quobyte-f93c5be4-d9c7-48b9-98f4-478b48926ed9" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:12:39 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-82dd6d5e-e21c-497e-8868-77839f2634a5 tempest-VolumesSnapshotTestJSON-895312450 None] Acquiring lock "cinder-quobyte-733e2f26-a422-4dbb-839f-95d80d43c302" by "_delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:12:39 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-82dd6d5e-e21c-497e-8868-77839f2634a5 tempest-VolumesSnapshotTestJSON-895312450 None] Lock "cinder-quobyte-733e2f26-a422-4dbb-839f-95d80d43c302" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:12:39 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-82dd6d5e-e21c-497e-8868-77839f2634a5 tempest-VolumesSnapshotTestJSON-895312450 None] Deleting offline snapshot 733e2f26-a422-4dbb-839f-95d80d43c302 of volume f93c5be4-d9c7-48b9-98f4-478b48926ed9 {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 20:12:39 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-82dd6d5e-e21c-497e-8868-77839f2634a5 tempest-VolumesSnapshotTestJSON-895312450 None] snapshot_file for this snap is: volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9.733e2f26-a422-4dbb-839f-95d80d43c302 {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 20:12:39 devstack sudo[89433]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:39 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.476s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:39 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:12:39 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac0ea540-0260-4c98-99e5-b6b061c0283e]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:12:39 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-82dd6d5e-e21c-497e-8868-77839f2634a5 tempest-VolumesSnapshotTestJSON-895312450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9.733e2f26-a422-4dbb-839f-95d80d43c302 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:39 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] Deleted volume successfully.
Apr 15 20:12:40 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-282ac349-3890-4d97-bda1-b847c54632de tempest-VolumesDeleteCascade-471708485 None] Lock "cinder-90e72c65-f4f8-4869-bc50-7e6eb499d3cf-delete_volume" released by "delete_volume" :: held 10.571s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:12:40 devstack sudo[89436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9.733e2f26-a422-4dbb-839f-95d80d43c302
Apr 15 20:12:40 devstack sudo[89436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:40 devstack sudo[89436]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:40 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-82dd6d5e-e21c-497e-8868-77839f2634a5 tempest-VolumesSnapshotTestJSON-895312450 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9.733e2f26-a422-4dbb-839f-95d80d43c302" returned: 0 in 0.496s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:40 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-82dd6d5e-e21c-497e-8868-77839f2634a5 tempest-VolumesSnapshotTestJSON-895312450 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82646) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 20:12:40 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[7911d04b-ea3b-4f0d-8885-46fe28aa762e]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:12:40 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-82dd6d5e-e21c-497e-8868-77839f2634a5 tempest-VolumesSnapshotTestJSON-895312450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:40 devstack sudo[89441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9
Apr 15 20:12:40 devstack sudo[89441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:40 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1402532-89b7-4934-bb1e-7c5118530e4f tempest-VolumesDeleteCascade-471708485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:12:40 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e1402532-89b7-4934-bb1e-7c5118530e4f tempest-VolumesDeleteCascade-471708485 None] Flow 'volume_create_manager' (aa4da470-631c-41b1-8db8-65ca93b7311e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:12:40 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e1402532-89b7-4934-bb1e-7c5118530e4f tempest-VolumesDeleteCascade-471708485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35fc164a-beab-4d4e-9e72-1eb87ecb0979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:12:40 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e1402532-89b7-4934-bb1e-7c5118530e4f tempest-VolumesDeleteCascade-471708485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35fc164a-beab-4d4e-9e72-1eb87ecb0979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:12:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1145414821',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0193dee1-edb3-4566-8cde-784bc37c100b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f919b8f096f94caea0384c696ad5fe05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:12:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:12:41Z,use_quota=True,user_id='25ff392f9e124c02be4e3f1e89015334',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:12:40 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e1402532-89b7-4934-bb1e-7c5118530e4f tempest-VolumesDeleteCascade-471708485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca9742ec-d31d-47c8-8e8b-8a78ac60606a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:12:40 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e1402532-89b7-4934-bb1e-7c5118530e4f tempest-VolumesDeleteCascade-471708485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca9742ec-d31d-47c8-8e8b-8a78ac60606a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:12:40 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e1402532-89b7-4934-bb1e-7c5118530e4f tempest-VolumesDeleteCascade-471708485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bf64cd2-a0d8-47e5-b20f-b7ae602c8fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:12:40 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e1402532-89b7-4934-bb1e-7c5118530e4f tempest-VolumesDeleteCascade-471708485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bf64cd2-a0d8-47e5-b20f-b7ae602c8fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0193dee1-edb3-4566-8cde-784bc37c100b', 'volume_name': 'volume-0193dee1-edb3-4566-8cde-784bc37c100b', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:12:40 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e1402532-89b7-4934-bb1e-7c5118530e4f tempest-VolumesDeleteCascade-471708485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62fb1872-a60a-4b8a-b521-2488b02f626f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:12:40 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e1402532-89b7-4934-bb1e-7c5118530e4f tempest-VolumesDeleteCascade-471708485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62fb1872-a60a-4b8a-b521-2488b02f626f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:12:40 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e1402532-89b7-4934-bb1e-7c5118530e4f tempest-VolumesDeleteCascade-471708485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a58e413-ac22-478e-82cc-72ffefa43506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:12:40 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-e1402532-89b7-4934-bb1e-7c5118530e4f tempest-VolumesDeleteCascade-471708485 None] Volume 0193dee1-edb3-4566-8cde-784bc37c100b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0193dee1-edb3-4566-8cde-784bc37c100b', 'volume_size': 1}
Apr 15 20:12:40 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-e1402532-89b7-4934-bb1e-7c5118530e4f tempest-VolumesDeleteCascade-471708485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:12:40 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-e1402532-89b7-4934-bb1e-7c5118530e4f tempest-VolumesDeleteCascade-471708485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:12:40 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-e1402532-89b7-4934-bb1e-7c5118530e4f tempest-VolumesDeleteCascade-471708485 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:12:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1145414821',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0193dee1-edb3-4566-8cde-784bc37c100b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f919b8f096f94caea0384c696ad5fe05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:12:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:12:41Z,use_quota=True,user_id='25ff392f9e124c02be4e3f1e89015334',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:12:40 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-e1402532-89b7-4934-bb1e-7c5118530e4f tempest-VolumesDeleteCascade-471708485 None] Creating volume 0193dee1-edb3-4566-8cde-784bc37c100b {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:12:40 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-e1402532-89b7-4934-bb1e-7c5118530e4f tempest-VolumesDeleteCascade-471708485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:12:40 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-e1402532-89b7-4934-bb1e-7c5118530e4f tempest-VolumesDeleteCascade-471708485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:12:40 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-e1402532-89b7-4934-bb1e-7c5118530e4f tempest-VolumesDeleteCascade-471708485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:12:40 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-e1402532-89b7-4934-bb1e-7c5118530e4f tempest-VolumesDeleteCascade-471708485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:12:40 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-e1402532-89b7-4934-bb1e-7c5118530e4f tempest-VolumesDeleteCascade-471708485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:12:40 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-e1402532-89b7-4934-bb1e-7c5118530e4f tempest-VolumesDeleteCascade-471708485 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:12:40 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-e1402532-89b7-4934-bb1e-7c5118530e4f tempest-VolumesDeleteCascade-471708485 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:12:40 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e1402532-89b7-4934-bb1e-7c5118530e4f tempest-VolumesDeleteCascade-471708485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0193dee1-edb3-4566-8cde-784bc37c100b 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:40 devstack sudo[89443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0193dee1-edb3-4566-8cde-784bc37c100b 1073741824
Apr 15 20:12:40 devstack sudo[89443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:40 devstack sudo[89441]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:40 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-82dd6d5e-e21c-497e-8868-77839f2634a5 tempest-VolumesSnapshotTestJSON-895312450 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9" returned: 0 in 0.485s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:40 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-82dd6d5e-e21c-497e-8868-77839f2634a5 tempest-VolumesSnapshotTestJSON-895312450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9.733e2f26-a422-4dbb-839f-95d80d43c302 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:40 devstack sudo[89448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9.733e2f26-a422-4dbb-839f-95d80d43c302
Apr 15 20:12:41 devstack sudo[89448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:41 devstack sudo[89443]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:41 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e1402532-89b7-4934-bb1e-7c5118530e4f tempest-VolumesDeleteCascade-471708485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0193dee1-edb3-4566-8cde-784bc37c100b 1073741824" returned: 0 in 0.538s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:41 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e1402532-89b7-4934-bb1e-7c5118530e4f tempest-VolumesDeleteCascade-471708485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0193dee1-edb3-4566-8cde-784bc37c100b {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:41 devstack sudo[89453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0193dee1-edb3-4566-8cde-784bc37c100b
Apr 15 20:12:41 devstack sudo[89453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:41 devstack sudo[89448]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:41 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-82dd6d5e-e21c-497e-8868-77839f2634a5 tempest-VolumesSnapshotTestJSON-895312450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9.733e2f26-a422-4dbb-839f-95d80d43c302" returned: 0 in 0.492s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:41 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-82dd6d5e-e21c-497e-8868-77839f2634a5 tempest-VolumesSnapshotTestJSON-895312450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9.733e2f26-a422-4dbb-839f-95d80d43c302 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:41 devstack sudo[89458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9.733e2f26-a422-4dbb-839f-95d80d43c302
Apr 15 20:12:41 devstack sudo[89458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:41 devstack sudo[89453]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:41 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e1402532-89b7-4934-bb1e-7c5118530e4f tempest-VolumesDeleteCascade-471708485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0193dee1-edb3-4566-8cde-784bc37c100b" returned: 0 in 0.471s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:41 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-e1402532-89b7-4934-bb1e-7c5118530e4f tempest-VolumesDeleteCascade-471708485 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:12:41 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-e1402532-89b7-4934-bb1e-7c5118530e4f tempest-VolumesDeleteCascade-471708485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:12:41 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e1402532-89b7-4934-bb1e-7c5118530e4f tempest-VolumesDeleteCascade-471708485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a58e413-ac22-478e-82cc-72ffefa43506) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0193dee1-edb3-4566-8cde-784bc37c100b', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:12:41 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e1402532-89b7-4934-bb1e-7c5118530e4f tempest-VolumesDeleteCascade-471708485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dac4d2d9-dc81-4eb5-8cab-8594b267d9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:12:41 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-e1402532-89b7-4934-bb1e-7c5118530e4f tempest-VolumesDeleteCascade-471708485 None] Volume volume-0193dee1-edb3-4566-8cde-784bc37c100b (0193dee1-edb3-4566-8cde-784bc37c100b): created successfully
Apr 15 20:12:41 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e1402532-89b7-4934-bb1e-7c5118530e4f tempest-VolumesDeleteCascade-471708485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dac4d2d9-dc81-4eb5-8cab-8594b267d9ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:12:41 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e1402532-89b7-4934-bb1e-7c5118530e4f tempest-VolumesDeleteCascade-471708485 None] Flow 'volume_create_manager' (aa4da470-631c-41b1-8db8-65ca93b7311e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:12:41 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-e1402532-89b7-4934-bb1e-7c5118530e4f tempest-VolumesDeleteCascade-471708485 None] Created volume successfully.
Apr 15 20:12:42 devstack sudo[89458]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:42 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-82dd6d5e-e21c-497e-8868-77839f2634a5 tempest-VolumesSnapshotTestJSON-895312450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9.733e2f26-a422-4dbb-839f-95d80d43c302" returned: 0 in 0.576s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:42 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-82dd6d5e-e21c-497e-8868-77839f2634a5 tempest-VolumesSnapshotTestJSON-895312450 None] Lock "cinder-quobyte-733e2f26-a422-4dbb-839f-95d80d43c302" released by "_delete_snapshot" :: held 2.111s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:12:42 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-82dd6d5e-e21c-497e-8868-77839f2634a5 tempest-VolumesSnapshotTestJSON-895312450 None] Lock "cinder-quobyte-f93c5be4-d9c7-48b9-98f4-478b48926ed9" released by "delete_snapshot" :: held 2.125s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:12:42 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-82dd6d5e-e21c-497e-8868-77839f2634a5 tempest-VolumesSnapshotTestJSON-895312450 None] Created reservations ['d0d1da96-03b8-476e-a491-6ba81e4e925c', 'd0bbe829-52f6-411c-9507-bb4652cedfed', 'e007234b-089f-4154-ba69-b23435b677f1', 'f915e913-ea53-4387-99ba-709e0da96fca'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:12:42 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-82dd6d5e-e21c-497e-8868-77839f2634a5 tempest-VolumesSnapshotTestJSON-895312450 None] Delete snapshot completed successfully.
Apr 15 20:12:42 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-82dd6d5e-e21c-497e-8868-77839f2634a5 tempest-VolumesSnapshotTestJSON-895312450 None] Lock "cinder-733e2f26-a422-4dbb-839f-95d80d43c302-delete_snapshot" released by "delete_snapshot" :: held 2.215s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:12:42 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-5e414cfa-61d4-41e0-bdb3-5d5bb011b2bb tempest-VolumesDeleteCascade-471708485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:12:42 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-5e414cfa-61d4-41e0-bdb3-5d5bb011b2bb tempest-VolumesDeleteCascade-471708485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:12:42 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-5e414cfa-61d4-41e0-bdb3-5d5bb011b2bb tempest-VolumesDeleteCascade-471708485 None] Creating offline snapshot a5378a22-33d8-4eb0-9e67-2921eb1cabdf of volume 0193dee1-edb3-4566-8cde-784bc37c100b {{(pid=82646) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 20:12:42 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[28901571-2d23-4a40-883d-83e43addb81b]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:12:42 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5e414cfa-61d4-41e0-bdb3-5d5bb011b2bb tempest-VolumesDeleteCascade-471708485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0193dee1-edb3-4566-8cde-784bc37c100b {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:42 devstack sudo[89462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0193dee1-edb3-4566-8cde-784bc37c100b
Apr 15 20:12:42 devstack sudo[89462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:43 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-d265005d-09f9-411e-a20a-af7ae71e8bf8 tempest-VolumesSnapshotTestJSON-895312450 None] Acquiring lock "cinder-f93c5be4-d9c7-48b9-98f4-478b48926ed9-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:12:43 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-d265005d-09f9-411e-a20a-af7ae71e8bf8 tempest-VolumesSnapshotTestJSON-895312450 None] Lock "cinder-f93c5be4-d9c7-48b9-98f4-478b48926ed9-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:12:43 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-d265005d-09f9-411e-a20a-af7ae71e8bf8 tempest-VolumesSnapshotTestJSON-895312450 None] Acquiring lock "cinder-quobyte-f93c5be4-d9c7-48b9-98f4-478b48926ed9" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:12:43 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-d265005d-09f9-411e-a20a-af7ae71e8bf8 tempest-VolumesSnapshotTestJSON-895312450 None] Lock "cinder-quobyte-f93c5be4-d9c7-48b9-98f4-478b48926ed9" acquired by "delete_volume" :: waited 0.009s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:12:43 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a01a4a6-e306-4cbb-9c0a-01a9f7e7445c]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:12:43 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d265005d-09f9-411e-a20a-af7ae71e8bf8 tempest-VolumesSnapshotTestJSON-895312450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:43 devstack sudo[89464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9
Apr 15 20:12:43 devstack sudo[89464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:43 devstack sudo[89462]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:43 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5e414cfa-61d4-41e0-bdb3-5d5bb011b2bb tempest-VolumesDeleteCascade-471708485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0193dee1-edb3-4566-8cde-784bc37c100b" returned: 0 in 0.510s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:43 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5e414cfa-61d4-41e0-bdb3-5d5bb011b2bb tempest-VolumesDeleteCascade-471708485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0193dee1-edb3-4566-8cde-784bc37c100b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0193dee1-edb3-4566-8cde-784bc37c100b.a5378a22-33d8-4eb0-9e67-2921eb1cabdf 1G {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:43 devstack sudo[89469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0193dee1-edb3-4566-8cde-784bc37c100b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0193dee1-edb3-4566-8cde-784bc37c100b.a5378a22-33d8-4eb0-9e67-2921eb1cabdf 1G
Apr 15 20:12:43 devstack sudo[89469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:43 devstack sudo[89464]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:43 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d265005d-09f9-411e-a20a-af7ae71e8bf8 tempest-VolumesSnapshotTestJSON-895312450 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9" returned: 0 in 0.530s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:43 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d265005d-09f9-411e-a20a-af7ae71e8bf8 tempest-VolumesSnapshotTestJSON-895312450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:43 devstack sudo[89475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9
Apr 15 20:12:43 devstack sudo[89475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:43 devstack sudo[89469]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:43 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5e414cfa-61d4-41e0-bdb3-5d5bb011b2bb tempest-VolumesDeleteCascade-471708485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0193dee1-edb3-4566-8cde-784bc37c100b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0193dee1-edb3-4566-8cde-784bc37c100b.a5378a22-33d8-4eb0-9e67-2921eb1cabdf 1G" returned: 0 in 0.523s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:43 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5e414cfa-61d4-41e0-bdb3-5d5bb011b2bb tempest-VolumesDeleteCascade-471708485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0193dee1-edb3-4566-8cde-784bc37c100b -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0193dee1-edb3-4566-8cde-784bc37c100b.a5378a22-33d8-4eb0-9e67-2921eb1cabdf {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:43 devstack sudo[89480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0193dee1-edb3-4566-8cde-784bc37c100b -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0193dee1-edb3-4566-8cde-784bc37c100b.a5378a22-33d8-4eb0-9e67-2921eb1cabdf
Apr 15 20:12:43 devstack sudo[89480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:44 devstack sudo[89475]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:44 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d265005d-09f9-411e-a20a-af7ae71e8bf8 tempest-VolumesSnapshotTestJSON-895312450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f93c5be4-d9c7-48b9-98f4-478b48926ed9" returned: 0 in 0.516s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:44 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-d265005d-09f9-411e-a20a-af7ae71e8bf8 tempest-VolumesSnapshotTestJSON-895312450 None] Lock "cinder-quobyte-f93c5be4-d9c7-48b9-98f4-478b48926ed9" released by "delete_volume" :: held 1.083s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:12:44 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-d265005d-09f9-411e-a20a-af7ae71e8bf8 tempest-VolumesSnapshotTestJSON-895312450 None] Created reservations ['f669c830-c52f-44bb-8024-b4b949bf0711', '490583f1-948f-4a89-aacb-b03677176e68', '64c867d7-6d6f-403a-b37e-7c80fd2808e6', 'd9f5a628-d02b-4d9c-82cc-c04f95bd4a44'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:12:44 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-d265005d-09f9-411e-a20a-af7ae71e8bf8 tempest-VolumesSnapshotTestJSON-895312450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:12:44 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-d265005d-09f9-411e-a20a-af7ae71e8bf8 tempest-VolumesSnapshotTestJSON-895312450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:12:44 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-d265005d-09f9-411e-a20a-af7ae71e8bf8 tempest-VolumesSnapshotTestJSON-895312450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:12:44 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-d265005d-09f9-411e-a20a-af7ae71e8bf8 tempest-VolumesSnapshotTestJSON-895312450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:12:44 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-d265005d-09f9-411e-a20a-af7ae71e8bf8 tempest-VolumesSnapshotTestJSON-895312450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:12:44 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d265005d-09f9-411e-a20a-af7ae71e8bf8 tempest-VolumesSnapshotTestJSON-895312450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:44 devstack sudo[89520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:12:44 devstack sudo[89520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:44 devstack sudo[89480]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:44 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5e414cfa-61d4-41e0-bdb3-5d5bb011b2bb tempest-VolumesDeleteCascade-471708485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0193dee1-edb3-4566-8cde-784bc37c100b -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0193dee1-edb3-4566-8cde-784bc37c100b.a5378a22-33d8-4eb0-9e67-2921eb1cabdf" returned: 0 in 0.470s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:44 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-5e414cfa-61d4-41e0-bdb3-5d5bb011b2bb tempest-VolumesDeleteCascade-471708485 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0193dee1-edb3-4566-8cde-784bc37c100b.a5378a22-33d8-4eb0-9e67-2921eb1cabdf is being set with open permissions: ugo+rw
Apr 15 20:12:44 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5e414cfa-61d4-41e0-bdb3-5d5bb011b2bb tempest-VolumesDeleteCascade-471708485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0193dee1-edb3-4566-8cde-784bc37c100b.a5378a22-33d8-4eb0-9e67-2921eb1cabdf {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:44 devstack sudo[89522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0193dee1-edb3-4566-8cde-784bc37c100b.a5378a22-33d8-4eb0-9e67-2921eb1cabdf
Apr 15 20:12:44 devstack sudo[89522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:44 devstack sudo[89520]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:44 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d265005d-09f9-411e-a20a-af7ae71e8bf8 tempest-VolumesSnapshotTestJSON-895312450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.420s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:44 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-d265005d-09f9-411e-a20a-af7ae71e8bf8 tempest-VolumesSnapshotTestJSON-895312450 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:12:44 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-d265005d-09f9-411e-a20a-af7ae71e8bf8 tempest-VolumesSnapshotTestJSON-895312450 None] Deleted volume successfully.
Apr 15 20:12:44 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-d265005d-09f9-411e-a20a-af7ae71e8bf8 tempest-VolumesSnapshotTestJSON-895312450 None] Lock "cinder-f93c5be4-d9c7-48b9-98f4-478b48926ed9-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:12:44 devstack sudo[89522]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:44 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5e414cfa-61d4-41e0-bdb3-5d5bb011b2bb tempest-VolumesDeleteCascade-471708485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0193dee1-edb3-4566-8cde-784bc37c100b.a5378a22-33d8-4eb0-9e67-2921eb1cabdf" returned: 0 in 0.469s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:44 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5e414cfa-61d4-41e0-bdb3-5d5bb011b2bb tempest-VolumesDeleteCascade-471708485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0193dee1-edb3-4566-8cde-784bc37c100b.info {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:44 devstack sudo[89526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0193dee1-edb3-4566-8cde-784bc37c100b.info
Apr 15 20:12:44 devstack sudo[89526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:45 devstack sudo[89526]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:45 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5e414cfa-61d4-41e0-bdb3-5d5bb011b2bb tempest-VolumesDeleteCascade-471708485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0193dee1-edb3-4566-8cde-784bc37c100b.info" returned: 0 in 0.415s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:45 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-5e414cfa-61d4-41e0-bdb3-5d5bb011b2bb tempest-VolumesDeleteCascade-471708485 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0193dee1-edb3-4566-8cde-784bc37c100b.info is being set with open permissions: ugo+rw
Apr 15 20:12:45 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5e414cfa-61d4-41e0-bdb3-5d5bb011b2bb tempest-VolumesDeleteCascade-471708485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0193dee1-edb3-4566-8cde-784bc37c100b.info {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:45 devstack sudo[89529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0193dee1-edb3-4566-8cde-784bc37c100b.info
Apr 15 20:12:45 devstack sudo[89529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:45 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-c89f8be2-0f6d-4f8f-a391-1ca48441c6b2 tempest-VolumesSnapshotTestJSON-895312450 None] Acquiring lock "cinder-305fd023-9eca-42d8-a381-0877d56ee1dc-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:12:45 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-c89f8be2-0f6d-4f8f-a391-1ca48441c6b2 tempest-VolumesSnapshotTestJSON-895312450 None] Lock "cinder-305fd023-9eca-42d8-a381-0877d56ee1dc-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:12:45 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-c89f8be2-0f6d-4f8f-a391-1ca48441c6b2 tempest-VolumesSnapshotTestJSON-895312450 None] Acquiring lock "cinder-quobyte-305fd023-9eca-42d8-a381-0877d56ee1dc" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:12:45 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-c89f8be2-0f6d-4f8f-a391-1ca48441c6b2 tempest-VolumesSnapshotTestJSON-895312450 None] Lock "cinder-quobyte-305fd023-9eca-42d8-a381-0877d56ee1dc" acquired by "delete_volume" :: waited 0.007s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:12:45 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7755d8-5eb9-4a91-aadd-9521880e2862]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:12:45 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c89f8be2-0f6d-4f8f-a391-1ca48441c6b2 tempest-VolumesSnapshotTestJSON-895312450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-305fd023-9eca-42d8-a381-0877d56ee1dc {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:45 devstack sudo[89531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-305fd023-9eca-42d8-a381-0877d56ee1dc
Apr 15 20:12:45 devstack sudo[89531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:45 devstack sudo[89529]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:45 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5e414cfa-61d4-41e0-bdb3-5d5bb011b2bb tempest-VolumesDeleteCascade-471708485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0193dee1-edb3-4566-8cde-784bc37c100b.info" returned: 0 in 0.454s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:45 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-5e414cfa-61d4-41e0-bdb3-5d5bb011b2bb tempest-VolumesDeleteCascade-471708485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.904s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:12:45 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-5e414cfa-61d4-41e0-bdb3-5d5bb011b2bb tempest-VolumesDeleteCascade-471708485 None] Create snapshot completed successfully
Apr 15 20:12:45 devstack sudo[89531]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:45 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c89f8be2-0f6d-4f8f-a391-1ca48441c6b2 tempest-VolumesSnapshotTestJSON-895312450 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-305fd023-9eca-42d8-a381-0877d56ee1dc" returned: 0 in 0.471s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:45 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c89f8be2-0f6d-4f8f-a391-1ca48441c6b2 tempest-VolumesSnapshotTestJSON-895312450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-305fd023-9eca-42d8-a381-0877d56ee1dc {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:45 devstack sudo[89537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-305fd023-9eca-42d8-a381-0877d56ee1dc
Apr 15 20:12:45 devstack sudo[89537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:46 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa25af9a-5f58-4ab8-8f43-9b51a809cd39 tempest-VolumesDeleteCascade-471708485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:12:46 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-aa25af9a-5f58-4ab8-8f43-9b51a809cd39 tempest-VolumesDeleteCascade-471708485 None] Flow 'volume_create_manager' (85c81d3e-f362-4949-b8f2-cccd5e430e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:12:46 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-aa25af9a-5f58-4ab8-8f43-9b51a809cd39 tempest-VolumesDeleteCascade-471708485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccc12238-d5eb-4abe-9210-a344d59400e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:12:46 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-aa25af9a-5f58-4ab8-8f43-9b51a809cd39 tempest-VolumesDeleteCascade-471708485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccc12238-d5eb-4abe-9210-a344d59400e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-278702828',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a67c696-f0d5-49ff-a604-9be3b30920e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f919b8f096f94caea0384c696ad5fe05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a5378a22-33d8-4eb0-9e67-2921eb1cabdf,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:12:46Z,use_quota=True,user_id='25ff392f9e124c02be4e3f1e89015334',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:12:46 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-aa25af9a-5f58-4ab8-8f43-9b51a809cd39 tempest-VolumesDeleteCascade-471708485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6652f490-ed53-4297-b2f3-171f65e7f7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:12:46 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-aa25af9a-5f58-4ab8-8f43-9b51a809cd39 tempest-VolumesDeleteCascade-471708485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6652f490-ed53-4297-b2f3-171f65e7f7ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:12:46 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-aa25af9a-5f58-4ab8-8f43-9b51a809cd39 tempest-VolumesDeleteCascade-471708485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7607bd7-e491-41d7-974f-885ff160a5b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:12:46 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-aa25af9a-5f58-4ab8-8f43-9b51a809cd39 tempest-VolumesDeleteCascade-471708485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7607bd7-e491-41d7-974f-885ff160a5b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6a67c696-f0d5-49ff-a604-9be3b30920e0', 'volume_name': 'volume-6a67c696-f0d5-49ff-a604-9be3b30920e0', 'volume_size': 1, 'snapshot_id': 'a5378a22-33d8-4eb0-9e67-2921eb1cabdf'}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:12:46 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-aa25af9a-5f58-4ab8-8f43-9b51a809cd39 tempest-VolumesDeleteCascade-471708485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f317af7a-2d82-4c61-8609-8698edcb9f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:12:46 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-aa25af9a-5f58-4ab8-8f43-9b51a809cd39 tempest-VolumesDeleteCascade-471708485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f317af7a-2d82-4c61-8609-8698edcb9f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:12:46 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-aa25af9a-5f58-4ab8-8f43-9b51a809cd39 tempest-VolumesDeleteCascade-471708485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bc965df-ff59-4863-b70a-cc4d09dea68c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:12:46 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-aa25af9a-5f58-4ab8-8f43-9b51a809cd39 tempest-VolumesDeleteCascade-471708485 None] Volume 6a67c696-f0d5-49ff-a604-9be3b30920e0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6a67c696-f0d5-49ff-a604-9be3b30920e0', 'volume_size': 1, 'snapshot_id': 'a5378a22-33d8-4eb0-9e67-2921eb1cabdf'}
Apr 15 20:12:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-aa25af9a-5f58-4ab8-8f43-9b51a809cd39 tempest-VolumesDeleteCascade-471708485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:12:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-aa25af9a-5f58-4ab8-8f43-9b51a809cd39 tempest-VolumesDeleteCascade-471708485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:12:46 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-aa25af9a-5f58-4ab8-8f43-9b51a809cd39 tempest-VolumesDeleteCascade-471708485 None] Acquiring lock "cinder-quobyte-a5378a22-33d8-4eb0-9e67-2921eb1cabdf-6a67c696-f0d5-49ff-a604-9be3b30920e0" by "_create_volume_from_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:12:46 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-aa25af9a-5f58-4ab8-8f43-9b51a809cd39 tempest-VolumesDeleteCascade-471708485 None] Lock "cinder-quobyte-a5378a22-33d8-4eb0-9e67-2921eb1cabdf-6a67c696-f0d5-49ff-a604-9be3b30920e0" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:12:46 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-aa25af9a-5f58-4ab8-8f43-9b51a809cd39 tempest-VolumesDeleteCascade-471708485 None] Creating volume 6a67c696-f0d5-49ff-a604-9be3b30920e0 from snapshot a5378a22-33d8-4eb0-9e67-2921eb1cabdf {{(pid=82646) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 15 20:12:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-aa25af9a-5f58-4ab8-8f43-9b51a809cd39 tempest-VolumesDeleteCascade-471708485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:12:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-aa25af9a-5f58-4ab8-8f43-9b51a809cd39 tempest-VolumesDeleteCascade-471708485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:12:46 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-aa25af9a-5f58-4ab8-8f43-9b51a809cd39 tempest-VolumesDeleteCascade-471708485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:12:46 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-aa25af9a-5f58-4ab8-8f43-9b51a809cd39 tempest-VolumesDeleteCascade-471708485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:12:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-aa25af9a-5f58-4ab8-8f43-9b51a809cd39 tempest-VolumesDeleteCascade-471708485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:12:46 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-aa25af9a-5f58-4ab8-8f43-9b51a809cd39 tempest-VolumesDeleteCascade-471708485 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:12:46 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-aa25af9a-5f58-4ab8-8f43-9b51a809cd39 tempest-VolumesDeleteCascade-471708485 None] Acquiring lock "cinder-quobyte-6a67c696-f0d5-49ff-a604-9be3b30920e0" by "_copy_volume_from_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:12:46 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-aa25af9a-5f58-4ab8-8f43-9b51a809cd39 tempest-VolumesDeleteCascade-471708485 None] Lock "cinder-quobyte-6a67c696-f0d5-49ff-a604-9be3b30920e0" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:12:46 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-aa25af9a-5f58-4ab8-8f43-9b51a809cd39 tempest-VolumesDeleteCascade-471708485 None] snapshot: a5378a22-33d8-4eb0-9e67-2921eb1cabdf, volume: 6a67c696-f0d5-49ff-a604-9be3b30920e0,  {{(pid=82646) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 15 20:12:46 devstack sudo[89537]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-aa25af9a-5f58-4ab8-8f43-9b51a809cd39 tempest-VolumesDeleteCascade-471708485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:12:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-aa25af9a-5f58-4ab8-8f43-9b51a809cd39 tempest-VolumesDeleteCascade-471708485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:12:46 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-aa25af9a-5f58-4ab8-8f43-9b51a809cd39 tempest-VolumesDeleteCascade-471708485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:12:46 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-aa25af9a-5f58-4ab8-8f43-9b51a809cd39 tempest-VolumesDeleteCascade-471708485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:12:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-aa25af9a-5f58-4ab8-8f43-9b51a809cd39 tempest-VolumesDeleteCascade-471708485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:12:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c89f8be2-0f6d-4f8f-a391-1ca48441c6b2 tempest-VolumesSnapshotTestJSON-895312450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-305fd023-9eca-42d8-a381-0877d56ee1dc" returned: 0 in 0.445s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:46 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa357c8e-b1bd-455f-b154-c8c332ac71f9]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:12:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-aa25af9a-5f58-4ab8-8f43-9b51a809cd39 tempest-VolumesDeleteCascade-471708485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0193dee1-edb3-4566-8cde-784bc37c100b.a5378a22-33d8-4eb0-9e67-2921eb1cabdf {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:46 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-c89f8be2-0f6d-4f8f-a391-1ca48441c6b2 tempest-VolumesSnapshotTestJSON-895312450 None] Lock "cinder-quobyte-305fd023-9eca-42d8-a381-0877d56ee1dc" released by "delete_volume" :: held 0.957s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:12:46 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-c89f8be2-0f6d-4f8f-a391-1ca48441c6b2 tempest-VolumesSnapshotTestJSON-895312450 None] Created reservations ['a16be8de-bc04-49b8-af9d-61836fab3824', '2b134efd-83cd-4484-95c8-8dca87c1c67b', '3280a545-e870-45cc-81bd-c7017e20e4f0', '456a666e-eada-4696-acf6-ab1abb578578'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:12:46 devstack sudo[89541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0193dee1-edb3-4566-8cde-784bc37c100b.a5378a22-33d8-4eb0-9e67-2921eb1cabdf
Apr 15 20:12:46 devstack sudo[89541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-c89f8be2-0f6d-4f8f-a391-1ca48441c6b2 tempest-VolumesSnapshotTestJSON-895312450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:12:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-c89f8be2-0f6d-4f8f-a391-1ca48441c6b2 tempest-VolumesSnapshotTestJSON-895312450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:12:46 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-c89f8be2-0f6d-4f8f-a391-1ca48441c6b2 tempest-VolumesSnapshotTestJSON-895312450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:12:46 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-c89f8be2-0f6d-4f8f-a391-1ca48441c6b2 tempest-VolumesSnapshotTestJSON-895312450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:12:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-c89f8be2-0f6d-4f8f-a391-1ca48441c6b2 tempest-VolumesSnapshotTestJSON-895312450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:12:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c89f8be2-0f6d-4f8f-a391-1ca48441c6b2 tempest-VolumesSnapshotTestJSON-895312450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:46 devstack sudo[89543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:12:46 devstack sudo[89543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:46 devstack sudo[89541]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-aa25af9a-5f58-4ab8-8f43-9b51a809cd39 tempest-VolumesDeleteCascade-471708485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0193dee1-edb3-4566-8cde-784bc37c100b.a5378a22-33d8-4eb0-9e67-2921eb1cabdf" returned: 0 in 0.522s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:46 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-aa25af9a-5f58-4ab8-8f43-9b51a809cd39 tempest-VolumesDeleteCascade-471708485 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0193dee1-edb3-4566-8cde-784bc37c100b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82646) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 20:12:46 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-aa25af9a-5f58-4ab8-8f43-9b51a809cd39 tempest-VolumesDeleteCascade-471708485 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0193dee1-edb3-4566-8cde-784bc37c100b {{(pid=82646) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 15 20:12:46 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-aa25af9a-5f58-4ab8-8f43-9b51a809cd39 tempest-VolumesDeleteCascade-471708485 None] Creating direct copy from snapshot {{(pid=82646) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 15 20:12:46 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0f3ea7-2151-438b-bae2-f360497d605c]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:12:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-aa25af9a-5f58-4ab8-8f43-9b51a809cd39 tempest-VolumesDeleteCascade-471708485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0193dee1-edb3-4566-8cde-784bc37c100b {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:46 devstack sudo[89543]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c89f8be2-0f6d-4f8f-a391-1ca48441c6b2 tempest-VolumesSnapshotTestJSON-895312450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.458s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:46 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-c89f8be2-0f6d-4f8f-a391-1ca48441c6b2 tempest-VolumesSnapshotTestJSON-895312450 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:12:46 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-c89f8be2-0f6d-4f8f-a391-1ca48441c6b2 tempest-VolumesSnapshotTestJSON-895312450 None] Deleted volume successfully.
Apr 15 20:12:46 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-c89f8be2-0f6d-4f8f-a391-1ca48441c6b2 tempest-VolumesSnapshotTestJSON-895312450 None] Lock "cinder-305fd023-9eca-42d8-a381-0877d56ee1dc-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:12:46 devstack sudo[89549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0193dee1-edb3-4566-8cde-784bc37c100b
Apr 15 20:12:46 devstack sudo[89549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:47 devstack sudo[89549]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:47 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-aa25af9a-5f58-4ab8-8f43-9b51a809cd39 tempest-VolumesDeleteCascade-471708485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0193dee1-edb3-4566-8cde-784bc37c100b" returned: 0 in 0.525s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:47 devstack cinder-volume[82646]: DEBUG cinder.utils [None req-aa25af9a-5f58-4ab8-8f43-9b51a809cd39 tempest-VolumesDeleteCascade-471708485 None] Path /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6a67c696-f0d5-49ff-a604-9be3b30920e0 not found in is_blk_device check {{(pid=82646) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 15 20:12:47 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-aa25af9a-5f58-4ab8-8f43-9b51a809cd39 tempest-VolumesDeleteCascade-471708485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0193dee1-edb3-4566-8cde-784bc37c100b /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6a67c696-f0d5-49ff-a604-9be3b30920e0 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:47 devstack sudo[89554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0193dee1-edb3-4566-8cde-784bc37c100b /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6a67c696-f0d5-49ff-a604-9be3b30920e0
Apr 15 20:12:47 devstack sudo[89554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:48 devstack cinder-volume[82646]: DEBUG oslo_service.periodic_task [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 15 20:12:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:12:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:12:48 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:12:48 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:12:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:12:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:48 devstack sudo[89567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:12:48 devstack sudo[89567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:49 devstack sudo[89567]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:49 devstack sudo[89554]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:49 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 1.012s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:49 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:12:49 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-aa25af9a-5f58-4ab8-8f43-9b51a809cd39 tempest-VolumesDeleteCascade-471708485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0193dee1-edb3-4566-8cde-784bc37c100b /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6a67c696-f0d5-49ff-a604-9be3b30920e0" returned: 0 in 2.497s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:49 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e350657-6c24-4b23-bffc-ef50b743aa2f]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:12:49 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-aa25af9a-5f58-4ab8-8f43-9b51a809cd39 tempest-VolumesDeleteCascade-471708485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0193dee1-edb3-4566-8cde-784bc37c100b {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:50 devstack sudo[89570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0193dee1-edb3-4566-8cde-784bc37c100b
Apr 15 20:12:50 devstack sudo[89570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:50 devstack sudo[89570]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:50 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-aa25af9a-5f58-4ab8-8f43-9b51a809cd39 tempest-VolumesDeleteCascade-471708485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0193dee1-edb3-4566-8cde-784bc37c100b" returned: 0 in 0.778s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:50 devstack cinder-volume[82646]: DEBUG cinder.image.image_utils [None req-aa25af9a-5f58-4ab8-8f43-9b51a809cd39 tempest-VolumesDeleteCascade-471708485 None] Image conversion details: src /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0193dee1-edb3-4566-8cde-784bc37c100b, size 1024.00 MB, duration 2.50 sec, destination /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6a67c696-f0d5-49ff-a604-9be3b30920e0 {{(pid=82646) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 20:12:50 devstack cinder-volume[82646]: INFO cinder.image.image_utils [None req-aa25af9a-5f58-4ab8-8f43-9b51a809cd39 tempest-VolumesDeleteCascade-471708485 None] Converted 1024.00 MB image at 409.98 MB/s
Apr 15 20:12:50 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-aa25af9a-5f58-4ab8-8f43-9b51a809cd39 tempest-VolumesDeleteCascade-471708485 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6a67c696-f0d5-49ff-a604-9be3b30920e0 is being set with open permissions: ugo+rw
Apr 15 20:12:50 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-aa25af9a-5f58-4ab8-8f43-9b51a809cd39 tempest-VolumesDeleteCascade-471708485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6a67c696-f0d5-49ff-a604-9be3b30920e0 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:50 devstack sudo[89576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6a67c696-f0d5-49ff-a604-9be3b30920e0
Apr 15 20:12:50 devstack sudo[89576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:51 devstack sudo[89576]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:51 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-aa25af9a-5f58-4ab8-8f43-9b51a809cd39 tempest-VolumesDeleteCascade-471708485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6a67c696-f0d5-49ff-a604-9be3b30920e0" returned: 0 in 0.422s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:51 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-aa25af9a-5f58-4ab8-8f43-9b51a809cd39 tempest-VolumesDeleteCascade-471708485 None] Lock "cinder-quobyte-6a67c696-f0d5-49ff-a604-9be3b30920e0" released by "_copy_volume_from_snapshot" :: held 4.812s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:12:51 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-aa25af9a-5f58-4ab8-8f43-9b51a809cd39 tempest-VolumesDeleteCascade-471708485 None] Lock "cinder-quobyte-a5378a22-33d8-4eb0-9e67-2921eb1cabdf-6a67c696-f0d5-49ff-a604-9be3b30920e0" released by "_create_volume_from_snapshot" :: held 4.831s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:12:51 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-aa25af9a-5f58-4ab8-8f43-9b51a809cd39 tempest-VolumesDeleteCascade-471708485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.840s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:12:51 devstack cinder-volume[82646]: DEBUG dbcounter [-] [82646] Writing DB stats cinder:SELECT=187,cinder:UPDATE=199,cinder:DELETE=15,cinder:INSERT=55 {{(pid=82646) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 20:12:51 devstack cinder-volume[82646]: DEBUG dbcounter [-] [82646] Writing DB stats cinder:UPDATE=211,cinder:SELECT=152,cinder:INSERT=46,cinder:DELETE=22 {{(pid=82646) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 20:12:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-aa25af9a-5f58-4ab8-8f43-9b51a809cd39 tempest-VolumesDeleteCascade-471708485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bc965df-ff59-4863-b70a-cc4d09dea68c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a67c696-f0d5-49ff-a604-9be3b30920e0', 'volume_size': 1, 'snapshot_id': 'a5378a22-33d8-4eb0-9e67-2921eb1cabdf'}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:12:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-aa25af9a-5f58-4ab8-8f43-9b51a809cd39 tempest-VolumesDeleteCascade-471708485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ab34097-3f5b-400f-907f-3e6b1e9e4411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:12:51 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-aa25af9a-5f58-4ab8-8f43-9b51a809cd39 tempest-VolumesDeleteCascade-471708485 None] Volume volume-6a67c696-f0d5-49ff-a604-9be3b30920e0 (6a67c696-f0d5-49ff-a604-9be3b30920e0): created successfully
Apr 15 20:12:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-aa25af9a-5f58-4ab8-8f43-9b51a809cd39 tempest-VolumesDeleteCascade-471708485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ab34097-3f5b-400f-907f-3e6b1e9e4411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:12:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-aa25af9a-5f58-4ab8-8f43-9b51a809cd39 tempest-VolumesDeleteCascade-471708485 None] Flow 'volume_create_manager' (85c81d3e-f362-4949-b8f2-cccd5e430e4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:12:51 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-aa25af9a-5f58-4ab8-8f43-9b51a809cd39 tempest-VolumesDeleteCascade-471708485 None] Created volume successfully.
Apr 15 20:12:51 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cc1b812-8817-48c7-927c-d6e8e986a475 tempest-VolumesSnapshotListTestJSON-1732160196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:12:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-0cc1b812-8817-48c7-927c-d6e8e986a475 tempest-VolumesSnapshotListTestJSON-1732160196 None] Flow 'volume_create_manager' (3111c200-1a2e-4761-82c1-7819cadc5b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:12:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-0cc1b812-8817-48c7-927c-d6e8e986a475 tempest-VolumesSnapshotListTestJSON-1732160196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40e236b3-dcc1-43d1-80aa-f0f41f60e5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:12:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-0cc1b812-8817-48c7-927c-d6e8e986a475 tempest-VolumesSnapshotListTestJSON-1732160196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40e236b3-dcc1-43d1-80aa-f0f41f60e5a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-652961130',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4376f359-395d-440e-9dc4-90dd0554529e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ed7893f736d4a4a91babda0333e4b4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:12:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:12:52Z,use_quota=True,user_id='f1b0cd1a9d8541abb69f3bd2821e7dad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:12:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-0cc1b812-8817-48c7-927c-d6e8e986a475 tempest-VolumesSnapshotListTestJSON-1732160196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f26851d-4e89-4adb-9e88-582ca263a0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:12:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-0cc1b812-8817-48c7-927c-d6e8e986a475 tempest-VolumesSnapshotListTestJSON-1732160196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f26851d-4e89-4adb-9e88-582ca263a0c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:12:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-0cc1b812-8817-48c7-927c-d6e8e986a475 tempest-VolumesSnapshotListTestJSON-1732160196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b5d1e41-494f-43a4-809f-dc0c1e5d8996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:12:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-0cc1b812-8817-48c7-927c-d6e8e986a475 tempest-VolumesSnapshotListTestJSON-1732160196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b5d1e41-494f-43a4-809f-dc0c1e5d8996) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4376f359-395d-440e-9dc4-90dd0554529e', 'volume_name': 'volume-4376f359-395d-440e-9dc4-90dd0554529e', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:12:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-0cc1b812-8817-48c7-927c-d6e8e986a475 tempest-VolumesSnapshotListTestJSON-1732160196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc406ac0-9242-4e81-92c9-c0e840b7a93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:12:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-0cc1b812-8817-48c7-927c-d6e8e986a475 tempest-VolumesSnapshotListTestJSON-1732160196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc406ac0-9242-4e81-92c9-c0e840b7a93e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:12:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-0cc1b812-8817-48c7-927c-d6e8e986a475 tempest-VolumesSnapshotListTestJSON-1732160196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (987d1b38-fc11-4083-96d2-981836a54bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:12:51 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-0cc1b812-8817-48c7-927c-d6e8e986a475 tempest-VolumesSnapshotListTestJSON-1732160196 None] Volume 4376f359-395d-440e-9dc4-90dd0554529e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4376f359-395d-440e-9dc4-90dd0554529e', 'volume_size': 1}
Apr 15 20:12:51 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-0cc1b812-8817-48c7-927c-d6e8e986a475 tempest-VolumesSnapshotListTestJSON-1732160196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:12:51 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-0cc1b812-8817-48c7-927c-d6e8e986a475 tempest-VolumesSnapshotListTestJSON-1732160196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:12:51 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-0cc1b812-8817-48c7-927c-d6e8e986a475 tempest-VolumesSnapshotListTestJSON-1732160196 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-652961130',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4376f359-395d-440e-9dc4-90dd0554529e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ed7893f736d4a4a91babda0333e4b4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:12:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:12:52Z,use_quota=True,user_id='f1b0cd1a9d8541abb69f3bd2821e7dad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:12:51 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-0cc1b812-8817-48c7-927c-d6e8e986a475 tempest-VolumesSnapshotListTestJSON-1732160196 None] Creating volume 4376f359-395d-440e-9dc4-90dd0554529e {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:12:51 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-0cc1b812-8817-48c7-927c-d6e8e986a475 tempest-VolumesSnapshotListTestJSON-1732160196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:12:51 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-0cc1b812-8817-48c7-927c-d6e8e986a475 tempest-VolumesSnapshotListTestJSON-1732160196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:12:51 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-0cc1b812-8817-48c7-927c-d6e8e986a475 tempest-VolumesSnapshotListTestJSON-1732160196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:12:51 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-0cc1b812-8817-48c7-927c-d6e8e986a475 tempest-VolumesSnapshotListTestJSON-1732160196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:12:51 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-0cc1b812-8817-48c7-927c-d6e8e986a475 tempest-VolumesSnapshotListTestJSON-1732160196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:12:51 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-0cc1b812-8817-48c7-927c-d6e8e986a475 tempest-VolumesSnapshotListTestJSON-1732160196 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:12:51 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-0cc1b812-8817-48c7-927c-d6e8e986a475 tempest-VolumesSnapshotListTestJSON-1732160196 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:12:51 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-0cc1b812-8817-48c7-927c-d6e8e986a475 tempest-VolumesSnapshotListTestJSON-1732160196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:51 devstack sudo[89579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e 1073741824
Apr 15 20:12:51 devstack sudo[89579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:51 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-4f35be42-7c5f-45fa-befc-65e444557031 tempest-VolumesDeleteCascade-471708485 None] Acquiring lock "cinder-0193dee1-edb3-4566-8cde-784bc37c100b-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:12:51 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-4f35be42-7c5f-45fa-befc-65e444557031 tempest-VolumesDeleteCascade-471708485 None] Lock "cinder-0193dee1-edb3-4566-8cde-784bc37c100b-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:12:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-4f35be42-7c5f-45fa-befc-65e444557031 tempest-VolumesDeleteCascade-471708485 None] Performing cascade delete. {{(pid=82646) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 15 20:12:51 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-4f35be42-7c5f-45fa-befc-65e444557031 tempest-VolumesDeleteCascade-471708485 None] Acquiring lock "cinder-a5378a22-33d8-4eb0-9e67-2921eb1cabdf-delete_snapshot" by "delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:12:51 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-4f35be42-7c5f-45fa-befc-65e444557031 tempest-VolumesDeleteCascade-471708485 None] Lock "cinder-a5378a22-33d8-4eb0-9e67-2921eb1cabdf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:12:51 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-4f35be42-7c5f-45fa-befc-65e444557031 tempest-VolumesDeleteCascade-471708485 None] Acquiring lock "cinder-quobyte-0193dee1-edb3-4566-8cde-784bc37c100b" by "delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:12:51 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-4f35be42-7c5f-45fa-befc-65e444557031 tempest-VolumesDeleteCascade-471708485 None] Lock "cinder-quobyte-0193dee1-edb3-4566-8cde-784bc37c100b" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:12:51 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-4f35be42-7c5f-45fa-befc-65e444557031 tempest-VolumesDeleteCascade-471708485 None] Acquiring lock "cinder-quobyte-a5378a22-33d8-4eb0-9e67-2921eb1cabdf" by "_delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:12:51 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-4f35be42-7c5f-45fa-befc-65e444557031 tempest-VolumesDeleteCascade-471708485 None] Lock "cinder-quobyte-a5378a22-33d8-4eb0-9e67-2921eb1cabdf" acquired by "_delete_snapshot" :: waited 0.005s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:12:51 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-4f35be42-7c5f-45fa-befc-65e444557031 tempest-VolumesDeleteCascade-471708485 None] Deleting offline snapshot a5378a22-33d8-4eb0-9e67-2921eb1cabdf of volume 0193dee1-edb3-4566-8cde-784bc37c100b {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 20:12:51 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-4f35be42-7c5f-45fa-befc-65e444557031 tempest-VolumesDeleteCascade-471708485 None] snapshot_file for this snap is: volume-0193dee1-edb3-4566-8cde-784bc37c100b.a5378a22-33d8-4eb0-9e67-2921eb1cabdf {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 20:12:51 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[3609e021-a19c-461c-8a9c-6e9164f44aea]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:12:51 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-4f35be42-7c5f-45fa-befc-65e444557031 tempest-VolumesDeleteCascade-471708485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0193dee1-edb3-4566-8cde-784bc37c100b.a5378a22-33d8-4eb0-9e67-2921eb1cabdf {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:51 devstack sudo[89581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0193dee1-edb3-4566-8cde-784bc37c100b.a5378a22-33d8-4eb0-9e67-2921eb1cabdf
Apr 15 20:12:51 devstack sudo[89581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:52 devstack sudo[89579]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:52 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-0cc1b812-8817-48c7-927c-d6e8e986a475 tempest-VolumesSnapshotListTestJSON-1732160196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e 1073741824" returned: 0 in 0.497s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:52 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-0cc1b812-8817-48c7-927c-d6e8e986a475 tempest-VolumesSnapshotListTestJSON-1732160196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:52 devstack sudo[89589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e
Apr 15 20:12:52 devstack sudo[89589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:52 devstack sudo[89581]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:52 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-4f35be42-7c5f-45fa-befc-65e444557031 tempest-VolumesDeleteCascade-471708485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0193dee1-edb3-4566-8cde-784bc37c100b.a5378a22-33d8-4eb0-9e67-2921eb1cabdf" returned: 0 in 0.489s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:52 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-4f35be42-7c5f-45fa-befc-65e444557031 tempest-VolumesDeleteCascade-471708485 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0193dee1-edb3-4566-8cde-784bc37c100b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82646) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 20:12:52 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[f119905b-c5a7-487e-a2b0-c736913bf4f2]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:12:52 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-4f35be42-7c5f-45fa-befc-65e444557031 tempest-VolumesDeleteCascade-471708485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0193dee1-edb3-4566-8cde-784bc37c100b {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:52 devstack sudo[89591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0193dee1-edb3-4566-8cde-784bc37c100b
Apr 15 20:12:52 devstack sudo[89591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:52 devstack sudo[89589]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:52 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-0cc1b812-8817-48c7-927c-d6e8e986a475 tempest-VolumesSnapshotListTestJSON-1732160196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e" returned: 0 in 0.429s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:52 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-0cc1b812-8817-48c7-927c-d6e8e986a475 tempest-VolumesSnapshotListTestJSON-1732160196 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:12:52 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-0cc1b812-8817-48c7-927c-d6e8e986a475 tempest-VolumesSnapshotListTestJSON-1732160196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:12:52 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-0cc1b812-8817-48c7-927c-d6e8e986a475 tempest-VolumesSnapshotListTestJSON-1732160196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (987d1b38-fc11-4083-96d2-981836a54bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4376f359-395d-440e-9dc4-90dd0554529e', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:12:52 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-0cc1b812-8817-48c7-927c-d6e8e986a475 tempest-VolumesSnapshotListTestJSON-1732160196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d76c638-3303-4e11-8b8c-e1d223873e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:12:52 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-0cc1b812-8817-48c7-927c-d6e8e986a475 tempest-VolumesSnapshotListTestJSON-1732160196 None] Volume volume-4376f359-395d-440e-9dc4-90dd0554529e (4376f359-395d-440e-9dc4-90dd0554529e): created successfully
Apr 15 20:12:52 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-0cc1b812-8817-48c7-927c-d6e8e986a475 tempest-VolumesSnapshotListTestJSON-1732160196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d76c638-3303-4e11-8b8c-e1d223873e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:12:52 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-0cc1b812-8817-48c7-927c-d6e8e986a475 tempest-VolumesSnapshotListTestJSON-1732160196 None] Flow 'volume_create_manager' (3111c200-1a2e-4761-82c1-7819cadc5b6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:12:52 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-0cc1b812-8817-48c7-927c-d6e8e986a475 tempest-VolumesSnapshotListTestJSON-1732160196 None] Created volume successfully.
Apr 15 20:12:52 devstack sudo[89591]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:52 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-4f35be42-7c5f-45fa-befc-65e444557031 tempest-VolumesDeleteCascade-471708485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0193dee1-edb3-4566-8cde-784bc37c100b" returned: 0 in 0.482s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:52 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-4f35be42-7c5f-45fa-befc-65e444557031 tempest-VolumesDeleteCascade-471708485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0193dee1-edb3-4566-8cde-784bc37c100b.a5378a22-33d8-4eb0-9e67-2921eb1cabdf {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:52 devstack sudo[89597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0193dee1-edb3-4566-8cde-784bc37c100b.a5378a22-33d8-4eb0-9e67-2921eb1cabdf
Apr 15 20:12:52 devstack sudo[89597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:53 devstack sudo[89597]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:53 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-4f35be42-7c5f-45fa-befc-65e444557031 tempest-VolumesDeleteCascade-471708485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0193dee1-edb3-4566-8cde-784bc37c100b.a5378a22-33d8-4eb0-9e67-2921eb1cabdf" returned: 0 in 0.423s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:53 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-4f35be42-7c5f-45fa-befc-65e444557031 tempest-VolumesDeleteCascade-471708485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0193dee1-edb3-4566-8cde-784bc37c100b.a5378a22-33d8-4eb0-9e67-2921eb1cabdf {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:53 devstack sudo[89602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0193dee1-edb3-4566-8cde-784bc37c100b.a5378a22-33d8-4eb0-9e67-2921eb1cabdf
Apr 15 20:12:53 devstack sudo[89602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:53 devstack sudo[89602]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:53 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-4f35be42-7c5f-45fa-befc-65e444557031 tempest-VolumesDeleteCascade-471708485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0193dee1-edb3-4566-8cde-784bc37c100b.a5378a22-33d8-4eb0-9e67-2921eb1cabdf" returned: 0 in 0.388s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:53 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-4f35be42-7c5f-45fa-befc-65e444557031 tempest-VolumesDeleteCascade-471708485 None] Lock "cinder-quobyte-a5378a22-33d8-4eb0-9e67-2921eb1cabdf" released by "_delete_snapshot" :: held 1.834s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:12:53 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-4f35be42-7c5f-45fa-befc-65e444557031 tempest-VolumesDeleteCascade-471708485 None] Lock "cinder-quobyte-0193dee1-edb3-4566-8cde-784bc37c100b" released by "delete_snapshot" :: held 1.844s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:12:53 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-4f35be42-7c5f-45fa-befc-65e444557031 tempest-VolumesDeleteCascade-471708485 None] Created reservations ['c3d17201-1f67-43d5-9784-3aba65ee02bb', 'cdcb5524-a163-41ff-ba8d-5e346c643600', '623991d6-dd64-4bec-b922-1cb93686e548', '2f4fade1-fa8b-4321-8512-4d6e4220f611'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:12:53 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-4f35be42-7c5f-45fa-befc-65e444557031 tempest-VolumesDeleteCascade-471708485 None] Delete snapshot completed successfully.
Apr 15 20:12:53 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-4f35be42-7c5f-45fa-befc-65e444557031 tempest-VolumesDeleteCascade-471708485 None] Lock "cinder-a5378a22-33d8-4eb0-9e67-2921eb1cabdf-delete_snapshot" released by "delete_snapshot" :: held 1.965s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:12:53 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-4f35be42-7c5f-45fa-befc-65e444557031 tempest-VolumesDeleteCascade-471708485 None] Snapshots deleted, issuing volume delete {{(pid=82646) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 15 20:12:53 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-4f35be42-7c5f-45fa-befc-65e444557031 tempest-VolumesDeleteCascade-471708485 None] Acquiring lock "cinder-quobyte-0193dee1-edb3-4566-8cde-784bc37c100b" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:12:53 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-4f35be42-7c5f-45fa-befc-65e444557031 tempest-VolumesDeleteCascade-471708485 None] Lock "cinder-quobyte-0193dee1-edb3-4566-8cde-784bc37c100b" acquired by "delete_volume" :: waited 0.011s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:12:53 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[18cc0ed6-1d65-473c-88f2-edefd5870c49]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:12:53 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-4f35be42-7c5f-45fa-befc-65e444557031 tempest-VolumesDeleteCascade-471708485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0193dee1-edb3-4566-8cde-784bc37c100b {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:53 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-9ff8590f-bf1e-41c4-aa48-48e6a47555a0 tempest-VolumesSnapshotListTestJSON-1732160196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:12:53 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-9ff8590f-bf1e-41c4-aa48-48e6a47555a0 tempest-VolumesSnapshotListTestJSON-1732160196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:12:53 devstack sudo[89605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0193dee1-edb3-4566-8cde-784bc37c100b
Apr 15 20:12:53 devstack sudo[89605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:53 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-9ff8590f-bf1e-41c4-aa48-48e6a47555a0 tempest-VolumesSnapshotListTestJSON-1732160196 None] Creating offline snapshot 82ff8c48-9c81-4dc7-868e-72804c3bfa4d of volume 4376f359-395d-440e-9dc4-90dd0554529e {{(pid=82646) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 20:12:53 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc9329c-3a96-406e-abef-e19f23b22d77]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:12:53 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-9ff8590f-bf1e-41c4-aa48-48e6a47555a0 tempest-VolumesSnapshotListTestJSON-1732160196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:53 devstack sudo[89607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e
Apr 15 20:12:53 devstack sudo[89607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:54 devstack sudo[89605]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:54 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-4f35be42-7c5f-45fa-befc-65e444557031 tempest-VolumesDeleteCascade-471708485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0193dee1-edb3-4566-8cde-784bc37c100b" returned: 0 in 0.477s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:54 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-4f35be42-7c5f-45fa-befc-65e444557031 tempest-VolumesDeleteCascade-471708485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0193dee1-edb3-4566-8cde-784bc37c100b {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:54 devstack sudo[89612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0193dee1-edb3-4566-8cde-784bc37c100b
Apr 15 20:12:54 devstack sudo[89612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:54 devstack sudo[89607]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:54 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-9ff8590f-bf1e-41c4-aa48-48e6a47555a0 tempest-VolumesSnapshotListTestJSON-1732160196 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e" returned: 0 in 0.514s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:54 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-9ff8590f-bf1e-41c4-aa48-48e6a47555a0 tempest-VolumesSnapshotListTestJSON-1732160196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.82ff8c48-9c81-4dc7-868e-72804c3bfa4d 1G {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:54 devstack sudo[89617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.82ff8c48-9c81-4dc7-868e-72804c3bfa4d 1G
Apr 15 20:12:54 devstack sudo[89617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:54 devstack sudo[89612]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:54 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-4f35be42-7c5f-45fa-befc-65e444557031 tempest-VolumesDeleteCascade-471708485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0193dee1-edb3-4566-8cde-784bc37c100b" returned: 0 in 0.471s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:54 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-4f35be42-7c5f-45fa-befc-65e444557031 tempest-VolumesDeleteCascade-471708485 None] Lock "cinder-quobyte-0193dee1-edb3-4566-8cde-784bc37c100b" released by "delete_volume" :: held 0.985s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:12:54 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-4f35be42-7c5f-45fa-befc-65e444557031 tempest-VolumesDeleteCascade-471708485 None] Created reservations ['f22a7e85-4e16-4ba6-8154-e8b210e96483', '7a844365-9d9e-4ac3-b6ed-54395a1c8898', '163416c8-ca51-42fa-ad07-a8fb65da7f6a', 'fef27d01-70ba-4c4f-8f59-9d6df758d700'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:12:54 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-4f35be42-7c5f-45fa-befc-65e444557031 tempest-VolumesDeleteCascade-471708485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:12:54 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-4f35be42-7c5f-45fa-befc-65e444557031 tempest-VolumesDeleteCascade-471708485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:12:54 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-4f35be42-7c5f-45fa-befc-65e444557031 tempest-VolumesDeleteCascade-471708485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:12:54 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-4f35be42-7c5f-45fa-befc-65e444557031 tempest-VolumesDeleteCascade-471708485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:12:54 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-4f35be42-7c5f-45fa-befc-65e444557031 tempest-VolumesDeleteCascade-471708485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:12:54 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-4f35be42-7c5f-45fa-befc-65e444557031 tempest-VolumesDeleteCascade-471708485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:54 devstack sudo[89623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:12:54 devstack sudo[89623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:54 devstack sudo[89617]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:54 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-9ff8590f-bf1e-41c4-aa48-48e6a47555a0 tempest-VolumesSnapshotListTestJSON-1732160196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.82ff8c48-9c81-4dc7-868e-72804c3bfa4d 1G" returned: 0 in 0.476s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:54 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-9ff8590f-bf1e-41c4-aa48-48e6a47555a0 tempest-VolumesSnapshotListTestJSON-1732160196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4376f359-395d-440e-9dc4-90dd0554529e -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.82ff8c48-9c81-4dc7-868e-72804c3bfa4d {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:54 devstack sudo[89625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4376f359-395d-440e-9dc4-90dd0554529e -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.82ff8c48-9c81-4dc7-868e-72804c3bfa4d
Apr 15 20:12:54 devstack sudo[89625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:55 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-8a28ce13-1818-46ea-998e-e33f156324da tempest-VolumesDeleteCascade-471708485 None] Acquiring lock "cinder-6a67c696-f0d5-49ff-a604-9be3b30920e0-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:12:55 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-8a28ce13-1818-46ea-998e-e33f156324da tempest-VolumesDeleteCascade-471708485 None] Lock "cinder-6a67c696-f0d5-49ff-a604-9be3b30920e0-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:12:55 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-8a28ce13-1818-46ea-998e-e33f156324da tempest-VolumesDeleteCascade-471708485 None] Acquiring lock "cinder-quobyte-6a67c696-f0d5-49ff-a604-9be3b30920e0" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:12:55 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-8a28ce13-1818-46ea-998e-e33f156324da tempest-VolumesDeleteCascade-471708485 None] Lock "cinder-quobyte-6a67c696-f0d5-49ff-a604-9be3b30920e0" acquired by "delete_volume" :: waited 0.008s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:12:55 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[0433f1a8-6c39-4abe-9bbf-95d011dc744d]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:12:55 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-8a28ce13-1818-46ea-998e-e33f156324da tempest-VolumesDeleteCascade-471708485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6a67c696-f0d5-49ff-a604-9be3b30920e0 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:55 devstack sudo[89627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6a67c696-f0d5-49ff-a604-9be3b30920e0
Apr 15 20:12:55 devstack sudo[89627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:55 devstack sudo[89623]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:55 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-4f35be42-7c5f-45fa-befc-65e444557031 tempest-VolumesDeleteCascade-471708485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.441s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:55 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-4f35be42-7c5f-45fa-befc-65e444557031 tempest-VolumesDeleteCascade-471708485 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:12:55 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-4f35be42-7c5f-45fa-befc-65e444557031 tempest-VolumesDeleteCascade-471708485 None] Deleted volume successfully.
Apr 15 20:12:55 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-4f35be42-7c5f-45fa-befc-65e444557031 tempest-VolumesDeleteCascade-471708485 None] Lock "cinder-0193dee1-edb3-4566-8cde-784bc37c100b-delete_volume" released by "delete_volume" :: held 3.561s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:12:55 devstack sudo[89625]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:55 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-9ff8590f-bf1e-41c4-aa48-48e6a47555a0 tempest-VolumesSnapshotListTestJSON-1732160196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4376f359-395d-440e-9dc4-90dd0554529e -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.82ff8c48-9c81-4dc7-868e-72804c3bfa4d" returned: 0 in 0.470s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:55 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-9ff8590f-bf1e-41c4-aa48-48e6a47555a0 tempest-VolumesSnapshotListTestJSON-1732160196 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.82ff8c48-9c81-4dc7-868e-72804c3bfa4d is being set with open permissions: ugo+rw
Apr 15 20:12:55 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-9ff8590f-bf1e-41c4-aa48-48e6a47555a0 tempest-VolumesSnapshotListTestJSON-1732160196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.82ff8c48-9c81-4dc7-868e-72804c3bfa4d {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:55 devstack sudo[89633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.82ff8c48-9c81-4dc7-868e-72804c3bfa4d
Apr 15 20:12:55 devstack sudo[89633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:55 devstack sudo[89627]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:55 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-8a28ce13-1818-46ea-998e-e33f156324da tempest-VolumesDeleteCascade-471708485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6a67c696-f0d5-49ff-a604-9be3b30920e0" returned: 0 in 0.506s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:55 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-8a28ce13-1818-46ea-998e-e33f156324da tempest-VolumesDeleteCascade-471708485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6a67c696-f0d5-49ff-a604-9be3b30920e0 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:55 devstack sudo[89638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6a67c696-f0d5-49ff-a604-9be3b30920e0
Apr 15 20:12:55 devstack sudo[89638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:55 devstack sudo[89633]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:55 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-9ff8590f-bf1e-41c4-aa48-48e6a47555a0 tempest-VolumesSnapshotListTestJSON-1732160196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.82ff8c48-9c81-4dc7-868e-72804c3bfa4d" returned: 0 in 0.413s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:55 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-9ff8590f-bf1e-41c4-aa48-48e6a47555a0 tempest-VolumesSnapshotListTestJSON-1732160196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.info {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:55 devstack sudo[89641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.info
Apr 15 20:12:55 devstack sudo[89641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:56 devstack sudo[89638]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:56 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-8a28ce13-1818-46ea-998e-e33f156324da tempest-VolumesDeleteCascade-471708485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6a67c696-f0d5-49ff-a604-9be3b30920e0" returned: 0 in 0.428s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:56 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-8a28ce13-1818-46ea-998e-e33f156324da tempest-VolumesDeleteCascade-471708485 None] Lock "cinder-quobyte-6a67c696-f0d5-49ff-a604-9be3b30920e0" released by "delete_volume" :: held 0.956s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:12:56 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-8a28ce13-1818-46ea-998e-e33f156324da tempest-VolumesDeleteCascade-471708485 None] Created reservations ['0419bea9-77c3-402c-ad55-b9e7866ace84', 'fb91797b-3022-4917-ad29-eebe74a1b841', '92171482-3cad-4307-8259-2c316295d5d1', 'bc973c43-200a-42a2-bd8c-a559c2a4d676'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:12:56 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-8a28ce13-1818-46ea-998e-e33f156324da tempest-VolumesDeleteCascade-471708485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:12:56 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-8a28ce13-1818-46ea-998e-e33f156324da tempest-VolumesDeleteCascade-471708485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:12:56 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-8a28ce13-1818-46ea-998e-e33f156324da tempest-VolumesDeleteCascade-471708485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:12:56 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-8a28ce13-1818-46ea-998e-e33f156324da tempest-VolumesDeleteCascade-471708485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:12:56 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-8a28ce13-1818-46ea-998e-e33f156324da tempest-VolumesDeleteCascade-471708485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:12:56 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-8a28ce13-1818-46ea-998e-e33f156324da tempest-VolumesDeleteCascade-471708485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:56 devstack sudo[89646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:12:56 devstack sudo[89646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:56 devstack sudo[89641]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:56 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-9ff8590f-bf1e-41c4-aa48-48e6a47555a0 tempest-VolumesSnapshotListTestJSON-1732160196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.info" returned: 0 in 0.436s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:56 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-9ff8590f-bf1e-41c4-aa48-48e6a47555a0 tempest-VolumesSnapshotListTestJSON-1732160196 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.info is being set with open permissions: ugo+rw
Apr 15 20:12:56 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-9ff8590f-bf1e-41c4-aa48-48e6a47555a0 tempest-VolumesSnapshotListTestJSON-1732160196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.info {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:56 devstack sudo[89648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.info
Apr 15 20:12:56 devstack sudo[89648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:56 devstack sudo[89646]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:56 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-8a28ce13-1818-46ea-998e-e33f156324da tempest-VolumesDeleteCascade-471708485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.444s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:56 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-8a28ce13-1818-46ea-998e-e33f156324da tempest-VolumesDeleteCascade-471708485 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:12:56 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-8a28ce13-1818-46ea-998e-e33f156324da tempest-VolumesDeleteCascade-471708485 None] Deleted volume successfully.
Apr 15 20:12:56 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-8a28ce13-1818-46ea-998e-e33f156324da tempest-VolumesDeleteCascade-471708485 None] Lock "cinder-6a67c696-f0d5-49ff-a604-9be3b30920e0-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:12:56 devstack sudo[89648]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:56 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-9ff8590f-bf1e-41c4-aa48-48e6a47555a0 tempest-VolumesSnapshotListTestJSON-1732160196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.info" returned: 0 in 0.473s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:56 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-9ff8590f-bf1e-41c4-aa48-48e6a47555a0 tempest-VolumesSnapshotListTestJSON-1732160196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.840s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:12:56 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-9ff8590f-bf1e-41c4-aa48-48e6a47555a0 tempest-VolumesSnapshotListTestJSON-1732160196 None] Create snapshot completed successfully
Apr 15 20:12:57 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-cef0c8b0-ae10-4af0-91e1-84ab2aa84b71 tempest-VolumesSnapshotListTestJSON-1732160196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:12:57 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-cef0c8b0-ae10-4af0-91e1-84ab2aa84b71 tempest-VolumesSnapshotListTestJSON-1732160196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:12:57 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-cef0c8b0-ae10-4af0-91e1-84ab2aa84b71 tempest-VolumesSnapshotListTestJSON-1732160196 None] Creating offline snapshot 05ea714c-df27-4076-8f56-4464789a933c of volume 4376f359-395d-440e-9dc4-90dd0554529e {{(pid=82646) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 20:12:57 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[f942a7dc-a929-4eae-a63e-7d84aeed00cd]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:12:57 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-cef0c8b0-ae10-4af0-91e1-84ab2aa84b71 tempest-VolumesSnapshotListTestJSON-1732160196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.82ff8c48-9c81-4dc7-868e-72804c3bfa4d {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:57 devstack sudo[89652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.82ff8c48-9c81-4dc7-868e-72804c3bfa4d
Apr 15 20:12:57 devstack sudo[89652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:57 devstack sudo[89652]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:57 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-cef0c8b0-ae10-4af0-91e1-84ab2aa84b71 tempest-VolumesSnapshotListTestJSON-1732160196 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.82ff8c48-9c81-4dc7-868e-72804c3bfa4d" returned: 0 in 0.615s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:57 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-cef0c8b0-ae10-4af0-91e1-84ab2aa84b71 tempest-VolumesSnapshotListTestJSON-1732160196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4376f359-395d-440e-9dc4-90dd0554529e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82646) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 20:12:57 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-cef0c8b0-ae10-4af0-91e1-84ab2aa84b71 tempest-VolumesSnapshotListTestJSON-1732160196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.82ff8c48-9c81-4dc7-868e-72804c3bfa4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.05ea714c-df27-4076-8f56-4464789a933c 1G {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:57 devstack sudo[89657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.82ff8c48-9c81-4dc7-868e-72804c3bfa4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.05ea714c-df27-4076-8f56-4464789a933c 1G
Apr 15 20:12:57 devstack sudo[89657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:58 devstack sudo[89657]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:58 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-cef0c8b0-ae10-4af0-91e1-84ab2aa84b71 tempest-VolumesSnapshotListTestJSON-1732160196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.82ff8c48-9c81-4dc7-868e-72804c3bfa4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.05ea714c-df27-4076-8f56-4464789a933c 1G" returned: 0 in 0.604s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:58 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-cef0c8b0-ae10-4af0-91e1-84ab2aa84b71 tempest-VolumesSnapshotListTestJSON-1732160196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4376f359-395d-440e-9dc4-90dd0554529e.82ff8c48-9c81-4dc7-868e-72804c3bfa4d -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.05ea714c-df27-4076-8f56-4464789a933c {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:58 devstack sudo[89663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4376f359-395d-440e-9dc4-90dd0554529e.82ff8c48-9c81-4dc7-868e-72804c3bfa4d -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.05ea714c-df27-4076-8f56-4464789a933c
Apr 15 20:12:58 devstack sudo[89663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:58 devstack sudo[89663]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:58 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-cef0c8b0-ae10-4af0-91e1-84ab2aa84b71 tempest-VolumesSnapshotListTestJSON-1732160196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4376f359-395d-440e-9dc4-90dd0554529e.82ff8c48-9c81-4dc7-868e-72804c3bfa4d -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.05ea714c-df27-4076-8f56-4464789a933c" returned: 0 in 0.586s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:58 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-cef0c8b0-ae10-4af0-91e1-84ab2aa84b71 tempest-VolumesSnapshotListTestJSON-1732160196 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.05ea714c-df27-4076-8f56-4464789a933c is being set with open permissions: ugo+rw
Apr 15 20:12:58 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-cef0c8b0-ae10-4af0-91e1-84ab2aa84b71 tempest-VolumesSnapshotListTestJSON-1732160196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.05ea714c-df27-4076-8f56-4464789a933c {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:12:58 devstack sudo[89668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.05ea714c-df27-4076-8f56-4464789a933c
Apr 15 20:12:58 devstack sudo[89668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:12:59 devstack sudo[89668]: pam_unix(sudo:session): session closed for user root
Apr 15 20:12:59 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-cef0c8b0-ae10-4af0-91e1-84ab2aa84b71 tempest-VolumesSnapshotListTestJSON-1732160196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.05ea714c-df27-4076-8f56-4464789a933c" returned: 0 in 0.420s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:12:59 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-cef0c8b0-ae10-4af0-91e1-84ab2aa84b71 tempest-VolumesSnapshotListTestJSON-1732160196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.278s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:12:59 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-cef0c8b0-ae10-4af0-91e1-84ab2aa84b71 tempest-VolumesSnapshotListTestJSON-1732160196 None] Create snapshot completed successfully
Apr 15 20:13:00 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-15da7f43-e5c8-4ce9-b797-2158db39ed0b tempest-VolumesTransfersTest-9495692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:13:00 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-15da7f43-e5c8-4ce9-b797-2158db39ed0b tempest-VolumesTransfersTest-9495692 None] Flow 'volume_create_manager' (b5140c80-7712-426b-8f6b-a64c576a5d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:13:00 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-15da7f43-e5c8-4ce9-b797-2158db39ed0b tempest-VolumesTransfersTest-9495692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fc2494a-ac0a-4567-aaad-dbe635ef5843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:00 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-15da7f43-e5c8-4ce9-b797-2158db39ed0b tempest-VolumesTransfersTest-9495692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fc2494a-ac0a-4567-aaad-dbe635ef5843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:13:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1652329380',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d1e86e7-4b6b-440c-975f-92f7cd4ad368,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ae4beb290184a88a2de07004f42b052',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:13:00Z,use_quota=True,user_id='e1fd80401ee2451da7136d1cee652bc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:00 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-15da7f43-e5c8-4ce9-b797-2158db39ed0b tempest-VolumesTransfersTest-9495692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a9c2f71-9be4-413f-81b3-390d323a1645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:00 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-15da7f43-e5c8-4ce9-b797-2158db39ed0b tempest-VolumesTransfersTest-9495692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a9c2f71-9be4-413f-81b3-390d323a1645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:00 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-15da7f43-e5c8-4ce9-b797-2158db39ed0b tempest-VolumesTransfersTest-9495692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51a3e428-9943-4417-8325-d66ffe5bd94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:00 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-15da7f43-e5c8-4ce9-b797-2158db39ed0b tempest-VolumesTransfersTest-9495692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51a3e428-9943-4417-8325-d66ffe5bd94c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d1e86e7-4b6b-440c-975f-92f7cd4ad368', 'volume_name': 'volume-4d1e86e7-4b6b-440c-975f-92f7cd4ad368', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:00 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-15da7f43-e5c8-4ce9-b797-2158db39ed0b tempest-VolumesTransfersTest-9495692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97496f36-6adb-4742-a68a-0a4ae0837b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:00 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-15da7f43-e5c8-4ce9-b797-2158db39ed0b tempest-VolumesTransfersTest-9495692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97496f36-6adb-4742-a68a-0a4ae0837b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:00 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-15da7f43-e5c8-4ce9-b797-2158db39ed0b tempest-VolumesTransfersTest-9495692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88164a8e-ac8e-4444-a238-5a9f00406b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:00 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-15da7f43-e5c8-4ce9-b797-2158db39ed0b tempest-VolumesTransfersTest-9495692 None] Volume 4d1e86e7-4b6b-440c-975f-92f7cd4ad368: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d1e86e7-4b6b-440c-975f-92f7cd4ad368', 'volume_size': 1}
Apr 15 20:13:00 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-15da7f43-e5c8-4ce9-b797-2158db39ed0b tempest-VolumesTransfersTest-9495692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:13:00 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-15da7f43-e5c8-4ce9-b797-2158db39ed0b tempest-VolumesTransfersTest-9495692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:13:00 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-15da7f43-e5c8-4ce9-b797-2158db39ed0b tempest-VolumesTransfersTest-9495692 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:13:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1652329380',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d1e86e7-4b6b-440c-975f-92f7cd4ad368,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ae4beb290184a88a2de07004f42b052',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:13:00Z,use_quota=True,user_id='e1fd80401ee2451da7136d1cee652bc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:13:00 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-15da7f43-e5c8-4ce9-b797-2158db39ed0b tempest-VolumesTransfersTest-9495692 None] Creating volume 4d1e86e7-4b6b-440c-975f-92f7cd4ad368 {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:13:00 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-15da7f43-e5c8-4ce9-b797-2158db39ed0b tempest-VolumesTransfersTest-9495692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:13:00 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-15da7f43-e5c8-4ce9-b797-2158db39ed0b tempest-VolumesTransfersTest-9495692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:13:00 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-15da7f43-e5c8-4ce9-b797-2158db39ed0b tempest-VolumesTransfersTest-9495692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:13:00 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-15da7f43-e5c8-4ce9-b797-2158db39ed0b tempest-VolumesTransfersTest-9495692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:13:00 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-15da7f43-e5c8-4ce9-b797-2158db39ed0b tempest-VolumesTransfersTest-9495692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:13:00 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-15da7f43-e5c8-4ce9-b797-2158db39ed0b tempest-VolumesTransfersTest-9495692 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:13:00 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-15da7f43-e5c8-4ce9-b797-2158db39ed0b tempest-VolumesTransfersTest-9495692 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:13:00 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-15da7f43-e5c8-4ce9-b797-2158db39ed0b tempest-VolumesTransfersTest-9495692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4d1e86e7-4b6b-440c-975f-92f7cd4ad368 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:00 devstack sudo[89671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4d1e86e7-4b6b-440c-975f-92f7cd4ad368 1073741824
Apr 15 20:13:00 devstack sudo[89671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:00 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-620e36de-a04f-4c71-bfd2-42f04a2c7d8b tempest-VolumesSnapshotListTestJSON-1732160196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:13:00 devstack sudo[89671]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:00 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-15da7f43-e5c8-4ce9-b797-2158db39ed0b tempest-VolumesTransfersTest-9495692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4d1e86e7-4b6b-440c-975f-92f7cd4ad368 1073741824" returned: 0 in 0.526s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:00 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-15da7f43-e5c8-4ce9-b797-2158db39ed0b tempest-VolumesTransfersTest-9495692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4d1e86e7-4b6b-440c-975f-92f7cd4ad368 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:00 devstack sudo[89676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4d1e86e7-4b6b-440c-975f-92f7cd4ad368
Apr 15 20:13:00 devstack sudo[89676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:01 devstack sudo[89676]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:01 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-15da7f43-e5c8-4ce9-b797-2158db39ed0b tempest-VolumesTransfersTest-9495692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4d1e86e7-4b6b-440c-975f-92f7cd4ad368" returned: 0 in 0.474s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:01 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-15da7f43-e5c8-4ce9-b797-2158db39ed0b tempest-VolumesTransfersTest-9495692 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:13:01 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-15da7f43-e5c8-4ce9-b797-2158db39ed0b tempest-VolumesTransfersTest-9495692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:13:01 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-620e36de-a04f-4c71-bfd2-42f04a2c7d8b tempest-VolumesSnapshotListTestJSON-1732160196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.819s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:13:01 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-15da7f43-e5c8-4ce9-b797-2158db39ed0b tempest-VolumesTransfersTest-9495692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88164a8e-ac8e-4444-a238-5a9f00406b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d1e86e7-4b6b-440c-975f-92f7cd4ad368', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:01 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-15da7f43-e5c8-4ce9-b797-2158db39ed0b tempest-VolumesTransfersTest-9495692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a254699f-053f-4958-958c-64ec43236f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:01 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-620e36de-a04f-4c71-bfd2-42f04a2c7d8b tempest-VolumesSnapshotListTestJSON-1732160196 None] Creating offline snapshot e19d186e-4058-43ba-bed0-bfd6ffa47b41 of volume 4376f359-395d-440e-9dc4-90dd0554529e {{(pid=82646) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 20:13:01 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-15da7f43-e5c8-4ce9-b797-2158db39ed0b tempest-VolumesTransfersTest-9495692 None] Volume volume-4d1e86e7-4b6b-440c-975f-92f7cd4ad368 (4d1e86e7-4b6b-440c-975f-92f7cd4ad368): created successfully
Apr 15 20:13:01 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-15da7f43-e5c8-4ce9-b797-2158db39ed0b tempest-VolumesTransfersTest-9495692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a254699f-053f-4958-958c-64ec43236f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:01 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-15da7f43-e5c8-4ce9-b797-2158db39ed0b tempest-VolumesTransfersTest-9495692 None] Flow 'volume_create_manager' (b5140c80-7712-426b-8f6b-a64c576a5d45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:13:01 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5265ec-df5e-44cc-bb3e-97ef67295088]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:13:01 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-620e36de-a04f-4c71-bfd2-42f04a2c7d8b tempest-VolumesSnapshotListTestJSON-1732160196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.05ea714c-df27-4076-8f56-4464789a933c {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:01 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-15da7f43-e5c8-4ce9-b797-2158db39ed0b tempest-VolumesTransfersTest-9495692 None] Created volume successfully.
Apr 15 20:13:01 devstack sudo[89679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.05ea714c-df27-4076-8f56-4464789a933c
Apr 15 20:13:01 devstack sudo[89679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:01 devstack sudo[89679]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:01 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-620e36de-a04f-4c71-bfd2-42f04a2c7d8b tempest-VolumesSnapshotListTestJSON-1732160196 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.05ea714c-df27-4076-8f56-4464789a933c" returned: 0 in 0.513s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:01 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-620e36de-a04f-4c71-bfd2-42f04a2c7d8b tempest-VolumesSnapshotListTestJSON-1732160196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4376f359-395d-440e-9dc4-90dd0554529e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82646) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 20:13:01 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-620e36de-a04f-4c71-bfd2-42f04a2c7d8b tempest-VolumesSnapshotListTestJSON-1732160196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.05ea714c-df27-4076-8f56-4464789a933c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.e19d186e-4058-43ba-bed0-bfd6ffa47b41 1G {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:01 devstack sudo[89684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.05ea714c-df27-4076-8f56-4464789a933c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.e19d186e-4058-43ba-bed0-bfd6ffa47b41 1G
Apr 15 20:13:01 devstack sudo[89684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:02 devstack sudo[89684]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:02 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-620e36de-a04f-4c71-bfd2-42f04a2c7d8b tempest-VolumesSnapshotListTestJSON-1732160196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.05ea714c-df27-4076-8f56-4464789a933c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.e19d186e-4058-43ba-bed0-bfd6ffa47b41 1G" returned: 0 in 0.566s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:02 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-620e36de-a04f-4c71-bfd2-42f04a2c7d8b tempest-VolumesSnapshotListTestJSON-1732160196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4376f359-395d-440e-9dc4-90dd0554529e.05ea714c-df27-4076-8f56-4464789a933c -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.e19d186e-4058-43ba-bed0-bfd6ffa47b41 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:02 devstack sudo[89689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4376f359-395d-440e-9dc4-90dd0554529e.05ea714c-df27-4076-8f56-4464789a933c -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.e19d186e-4058-43ba-bed0-bfd6ffa47b41
Apr 15 20:13:02 devstack sudo[89689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:02 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-70f455d3-677b-4517-9b56-0c3bede22f1f tempest-VolumesTransfersTest-1997159767 None] Transfer volume completed successfully.
Apr 15 20:13:02 devstack sudo[89689]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:02 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-620e36de-a04f-4c71-bfd2-42f04a2c7d8b tempest-VolumesSnapshotListTestJSON-1732160196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4376f359-395d-440e-9dc4-90dd0554529e.05ea714c-df27-4076-8f56-4464789a933c -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.e19d186e-4058-43ba-bed0-bfd6ffa47b41" returned: 0 in 0.453s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:02 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-620e36de-a04f-4c71-bfd2-42f04a2c7d8b tempest-VolumesSnapshotListTestJSON-1732160196 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.e19d186e-4058-43ba-bed0-bfd6ffa47b41 is being set with open permissions: ugo+rw
Apr 15 20:13:02 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-620e36de-a04f-4c71-bfd2-42f04a2c7d8b tempest-VolumesSnapshotListTestJSON-1732160196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.e19d186e-4058-43ba-bed0-bfd6ffa47b41 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:02 devstack sudo[89694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.e19d186e-4058-43ba-bed0-bfd6ffa47b41
Apr 15 20:13:02 devstack sudo[89694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:03 devstack sudo[89694]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:03 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-620e36de-a04f-4c71-bfd2-42f04a2c7d8b tempest-VolumesSnapshotListTestJSON-1732160196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.e19d186e-4058-43ba-bed0-bfd6ffa47b41" returned: 0 in 0.417s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:03 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-620e36de-a04f-4c71-bfd2-42f04a2c7d8b tempest-VolumesSnapshotListTestJSON-1732160196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.028s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:13:03 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-620e36de-a04f-4c71-bfd2-42f04a2c7d8b tempest-VolumesSnapshotListTestJSON-1732160196 None] Create snapshot completed successfully
Apr 15 20:13:03 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-6f4c63d0-c099-4ad8-ab57-4e86215750f0 tempest-VolumesTransfersTest-442270188 None] Acquiring lock "cinder-4d1e86e7-4b6b-440c-975f-92f7cd4ad368-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:13:03 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-6f4c63d0-c099-4ad8-ab57-4e86215750f0 tempest-VolumesTransfersTest-442270188 None] Lock "cinder-4d1e86e7-4b6b-440c-975f-92f7cd4ad368-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:13:03 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-6f4c63d0-c099-4ad8-ab57-4e86215750f0 tempest-VolumesTransfersTest-442270188 None] Acquiring lock "cinder-quobyte-4d1e86e7-4b6b-440c-975f-92f7cd4ad368" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:13:03 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-6f4c63d0-c099-4ad8-ab57-4e86215750f0 tempest-VolumesTransfersTest-442270188 None] Lock "cinder-quobyte-4d1e86e7-4b6b-440c-975f-92f7cd4ad368" acquired by "delete_volume" :: waited 0.013s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:13:03 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6146c5-1b13-442b-b1ac-862537607a02]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:13:03 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6f4c63d0-c099-4ad8-ab57-4e86215750f0 tempest-VolumesTransfersTest-442270188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4d1e86e7-4b6b-440c-975f-92f7cd4ad368 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:03 devstack sudo[89697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4d1e86e7-4b6b-440c-975f-92f7cd4ad368
Apr 15 20:13:03 devstack sudo[89697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:04 devstack sudo[89697]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:04 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6f4c63d0-c099-4ad8-ab57-4e86215750f0 tempest-VolumesTransfersTest-442270188 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4d1e86e7-4b6b-440c-975f-92f7cd4ad368" returned: 0 in 0.540s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:04 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6f4c63d0-c099-4ad8-ab57-4e86215750f0 tempest-VolumesTransfersTest-442270188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4d1e86e7-4b6b-440c-975f-92f7cd4ad368 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:04 devstack sudo[89702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4d1e86e7-4b6b-440c-975f-92f7cd4ad368
Apr 15 20:13:04 devstack sudo[89702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:04 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-dfe7ec38-7a6f-4bce-92df-1f9f045adb21 tempest-VolumesSnapshotListTestJSON-1732160196 None] Acquiring lock "cinder-e19d186e-4058-43ba-bed0-bfd6ffa47b41-delete_snapshot" by "delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:13:04 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-dfe7ec38-7a6f-4bce-92df-1f9f045adb21 tempest-VolumesSnapshotListTestJSON-1732160196 None] Lock "cinder-e19d186e-4058-43ba-bed0-bfd6ffa47b41-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:13:04 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-dfe7ec38-7a6f-4bce-92df-1f9f045adb21 tempest-VolumesSnapshotListTestJSON-1732160196 None] Acquiring lock "cinder-quobyte-4376f359-395d-440e-9dc4-90dd0554529e" by "delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:13:04 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-dfe7ec38-7a6f-4bce-92df-1f9f045adb21 tempest-VolumesSnapshotListTestJSON-1732160196 None] Lock "cinder-quobyte-4376f359-395d-440e-9dc4-90dd0554529e" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:13:04 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-dfe7ec38-7a6f-4bce-92df-1f9f045adb21 tempest-VolumesSnapshotListTestJSON-1732160196 None] Acquiring lock "cinder-quobyte-e19d186e-4058-43ba-bed0-bfd6ffa47b41" by "_delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:13:04 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-dfe7ec38-7a6f-4bce-92df-1f9f045adb21 tempest-VolumesSnapshotListTestJSON-1732160196 None] Lock "cinder-quobyte-e19d186e-4058-43ba-bed0-bfd6ffa47b41" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:13:04 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-dfe7ec38-7a6f-4bce-92df-1f9f045adb21 tempest-VolumesSnapshotListTestJSON-1732160196 None] Deleting offline snapshot e19d186e-4058-43ba-bed0-bfd6ffa47b41 of volume 4376f359-395d-440e-9dc4-90dd0554529e {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 20:13:04 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-dfe7ec38-7a6f-4bce-92df-1f9f045adb21 tempest-VolumesSnapshotListTestJSON-1732160196 None] snapshot_file for this snap is: volume-4376f359-395d-440e-9dc4-90dd0554529e.e19d186e-4058-43ba-bed0-bfd6ffa47b41 {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 20:13:04 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b909f89-b987-44a5-85d8-66abe6956454]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:13:04 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-dfe7ec38-7a6f-4bce-92df-1f9f045adb21 tempest-VolumesSnapshotListTestJSON-1732160196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.e19d186e-4058-43ba-bed0-bfd6ffa47b41 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:04 devstack sudo[89704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.e19d186e-4058-43ba-bed0-bfd6ffa47b41
Apr 15 20:13:04 devstack sudo[89704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:04 devstack sudo[89702]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:04 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6f4c63d0-c099-4ad8-ab57-4e86215750f0 tempest-VolumesTransfersTest-442270188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4d1e86e7-4b6b-440c-975f-92f7cd4ad368" returned: 0 in 0.421s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:04 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-6f4c63d0-c099-4ad8-ab57-4e86215750f0 tempest-VolumesTransfersTest-442270188 None] Lock "cinder-quobyte-4d1e86e7-4b6b-440c-975f-92f7cd4ad368" released by "delete_volume" :: held 0.985s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:13:04 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-6f4c63d0-c099-4ad8-ab57-4e86215750f0 tempest-VolumesTransfersTest-442270188 None] Created reservations ['f755c778-58c6-4d86-8afa-563762d8a6aa', '29440c0f-ee21-4825-ac9a-52c2a56bd368', '095a218d-adec-463d-bc16-4f747e94cfdb', '3975c89b-e136-469c-93e9-10a1a4e47d96'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:13:04 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-6f4c63d0-c099-4ad8-ab57-4e86215750f0 tempest-VolumesTransfersTest-442270188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:13:04 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-6f4c63d0-c099-4ad8-ab57-4e86215750f0 tempest-VolumesTransfersTest-442270188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:13:04 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-6f4c63d0-c099-4ad8-ab57-4e86215750f0 tempest-VolumesTransfersTest-442270188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:13:04 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-6f4c63d0-c099-4ad8-ab57-4e86215750f0 tempest-VolumesTransfersTest-442270188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:13:04 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-6f4c63d0-c099-4ad8-ab57-4e86215750f0 tempest-VolumesTransfersTest-442270188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:13:04 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6f4c63d0-c099-4ad8-ab57-4e86215750f0 tempest-VolumesTransfersTest-442270188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:04 devstack sudo[89708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:13:04 devstack sudo[89708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:04 devstack sudo[89704]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:04 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-dfe7ec38-7a6f-4bce-92df-1f9f045adb21 tempest-VolumesSnapshotListTestJSON-1732160196 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.e19d186e-4058-43ba-bed0-bfd6ffa47b41" returned: 0 in 0.542s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:04 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-dfe7ec38-7a6f-4bce-92df-1f9f045adb21 tempest-VolumesSnapshotListTestJSON-1732160196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4376f359-395d-440e-9dc4-90dd0554529e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82646) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 20:13:04 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[4450b441-c88b-4dcb-91d9-4a07badc1e99]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:13:04 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-dfe7ec38-7a6f-4bce-92df-1f9f045adb21 tempest-VolumesSnapshotListTestJSON-1732160196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.05ea714c-df27-4076-8f56-4464789a933c {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:04 devstack sudo[89712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.05ea714c-df27-4076-8f56-4464789a933c
Apr 15 20:13:04 devstack sudo[89712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:05 devstack sudo[89708]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:05 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6f4c63d0-c099-4ad8-ab57-4e86215750f0 tempest-VolumesTransfersTest-442270188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.419s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:05 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-6f4c63d0-c099-4ad8-ab57-4e86215750f0 tempest-VolumesTransfersTest-442270188 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:13:05 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-6f4c63d0-c099-4ad8-ab57-4e86215750f0 tempest-VolumesTransfersTest-442270188 None] Deleted volume successfully.
Apr 15 20:13:05 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-6f4c63d0-c099-4ad8-ab57-4e86215750f0 tempest-VolumesTransfersTest-442270188 None] Lock "cinder-4d1e86e7-4b6b-440c-975f-92f7cd4ad368-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:13:05 devstack sudo[89712]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:05 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-dfe7ec38-7a6f-4bce-92df-1f9f045adb21 tempest-VolumesSnapshotListTestJSON-1732160196 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.05ea714c-df27-4076-8f56-4464789a933c" returned: 0 in 0.503s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:05 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-dfe7ec38-7a6f-4bce-92df-1f9f045adb21 tempest-VolumesSnapshotListTestJSON-1732160196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4376f359-395d-440e-9dc4-90dd0554529e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82646) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 20:13:05 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-dfe7ec38-7a6f-4bce-92df-1f9f045adb21 tempest-VolumesSnapshotListTestJSON-1732160196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.e19d186e-4058-43ba-bed0-bfd6ffa47b41 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:05 devstack sudo[89718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.e19d186e-4058-43ba-bed0-bfd6ffa47b41
Apr 15 20:13:05 devstack sudo[89718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:05 devstack sudo[89718]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:05 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-dfe7ec38-7a6f-4bce-92df-1f9f045adb21 tempest-VolumesSnapshotListTestJSON-1732160196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.e19d186e-4058-43ba-bed0-bfd6ffa47b41" returned: 0 in 0.529s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:05 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-dfe7ec38-7a6f-4bce-92df-1f9f045adb21 tempest-VolumesSnapshotListTestJSON-1732160196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.e19d186e-4058-43ba-bed0-bfd6ffa47b41 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:05 devstack sudo[89723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.e19d186e-4058-43ba-bed0-bfd6ffa47b41
Apr 15 20:13:05 devstack sudo[89723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:05 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-eba2f53a-dffa-482c-ac85-f56a86bf8f1b tempest-VolumesTransfersTest-9495692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:13:05 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-eba2f53a-dffa-482c-ac85-f56a86bf8f1b tempest-VolumesTransfersTest-9495692 None] Flow 'volume_create_manager' (d152321c-1310-46c6-bfe4-430b1def575b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:13:05 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-eba2f53a-dffa-482c-ac85-f56a86bf8f1b tempest-VolumesTransfersTest-9495692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ea66825-15a0-43d2-8ad6-fc8d6e4409ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:05 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-eba2f53a-dffa-482c-ac85-f56a86bf8f1b tempest-VolumesTransfersTest-9495692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ea66825-15a0-43d2-8ad6-fc8d6e4409ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:13:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1860648746',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a36086d-6eb3-498f-8f3e-da840de14063,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ae4beb290184a88a2de07004f42b052',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:13:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:13:06Z,use_quota=True,user_id='e1fd80401ee2451da7136d1cee652bc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:05 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-eba2f53a-dffa-482c-ac85-f56a86bf8f1b tempest-VolumesTransfersTest-9495692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21351bd2-deda-4bf0-a0de-5f6e2dc0c331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:05 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-eba2f53a-dffa-482c-ac85-f56a86bf8f1b tempest-VolumesTransfersTest-9495692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21351bd2-deda-4bf0-a0de-5f6e2dc0c331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:05 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-eba2f53a-dffa-482c-ac85-f56a86bf8f1b tempest-VolumesTransfersTest-9495692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a54c04e2-3b7f-4bd2-9fd0-9b11d9dacf60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:05 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-eba2f53a-dffa-482c-ac85-f56a86bf8f1b tempest-VolumesTransfersTest-9495692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a54c04e2-3b7f-4bd2-9fd0-9b11d9dacf60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a36086d-6eb3-498f-8f3e-da840de14063', 'volume_name': 'volume-0a36086d-6eb3-498f-8f3e-da840de14063', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:05 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-eba2f53a-dffa-482c-ac85-f56a86bf8f1b tempest-VolumesTransfersTest-9495692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (207c7012-6b19-48bc-8af7-ad6679464923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:05 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-eba2f53a-dffa-482c-ac85-f56a86bf8f1b tempest-VolumesTransfersTest-9495692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (207c7012-6b19-48bc-8af7-ad6679464923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:05 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-eba2f53a-dffa-482c-ac85-f56a86bf8f1b tempest-VolumesTransfersTest-9495692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14658421-2b79-4247-a0cf-1c69da7d8116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:05 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-eba2f53a-dffa-482c-ac85-f56a86bf8f1b tempest-VolumesTransfersTest-9495692 None] Volume 0a36086d-6eb3-498f-8f3e-da840de14063: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a36086d-6eb3-498f-8f3e-da840de14063', 'volume_size': 1}
Apr 15 20:13:05 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-eba2f53a-dffa-482c-ac85-f56a86bf8f1b tempest-VolumesTransfersTest-9495692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:13:05 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-eba2f53a-dffa-482c-ac85-f56a86bf8f1b tempest-VolumesTransfersTest-9495692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:13:05 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-eba2f53a-dffa-482c-ac85-f56a86bf8f1b tempest-VolumesTransfersTest-9495692 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:13:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1860648746',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a36086d-6eb3-498f-8f3e-da840de14063,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ae4beb290184a88a2de07004f42b052',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:13:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:13:06Z,use_quota=True,user_id='e1fd80401ee2451da7136d1cee652bc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:13:05 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-eba2f53a-dffa-482c-ac85-f56a86bf8f1b tempest-VolumesTransfersTest-9495692 None] Creating volume 0a36086d-6eb3-498f-8f3e-da840de14063 {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:13:05 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-eba2f53a-dffa-482c-ac85-f56a86bf8f1b tempest-VolumesTransfersTest-9495692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:13:05 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-eba2f53a-dffa-482c-ac85-f56a86bf8f1b tempest-VolumesTransfersTest-9495692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:13:05 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-eba2f53a-dffa-482c-ac85-f56a86bf8f1b tempest-VolumesTransfersTest-9495692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:13:05 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-eba2f53a-dffa-482c-ac85-f56a86bf8f1b tempest-VolumesTransfersTest-9495692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:13:05 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-eba2f53a-dffa-482c-ac85-f56a86bf8f1b tempest-VolumesTransfersTest-9495692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:13:05 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-eba2f53a-dffa-482c-ac85-f56a86bf8f1b tempest-VolumesTransfersTest-9495692 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:13:05 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-eba2f53a-dffa-482c-ac85-f56a86bf8f1b tempest-VolumesTransfersTest-9495692 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:13:05 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-eba2f53a-dffa-482c-ac85-f56a86bf8f1b tempest-VolumesTransfersTest-9495692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0a36086d-6eb3-498f-8f3e-da840de14063 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:05 devstack sudo[89725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0a36086d-6eb3-498f-8f3e-da840de14063 1073741824
Apr 15 20:13:05 devstack sudo[89725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:06 devstack sudo[89723]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:06 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-dfe7ec38-7a6f-4bce-92df-1f9f045adb21 tempest-VolumesSnapshotListTestJSON-1732160196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.e19d186e-4058-43ba-bed0-bfd6ffa47b41" returned: 0 in 0.445s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:06 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-dfe7ec38-7a6f-4bce-92df-1f9f045adb21 tempest-VolumesSnapshotListTestJSON-1732160196 None] Lock "cinder-quobyte-e19d186e-4058-43ba-bed0-bfd6ffa47b41" released by "_delete_snapshot" :: held 2.078s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:13:06 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-dfe7ec38-7a6f-4bce-92df-1f9f045adb21 tempest-VolumesSnapshotListTestJSON-1732160196 None] Lock "cinder-quobyte-4376f359-395d-440e-9dc4-90dd0554529e" released by "delete_snapshot" :: held 2.094s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:13:06 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-dfe7ec38-7a6f-4bce-92df-1f9f045adb21 tempest-VolumesSnapshotListTestJSON-1732160196 None] Created reservations ['2accccde-edf7-4a07-9df6-b521cc4e8a1b', '45a1e1fd-bc74-435d-8981-5346122b055a', 'a8790d79-0dbb-445d-ab20-9ba08e254d89', 'e721b117-c318-40ed-b29c-b3c699f8822f'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:13:06 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-dfe7ec38-7a6f-4bce-92df-1f9f045adb21 tempest-VolumesSnapshotListTestJSON-1732160196 None] Delete snapshot completed successfully.
Apr 15 20:13:06 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-dfe7ec38-7a6f-4bce-92df-1f9f045adb21 tempest-VolumesSnapshotListTestJSON-1732160196 None] Lock "cinder-e19d186e-4058-43ba-bed0-bfd6ffa47b41-delete_snapshot" released by "delete_snapshot" :: held 2.177s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:13:06 devstack sudo[89725]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:06 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-eba2f53a-dffa-482c-ac85-f56a86bf8f1b tempest-VolumesTransfersTest-9495692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0a36086d-6eb3-498f-8f3e-da840de14063 1073741824" returned: 0 in 0.484s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:06 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-eba2f53a-dffa-482c-ac85-f56a86bf8f1b tempest-VolumesTransfersTest-9495692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0a36086d-6eb3-498f-8f3e-da840de14063 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:06 devstack sudo[89732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0a36086d-6eb3-498f-8f3e-da840de14063
Apr 15 20:13:06 devstack sudo[89732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:06 devstack sudo[89732]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:06 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-eba2f53a-dffa-482c-ac85-f56a86bf8f1b tempest-VolumesTransfersTest-9495692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0a36086d-6eb3-498f-8f3e-da840de14063" returned: 0 in 0.424s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:06 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-eba2f53a-dffa-482c-ac85-f56a86bf8f1b tempest-VolumesTransfersTest-9495692 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:13:06 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-eba2f53a-dffa-482c-ac85-f56a86bf8f1b tempest-VolumesTransfersTest-9495692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:13:06 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-eba2f53a-dffa-482c-ac85-f56a86bf8f1b tempest-VolumesTransfersTest-9495692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14658421-2b79-4247-a0cf-1c69da7d8116) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a36086d-6eb3-498f-8f3e-da840de14063', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:06 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-eba2f53a-dffa-482c-ac85-f56a86bf8f1b tempest-VolumesTransfersTest-9495692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc38a3c1-4f5a-4f60-9b91-00cacce7ff82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:06 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-eba2f53a-dffa-482c-ac85-f56a86bf8f1b tempest-VolumesTransfersTest-9495692 None] Volume volume-0a36086d-6eb3-498f-8f3e-da840de14063 (0a36086d-6eb3-498f-8f3e-da840de14063): created successfully
Apr 15 20:13:06 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-eba2f53a-dffa-482c-ac85-f56a86bf8f1b tempest-VolumesTransfersTest-9495692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc38a3c1-4f5a-4f60-9b91-00cacce7ff82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:06 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-eba2f53a-dffa-482c-ac85-f56a86bf8f1b tempest-VolumesTransfersTest-9495692 None] Flow 'volume_create_manager' (d152321c-1310-46c6-bfe4-430b1def575b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:13:06 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-eba2f53a-dffa-482c-ac85-f56a86bf8f1b tempest-VolumesTransfersTest-9495692 None] Created volume successfully.
Apr 15 20:13:07 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-d5c7f422-cbab-4ef8-beea-5e0ade1b96fd tempest-VolumesSnapshotListTestJSON-1732160196 None] Acquiring lock "cinder-05ea714c-df27-4076-8f56-4464789a933c-delete_snapshot" by "delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:13:07 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-d5c7f422-cbab-4ef8-beea-5e0ade1b96fd tempest-VolumesSnapshotListTestJSON-1732160196 None] Lock "cinder-05ea714c-df27-4076-8f56-4464789a933c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:13:07 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-d5c7f422-cbab-4ef8-beea-5e0ade1b96fd tempest-VolumesSnapshotListTestJSON-1732160196 None] Acquiring lock "cinder-quobyte-4376f359-395d-440e-9dc4-90dd0554529e" by "delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:13:07 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-d5c7f422-cbab-4ef8-beea-5e0ade1b96fd tempest-VolumesSnapshotListTestJSON-1732160196 None] Lock "cinder-quobyte-4376f359-395d-440e-9dc4-90dd0554529e" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:13:07 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-d5c7f422-cbab-4ef8-beea-5e0ade1b96fd tempest-VolumesSnapshotListTestJSON-1732160196 None] Acquiring lock "cinder-quobyte-05ea714c-df27-4076-8f56-4464789a933c" by "_delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:13:07 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-d5c7f422-cbab-4ef8-beea-5e0ade1b96fd tempest-VolumesSnapshotListTestJSON-1732160196 None] Lock "cinder-quobyte-05ea714c-df27-4076-8f56-4464789a933c" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:13:07 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-d5c7f422-cbab-4ef8-beea-5e0ade1b96fd tempest-VolumesSnapshotListTestJSON-1732160196 None] Deleting offline snapshot 05ea714c-df27-4076-8f56-4464789a933c of volume 4376f359-395d-440e-9dc4-90dd0554529e {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 20:13:07 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-d5c7f422-cbab-4ef8-beea-5e0ade1b96fd tempest-VolumesSnapshotListTestJSON-1732160196 None] snapshot_file for this snap is: volume-4376f359-395d-440e-9dc4-90dd0554529e.05ea714c-df27-4076-8f56-4464789a933c {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 20:13:07 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7c9a30-8c63-44e8-a975-86021096a7cb]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:13:07 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d5c7f422-cbab-4ef8-beea-5e0ade1b96fd tempest-VolumesSnapshotListTestJSON-1732160196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.05ea714c-df27-4076-8f56-4464789a933c {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:07 devstack sudo[89735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.05ea714c-df27-4076-8f56-4464789a933c
Apr 15 20:13:07 devstack sudo[89735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:07 devstack sudo[89735]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:07 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d5c7f422-cbab-4ef8-beea-5e0ade1b96fd tempest-VolumesSnapshotListTestJSON-1732160196 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.05ea714c-df27-4076-8f56-4464789a933c" returned: 0 in 0.459s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:07 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-d5c7f422-cbab-4ef8-beea-5e0ade1b96fd tempest-VolumesSnapshotListTestJSON-1732160196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4376f359-395d-440e-9dc4-90dd0554529e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82646) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 20:13:07 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[081e9fb8-17fb-42ec-80df-f8f55f30df2e]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:13:07 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d5c7f422-cbab-4ef8-beea-5e0ade1b96fd tempest-VolumesSnapshotListTestJSON-1732160196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.82ff8c48-9c81-4dc7-868e-72804c3bfa4d {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:07 devstack sudo[89740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.82ff8c48-9c81-4dc7-868e-72804c3bfa4d
Apr 15 20:13:07 devstack sudo[89740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:08 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-128c38c3-dc78-42e4-823d-8f5fdda85b67 tempest-VolumesTransfersTest-442270188 None] Acquiring lock "cinder-0a36086d-6eb3-498f-8f3e-da840de14063-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:13:08 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-128c38c3-dc78-42e4-823d-8f5fdda85b67 tempest-VolumesTransfersTest-442270188 None] Lock "cinder-0a36086d-6eb3-498f-8f3e-da840de14063-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:13:08 devstack sudo[89740]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:08 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d5c7f422-cbab-4ef8-beea-5e0ade1b96fd tempest-VolumesSnapshotListTestJSON-1732160196 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.82ff8c48-9c81-4dc7-868e-72804c3bfa4d" returned: 0 in 0.498s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:08 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-d5c7f422-cbab-4ef8-beea-5e0ade1b96fd tempest-VolumesSnapshotListTestJSON-1732160196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4376f359-395d-440e-9dc4-90dd0554529e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82646) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 20:13:08 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d5c7f422-cbab-4ef8-beea-5e0ade1b96fd tempest-VolumesSnapshotListTestJSON-1732160196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.05ea714c-df27-4076-8f56-4464789a933c {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:08 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-128c38c3-dc78-42e4-823d-8f5fdda85b67 tempest-VolumesTransfersTest-442270188 None] Acquiring lock "cinder-quobyte-0a36086d-6eb3-498f-8f3e-da840de14063" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:13:08 devstack sudo[89745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.05ea714c-df27-4076-8f56-4464789a933c
Apr 15 20:13:08 devstack sudo[89745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:08 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-128c38c3-dc78-42e4-823d-8f5fdda85b67 tempest-VolumesTransfersTest-442270188 None] Lock "cinder-quobyte-0a36086d-6eb3-498f-8f3e-da840de14063" acquired by "delete_volume" :: waited 0.013s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:13:08 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f495ea-c457-4051-b2c1-6ed150402fdc]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:13:08 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-128c38c3-dc78-42e4-823d-8f5fdda85b67 tempest-VolumesTransfersTest-442270188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0a36086d-6eb3-498f-8f3e-da840de14063 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:08 devstack sudo[89747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0a36086d-6eb3-498f-8f3e-da840de14063
Apr 15 20:13:08 devstack sudo[89747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:08 devstack sudo[89745]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:08 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d5c7f422-cbab-4ef8-beea-5e0ade1b96fd tempest-VolumesSnapshotListTestJSON-1732160196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.05ea714c-df27-4076-8f56-4464789a933c" returned: 0 in 0.469s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:08 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d5c7f422-cbab-4ef8-beea-5e0ade1b96fd tempest-VolumesSnapshotListTestJSON-1732160196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.05ea714c-df27-4076-8f56-4464789a933c {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:08 devstack sudo[89754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.05ea714c-df27-4076-8f56-4464789a933c
Apr 15 20:13:08 devstack sudo[89754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:08 devstack sudo[89747]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:08 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-128c38c3-dc78-42e4-823d-8f5fdda85b67 tempest-VolumesTransfersTest-442270188 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0a36086d-6eb3-498f-8f3e-da840de14063" returned: 0 in 0.549s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:08 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-128c38c3-dc78-42e4-823d-8f5fdda85b67 tempest-VolumesTransfersTest-442270188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0a36086d-6eb3-498f-8f3e-da840de14063 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:08 devstack sudo[89757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0a36086d-6eb3-498f-8f3e-da840de14063
Apr 15 20:13:08 devstack sudo[89757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:09 devstack sudo[89754]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d5c7f422-cbab-4ef8-beea-5e0ade1b96fd tempest-VolumesSnapshotListTestJSON-1732160196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.05ea714c-df27-4076-8f56-4464789a933c" returned: 0 in 0.397s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:09 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-d5c7f422-cbab-4ef8-beea-5e0ade1b96fd tempest-VolumesSnapshotListTestJSON-1732160196 None] Lock "cinder-quobyte-05ea714c-df27-4076-8f56-4464789a933c" released by "_delete_snapshot" :: held 1.873s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:13:09 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-d5c7f422-cbab-4ef8-beea-5e0ade1b96fd tempest-VolumesSnapshotListTestJSON-1732160196 None] Lock "cinder-quobyte-4376f359-395d-440e-9dc4-90dd0554529e" released by "delete_snapshot" :: held 1.889s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:13:09 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-d5c7f422-cbab-4ef8-beea-5e0ade1b96fd tempest-VolumesSnapshotListTestJSON-1732160196 None] Created reservations ['bbcbe946-4f16-4870-994e-c88cb8398ab6', 'b1743552-7a91-4d99-925e-d182f40edc42', '81e706d6-99d9-4c9d-a4a8-6b1eab187cf7', '28f70536-6289-403a-87a2-053db6189cfe'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:13:09 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-d5c7f422-cbab-4ef8-beea-5e0ade1b96fd tempest-VolumesSnapshotListTestJSON-1732160196 None] Delete snapshot completed successfully.
Apr 15 20:13:09 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-d5c7f422-cbab-4ef8-beea-5e0ade1b96fd tempest-VolumesSnapshotListTestJSON-1732160196 None] Lock "cinder-05ea714c-df27-4076-8f56-4464789a933c-delete_snapshot" released by "delete_snapshot" :: held 1.971s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:13:09 devstack sudo[89757]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-128c38c3-dc78-42e4-823d-8f5fdda85b67 tempest-VolumesTransfersTest-442270188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0a36086d-6eb3-498f-8f3e-da840de14063" returned: 0 in 0.482s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:09 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-128c38c3-dc78-42e4-823d-8f5fdda85b67 tempest-VolumesTransfersTest-442270188 None] Lock "cinder-quobyte-0a36086d-6eb3-498f-8f3e-da840de14063" released by "delete_volume" :: held 1.054s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:13:09 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-8d868ad0-0167-4918-83dd-912d1470973f tempest-VolumesSnapshotListTestJSON-1732160196 None] Acquiring lock "cinder-82ff8c48-9c81-4dc7-868e-72804c3bfa4d-delete_snapshot" by "delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:13:09 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-8d868ad0-0167-4918-83dd-912d1470973f tempest-VolumesSnapshotListTestJSON-1732160196 None] Lock "cinder-82ff8c48-9c81-4dc7-868e-72804c3bfa4d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:13:09 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-8d868ad0-0167-4918-83dd-912d1470973f tempest-VolumesSnapshotListTestJSON-1732160196 None] Acquiring lock "cinder-quobyte-4376f359-395d-440e-9dc4-90dd0554529e" by "delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:13:09 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-8d868ad0-0167-4918-83dd-912d1470973f tempest-VolumesSnapshotListTestJSON-1732160196 None] Lock "cinder-quobyte-4376f359-395d-440e-9dc4-90dd0554529e" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:13:09 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-8d868ad0-0167-4918-83dd-912d1470973f tempest-VolumesSnapshotListTestJSON-1732160196 None] Acquiring lock "cinder-quobyte-82ff8c48-9c81-4dc7-868e-72804c3bfa4d" by "_delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:13:09 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-8d868ad0-0167-4918-83dd-912d1470973f tempest-VolumesSnapshotListTestJSON-1732160196 None] Lock "cinder-quobyte-82ff8c48-9c81-4dc7-868e-72804c3bfa4d" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:13:09 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-8d868ad0-0167-4918-83dd-912d1470973f tempest-VolumesSnapshotListTestJSON-1732160196 None] Deleting offline snapshot 82ff8c48-9c81-4dc7-868e-72804c3bfa4d of volume 4376f359-395d-440e-9dc4-90dd0554529e {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 20:13:09 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-8d868ad0-0167-4918-83dd-912d1470973f tempest-VolumesSnapshotListTestJSON-1732160196 None] snapshot_file for this snap is: volume-4376f359-395d-440e-9dc4-90dd0554529e.82ff8c48-9c81-4dc7-868e-72804c3bfa4d {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 20:13:09 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-128c38c3-dc78-42e4-823d-8f5fdda85b67 tempest-VolumesTransfersTest-442270188 None] Created reservations ['18c15449-5b45-4181-83dd-7b5a131d5c79', '73536fa9-5702-46a0-b303-65a5f4989a4c', 'e93ecb80-26b5-4c79-a9c4-0acb7a7c1759', '652cf53b-6c58-40a7-9d96-b4a00345f9e0'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:13:09 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[904852dc-6cad-4baf-abb9-eb6caefc4bb5]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:13:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-8d868ad0-0167-4918-83dd-912d1470973f tempest-VolumesSnapshotListTestJSON-1732160196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.82ff8c48-9c81-4dc7-868e-72804c3bfa4d {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-128c38c3-dc78-42e4-823d-8f5fdda85b67 tempest-VolumesTransfersTest-442270188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:13:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-128c38c3-dc78-42e4-823d-8f5fdda85b67 tempest-VolumesTransfersTest-442270188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:13:09 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-128c38c3-dc78-42e4-823d-8f5fdda85b67 tempest-VolumesTransfersTest-442270188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:13:09 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-128c38c3-dc78-42e4-823d-8f5fdda85b67 tempest-VolumesTransfersTest-442270188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:13:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-128c38c3-dc78-42e4-823d-8f5fdda85b67 tempest-VolumesTransfersTest-442270188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:13:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-128c38c3-dc78-42e4-823d-8f5fdda85b67 tempest-VolumesTransfersTest-442270188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:09 devstack sudo[89761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.82ff8c48-9c81-4dc7-868e-72804c3bfa4d
Apr 15 20:13:09 devstack sudo[89761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:09 devstack sudo[89762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:13:09 devstack sudo[89762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:09 devstack sudo[89761]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-8d868ad0-0167-4918-83dd-912d1470973f tempest-VolumesSnapshotListTestJSON-1732160196 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.82ff8c48-9c81-4dc7-868e-72804c3bfa4d" returned: 0 in 0.487s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:09 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-8d868ad0-0167-4918-83dd-912d1470973f tempest-VolumesSnapshotListTestJSON-1732160196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4376f359-395d-440e-9dc4-90dd0554529e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82646) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 20:13:09 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[d699fe9b-2aa6-4bc7-a51e-aba41969cfa9]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:13:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-8d868ad0-0167-4918-83dd-912d1470973f tempest-VolumesSnapshotListTestJSON-1732160196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:09 devstack sudo[89762]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-128c38c3-dc78-42e4-823d-8f5fdda85b67 tempest-VolumesTransfersTest-442270188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.482s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:09 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-128c38c3-dc78-42e4-823d-8f5fdda85b67 tempest-VolumesTransfersTest-442270188 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:13:10 devstack sudo[89769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e
Apr 15 20:13:10 devstack sudo[89769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:10 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-128c38c3-dc78-42e4-823d-8f5fdda85b67 tempest-VolumesTransfersTest-442270188 None] Deleted volume successfully.
Apr 15 20:13:10 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-128c38c3-dc78-42e4-823d-8f5fdda85b67 tempest-VolumesTransfersTest-442270188 None] Lock "cinder-0a36086d-6eb3-498f-8f3e-da840de14063-delete_volume" released by "delete_volume" :: held 1.799s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:13:10 devstack sudo[89769]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:10 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-8d868ad0-0167-4918-83dd-912d1470973f tempest-VolumesSnapshotListTestJSON-1732160196 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e" returned: 0 in 0.519s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:10 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-8d868ad0-0167-4918-83dd-912d1470973f tempest-VolumesSnapshotListTestJSON-1732160196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.82ff8c48-9c81-4dc7-868e-72804c3bfa4d {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:10 devstack sudo[89774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.82ff8c48-9c81-4dc7-868e-72804c3bfa4d
Apr 15 20:13:10 devstack sudo[89774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:10 devstack sudo[89774]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:10 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-8d868ad0-0167-4918-83dd-912d1470973f tempest-VolumesSnapshotListTestJSON-1732160196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.82ff8c48-9c81-4dc7-868e-72804c3bfa4d" returned: 0 in 0.492s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:10 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-8d868ad0-0167-4918-83dd-912d1470973f tempest-VolumesSnapshotListTestJSON-1732160196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.82ff8c48-9c81-4dc7-868e-72804c3bfa4d {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:10 devstack sudo[89779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.82ff8c48-9c81-4dc7-868e-72804c3bfa4d
Apr 15 20:13:10 devstack sudo[89779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:11 devstack sudo[89779]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:11 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-8d868ad0-0167-4918-83dd-912d1470973f tempest-VolumesSnapshotListTestJSON-1732160196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e.82ff8c48-9c81-4dc7-868e-72804c3bfa4d" returned: 0 in 0.462s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:11 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-8d868ad0-0167-4918-83dd-912d1470973f tempest-VolumesSnapshotListTestJSON-1732160196 None] Lock "cinder-quobyte-82ff8c48-9c81-4dc7-868e-72804c3bfa4d" released by "_delete_snapshot" :: held 2.029s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:13:11 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-8d868ad0-0167-4918-83dd-912d1470973f tempest-VolumesSnapshotListTestJSON-1732160196 None] Lock "cinder-quobyte-4376f359-395d-440e-9dc4-90dd0554529e" released by "delete_snapshot" :: held 2.042s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:13:11 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-8d868ad0-0167-4918-83dd-912d1470973f tempest-VolumesSnapshotListTestJSON-1732160196 None] Created reservations ['601c9d38-212d-4f78-9c72-328d61b455f6', '9accedb3-b326-468e-a280-fd76909e79a9', '388570b2-1202-4e85-a022-16b23d01222c', 'c58a379b-988a-4333-918c-d30c92e4193b'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:13:11 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-8d868ad0-0167-4918-83dd-912d1470973f tempest-VolumesSnapshotListTestJSON-1732160196 None] Delete snapshot completed successfully.
Apr 15 20:13:11 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-8d868ad0-0167-4918-83dd-912d1470973f tempest-VolumesSnapshotListTestJSON-1732160196 None] Lock "cinder-82ff8c48-9c81-4dc7-868e-72804c3bfa4d-delete_snapshot" released by "delete_snapshot" :: held 2.142s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:13:12 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-25b29000-92b2-452a-8a7a-9d5c6c69b9d6 tempest-VolumesSnapshotListTestJSON-1732160196 None] Acquiring lock "cinder-4376f359-395d-440e-9dc4-90dd0554529e-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:13:12 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-25b29000-92b2-452a-8a7a-9d5c6c69b9d6 tempest-VolumesSnapshotListTestJSON-1732160196 None] Lock "cinder-4376f359-395d-440e-9dc4-90dd0554529e-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:13:12 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-25b29000-92b2-452a-8a7a-9d5c6c69b9d6 tempest-VolumesSnapshotListTestJSON-1732160196 None] Acquiring lock "cinder-quobyte-4376f359-395d-440e-9dc4-90dd0554529e" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:13:12 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-25b29000-92b2-452a-8a7a-9d5c6c69b9d6 tempest-VolumesSnapshotListTestJSON-1732160196 None] Lock "cinder-quobyte-4376f359-395d-440e-9dc4-90dd0554529e" acquired by "delete_volume" :: waited 0.013s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:13:12 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb3f65b-367a-434d-8e6e-897f2817b3b8]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:13:12 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-25b29000-92b2-452a-8a7a-9d5c6c69b9d6 tempest-VolumesSnapshotListTestJSON-1732160196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:12 devstack sudo[89784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e
Apr 15 20:13:12 devstack sudo[89784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:13 devstack sudo[89784]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:13 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-25b29000-92b2-452a-8a7a-9d5c6c69b9d6 tempest-VolumesSnapshotListTestJSON-1732160196 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e" returned: 0 in 0.519s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:13 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-25b29000-92b2-452a-8a7a-9d5c6c69b9d6 tempest-VolumesSnapshotListTestJSON-1732160196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:13 devstack sudo[89789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e
Apr 15 20:13:13 devstack sudo[89789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:13 devstack sudo[89789]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:13 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-25b29000-92b2-452a-8a7a-9d5c6c69b9d6 tempest-VolumesSnapshotListTestJSON-1732160196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-4376f359-395d-440e-9dc4-90dd0554529e" returned: 0 in 0.470s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:13 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-25b29000-92b2-452a-8a7a-9d5c6c69b9d6 tempest-VolumesSnapshotListTestJSON-1732160196 None] Lock "cinder-quobyte-4376f359-395d-440e-9dc4-90dd0554529e" released by "delete_volume" :: held 1.031s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:13:13 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-25b29000-92b2-452a-8a7a-9d5c6c69b9d6 tempest-VolumesSnapshotListTestJSON-1732160196 None] Created reservations ['3ac9045d-cd18-44a9-8486-09c74af94014', 'f135d173-1659-4a40-883e-19b704184ca6', '7425ad89-51c0-489e-8971-bf5f3b0ef4ae', 'c9a3012a-d0f7-4ca4-9172-e63ed4411a9a'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:13:13 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-25b29000-92b2-452a-8a7a-9d5c6c69b9d6 tempest-VolumesSnapshotListTestJSON-1732160196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:13:13 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-25b29000-92b2-452a-8a7a-9d5c6c69b9d6 tempest-VolumesSnapshotListTestJSON-1732160196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:13:13 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-25b29000-92b2-452a-8a7a-9d5c6c69b9d6 tempest-VolumesSnapshotListTestJSON-1732160196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:13:13 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-25b29000-92b2-452a-8a7a-9d5c6c69b9d6 tempest-VolumesSnapshotListTestJSON-1732160196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:13:13 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-25b29000-92b2-452a-8a7a-9d5c6c69b9d6 tempest-VolumesSnapshotListTestJSON-1732160196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:13:13 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-25b29000-92b2-452a-8a7a-9d5c6c69b9d6 tempest-VolumesSnapshotListTestJSON-1732160196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:13 devstack sudo[89792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:13:13 devstack sudo[89792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:13 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-158c22f6-fe5d-4669-9dcd-e2f0cacc84d4 tempest-CreateVolumesFromImageTest-542036154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:13:13 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-158c22f6-fe5d-4669-9dcd-e2f0cacc84d4 tempest-CreateVolumesFromImageTest-542036154 None] Flow 'volume_create_manager' (832bc310-6343-4781-b520-b2a900efa138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:13:13 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-158c22f6-fe5d-4669-9dcd-e2f0cacc84d4 tempest-CreateVolumesFromImageTest-542036154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2464d38e-c288-44b9-8622-dc8984b9e98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:13 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-158c22f6-fe5d-4669-9dcd-e2f0cacc84d4 tempest-CreateVolumesFromImageTest-542036154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2464d38e-c288-44b9-8622-dc8984b9e98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:13:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-360851698',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d924a44a-cf05-463a-98d4-66329b276701,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d35df6e6f8449ea8441fbaaf47f6cb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:13:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:13:14Z,use_quota=True,user_id='1b95f61ad7c3462db9bde61c4263d3ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:13 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-158c22f6-fe5d-4669-9dcd-e2f0cacc84d4 tempest-CreateVolumesFromImageTest-542036154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d56c6220-7786-470a-b8c9-be79b7a16a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:13 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-158c22f6-fe5d-4669-9dcd-e2f0cacc84d4 tempest-CreateVolumesFromImageTest-542036154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d56c6220-7786-470a-b8c9-be79b7a16a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:13 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-158c22f6-fe5d-4669-9dcd-e2f0cacc84d4 tempest-CreateVolumesFromImageTest-542036154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a70636a2-6f5e-4de0-be9a-c7464173f974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:13 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-158c22f6-fe5d-4669-9dcd-e2f0cacc84d4 tempest-CreateVolumesFromImageTest-542036154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a70636a2-6f5e-4de0-be9a-c7464173f974) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd924a44a-cf05-463a-98d4-66329b276701', 'volume_name': 'volume-d924a44a-cf05-463a-98d4-66329b276701', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:13 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-158c22f6-fe5d-4669-9dcd-e2f0cacc84d4 tempest-CreateVolumesFromImageTest-542036154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e91feeea-d6b2-46d0-885d-39adfda811b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:13 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-158c22f6-fe5d-4669-9dcd-e2f0cacc84d4 tempest-CreateVolumesFromImageTest-542036154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e91feeea-d6b2-46d0-885d-39adfda811b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:13 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-158c22f6-fe5d-4669-9dcd-e2f0cacc84d4 tempest-CreateVolumesFromImageTest-542036154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ed24ba6-7a13-4b3e-8ecd-daa3dfc88e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:13 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-158c22f6-fe5d-4669-9dcd-e2f0cacc84d4 tempest-CreateVolumesFromImageTest-542036154 None] Volume d924a44a-cf05-463a-98d4-66329b276701: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d924a44a-cf05-463a-98d4-66329b276701', 'volume_size': 1}
Apr 15 20:13:13 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-158c22f6-fe5d-4669-9dcd-e2f0cacc84d4 tempest-CreateVolumesFromImageTest-542036154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:13:13 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-158c22f6-fe5d-4669-9dcd-e2f0cacc84d4 tempest-CreateVolumesFromImageTest-542036154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:13:13 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-158c22f6-fe5d-4669-9dcd-e2f0cacc84d4 tempest-CreateVolumesFromImageTest-542036154 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:13:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-360851698',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d924a44a-cf05-463a-98d4-66329b276701,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d35df6e6f8449ea8441fbaaf47f6cb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:13:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:13:14Z,use_quota=True,user_id='1b95f61ad7c3462db9bde61c4263d3ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:13:13 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-158c22f6-fe5d-4669-9dcd-e2f0cacc84d4 tempest-CreateVolumesFromImageTest-542036154 None] Creating volume d924a44a-cf05-463a-98d4-66329b276701 {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:13:13 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-158c22f6-fe5d-4669-9dcd-e2f0cacc84d4 tempest-CreateVolumesFromImageTest-542036154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:13:13 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-158c22f6-fe5d-4669-9dcd-e2f0cacc84d4 tempest-CreateVolumesFromImageTest-542036154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:13:13 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-158c22f6-fe5d-4669-9dcd-e2f0cacc84d4 tempest-CreateVolumesFromImageTest-542036154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:13:13 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-158c22f6-fe5d-4669-9dcd-e2f0cacc84d4 tempest-CreateVolumesFromImageTest-542036154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:13:13 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-158c22f6-fe5d-4669-9dcd-e2f0cacc84d4 tempest-CreateVolumesFromImageTest-542036154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:13:13 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-158c22f6-fe5d-4669-9dcd-e2f0cacc84d4 tempest-CreateVolumesFromImageTest-542036154 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:13:13 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-158c22f6-fe5d-4669-9dcd-e2f0cacc84d4 tempest-CreateVolumesFromImageTest-542036154 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:13:13 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-158c22f6-fe5d-4669-9dcd-e2f0cacc84d4 tempest-CreateVolumesFromImageTest-542036154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d924a44a-cf05-463a-98d4-66329b276701 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:13 devstack sudo[89794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d924a44a-cf05-463a-98d4-66329b276701 1073741824
Apr 15 20:13:13 devstack sudo[89794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:14 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-b424252b-57e9-4cf4-994a-85735e85e5ad tempest-CreateVolumesFromImageTest-542036154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:13:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b424252b-57e9-4cf4-994a-85735e85e5ad tempest-CreateVolumesFromImageTest-542036154 None] Flow 'volume_create_manager' (093f7953-f57d-4860-bc20-c53b292ba2af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:13:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b424252b-57e9-4cf4-994a-85735e85e5ad tempest-CreateVolumesFromImageTest-542036154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cde02c32-51a6-49cb-b57c-4e66197cd214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b424252b-57e9-4cf4-994a-85735e85e5ad tempest-CreateVolumesFromImageTest-542036154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cde02c32-51a6-49cb-b57c-4e66197cd214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:13:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-197515227',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f715b55a-acf6-4379-a850-ab065b8df5e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d35df6e6f8449ea8441fbaaf47f6cb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:13:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:13:14Z,use_quota=True,user_id='1b95f61ad7c3462db9bde61c4263d3ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b424252b-57e9-4cf4-994a-85735e85e5ad tempest-CreateVolumesFromImageTest-542036154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3106e72-41e6-47a2-a08c-5acfc071dc1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b424252b-57e9-4cf4-994a-85735e85e5ad tempest-CreateVolumesFromImageTest-542036154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3106e72-41e6-47a2-a08c-5acfc071dc1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b424252b-57e9-4cf4-994a-85735e85e5ad tempest-CreateVolumesFromImageTest-542036154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9230464-f222-47ef-b919-25de175262ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b424252b-57e9-4cf4-994a-85735e85e5ad tempest-CreateVolumesFromImageTest-542036154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9230464-f222-47ef-b919-25de175262ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f715b55a-acf6-4379-a850-ab065b8df5e9', 'volume_name': 'volume-f715b55a-acf6-4379-a850-ab065b8df5e9', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b424252b-57e9-4cf4-994a-85735e85e5ad tempest-CreateVolumesFromImageTest-542036154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c02acd7b-0934-4d22-9a19-97b5a9e13ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b424252b-57e9-4cf4-994a-85735e85e5ad tempest-CreateVolumesFromImageTest-542036154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c02acd7b-0934-4d22-9a19-97b5a9e13ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b424252b-57e9-4cf4-994a-85735e85e5ad tempest-CreateVolumesFromImageTest-542036154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc6e1cc4-d961-45e3-a892-83b3aaf7f04b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:14 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-b424252b-57e9-4cf4-994a-85735e85e5ad tempest-CreateVolumesFromImageTest-542036154 None] Volume f715b55a-acf6-4379-a850-ab065b8df5e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f715b55a-acf6-4379-a850-ab065b8df5e9', 'volume_size': 1}
Apr 15 20:13:14 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-b424252b-57e9-4cf4-994a-85735e85e5ad tempest-CreateVolumesFromImageTest-542036154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:13:14 devstack sudo[89792]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:14 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-25b29000-92b2-452a-8a7a-9d5c6c69b9d6 tempest-VolumesSnapshotListTestJSON-1732160196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.509s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:14 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-25b29000-92b2-452a-8a7a-9d5c6c69b9d6 tempest-VolumesSnapshotListTestJSON-1732160196 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:13:14 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-25b29000-92b2-452a-8a7a-9d5c6c69b9d6 tempest-VolumesSnapshotListTestJSON-1732160196 None] Deleted volume successfully.
Apr 15 20:13:14 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-25b29000-92b2-452a-8a7a-9d5c6c69b9d6 tempest-VolumesSnapshotListTestJSON-1732160196 None] Lock "cinder-4376f359-395d-440e-9dc4-90dd0554529e-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:13:14 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ee7c85d-a93a-4400-981a-2c8c4681d563 tempest-CreateVolumesFromImageTest-542036154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:13:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-9ee7c85d-a93a-4400-981a-2c8c4681d563 tempest-CreateVolumesFromImageTest-542036154 None] Flow 'volume_create_manager' (7e64d8a0-c53c-4cd4-b4bb-64f226fe4cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:13:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-9ee7c85d-a93a-4400-981a-2c8c4681d563 tempest-CreateVolumesFromImageTest-542036154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (357e96c7-e1d7-438f-ba32-213b0b5037d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-9ee7c85d-a93a-4400-981a-2c8c4681d563 tempest-CreateVolumesFromImageTest-542036154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (357e96c7-e1d7-438f-ba32-213b0b5037d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:13:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-301175985',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a19fb6a-dec7-4a24-a2dc-1900a2c9105f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d35df6e6f8449ea8441fbaaf47f6cb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:13:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:13:14Z,use_quota=True,user_id='1b95f61ad7c3462db9bde61c4263d3ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-9ee7c85d-a93a-4400-981a-2c8c4681d563 tempest-CreateVolumesFromImageTest-542036154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6ab9df1-5708-4db6-80e9-84066f960891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-9ee7c85d-a93a-4400-981a-2c8c4681d563 tempest-CreateVolumesFromImageTest-542036154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6ab9df1-5708-4db6-80e9-84066f960891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-9ee7c85d-a93a-4400-981a-2c8c4681d563 tempest-CreateVolumesFromImageTest-542036154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72b79e20-0b6f-4a6b-8d69-40cca450205a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-9ee7c85d-a93a-4400-981a-2c8c4681d563 tempest-CreateVolumesFromImageTest-542036154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72b79e20-0b6f-4a6b-8d69-40cca450205a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a19fb6a-dec7-4a24-a2dc-1900a2c9105f', 'volume_name': 'volume-9a19fb6a-dec7-4a24-a2dc-1900a2c9105f', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-9ee7c85d-a93a-4400-981a-2c8c4681d563 tempest-CreateVolumesFromImageTest-542036154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb4a6fe5-f965-4068-b9a2-b46e060c9b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-9ee7c85d-a93a-4400-981a-2c8c4681d563 tempest-CreateVolumesFromImageTest-542036154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb4a6fe5-f965-4068-b9a2-b46e060c9b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-9ee7c85d-a93a-4400-981a-2c8c4681d563 tempest-CreateVolumesFromImageTest-542036154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbb4e31b-48fb-4a7e-a36e-4089c9abd699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:14 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-9ee7c85d-a93a-4400-981a-2c8c4681d563 tempest-CreateVolumesFromImageTest-542036154 None] Volume 9a19fb6a-dec7-4a24-a2dc-1900a2c9105f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a19fb6a-dec7-4a24-a2dc-1900a2c9105f', 'volume_size': 1}
Apr 15 20:13:14 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-9ee7c85d-a93a-4400-981a-2c8c4681d563 tempest-CreateVolumesFromImageTest-542036154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:13:14 devstack sudo[89794]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:14 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-158c22f6-fe5d-4669-9dcd-e2f0cacc84d4 tempest-CreateVolumesFromImageTest-542036154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d924a44a-cf05-463a-98d4-66329b276701 1073741824" returned: 0 in 0.627s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:14 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-158c22f6-fe5d-4669-9dcd-e2f0cacc84d4 tempest-CreateVolumesFromImageTest-542036154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d924a44a-cf05-463a-98d4-66329b276701 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:14 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f4985c4-4fc9-437d-a73f-fae529643885 tempest-CreateVolumesFromImageTest-542036154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:13:14 devstack sudo[89800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d924a44a-cf05-463a-98d4-66329b276701
Apr 15 20:13:14 devstack sudo[89800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-5f4985c4-4fc9-437d-a73f-fae529643885 tempest-CreateVolumesFromImageTest-542036154 None] Flow 'volume_create_manager' (43fd2651-7cd9-4487-ab62-a26bd0d9b293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:13:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-5f4985c4-4fc9-437d-a73f-fae529643885 tempest-CreateVolumesFromImageTest-542036154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9d92702-e928-42eb-8039-4f3bd9070515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-5f4985c4-4fc9-437d-a73f-fae529643885 tempest-CreateVolumesFromImageTest-542036154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9d92702-e928-42eb-8039-4f3bd9070515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:13:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-240526218',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46a8775d-1aa1-444f-9cfa-7dee4aae53bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d35df6e6f8449ea8441fbaaf47f6cb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:13:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:13:15Z,use_quota=True,user_id='1b95f61ad7c3462db9bde61c4263d3ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-5f4985c4-4fc9-437d-a73f-fae529643885 tempest-CreateVolumesFromImageTest-542036154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe9904be-7e3c-4b49-86f5-f40e75f324d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-5f4985c4-4fc9-437d-a73f-fae529643885 tempest-CreateVolumesFromImageTest-542036154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe9904be-7e3c-4b49-86f5-f40e75f324d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-5f4985c4-4fc9-437d-a73f-fae529643885 tempest-CreateVolumesFromImageTest-542036154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ed6ee24-844b-46a1-9b5a-782a02589fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-5f4985c4-4fc9-437d-a73f-fae529643885 tempest-CreateVolumesFromImageTest-542036154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ed6ee24-844b-46a1-9b5a-782a02589fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46a8775d-1aa1-444f-9cfa-7dee4aae53bc', 'volume_name': 'volume-46a8775d-1aa1-444f-9cfa-7dee4aae53bc', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-5f4985c4-4fc9-437d-a73f-fae529643885 tempest-CreateVolumesFromImageTest-542036154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf2cbfa4-c90e-4500-8d18-e700abae3397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-5f4985c4-4fc9-437d-a73f-fae529643885 tempest-CreateVolumesFromImageTest-542036154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf2cbfa4-c90e-4500-8d18-e700abae3397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-5f4985c4-4fc9-437d-a73f-fae529643885 tempest-CreateVolumesFromImageTest-542036154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56c34977-c817-406c-b5c8-180a8d7a37f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:14 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-5f4985c4-4fc9-437d-a73f-fae529643885 tempest-CreateVolumesFromImageTest-542036154 None] Volume 46a8775d-1aa1-444f-9cfa-7dee4aae53bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46a8775d-1aa1-444f-9cfa-7dee4aae53bc', 'volume_size': 1}
Apr 15 20:13:14 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-5f4985c4-4fc9-437d-a73f-fae529643885 tempest-CreateVolumesFromImageTest-542036154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:13:14 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dd31e8e-8b82-43f5-a2a6-13750fbb2e72 tempest-CreateVolumesFromImageTest-542036154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:13:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-5dd31e8e-8b82-43f5-a2a6-13750fbb2e72 tempest-CreateVolumesFromImageTest-542036154 None] Flow 'volume_create_manager' (11502fd7-3c88-4a4f-a7d8-a6fd4ab07b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:13:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-5dd31e8e-8b82-43f5-a2a6-13750fbb2e72 tempest-CreateVolumesFromImageTest-542036154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b34ca2b-8960-4275-8361-7a12abbd7a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-5dd31e8e-8b82-43f5-a2a6-13750fbb2e72 tempest-CreateVolumesFromImageTest-542036154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b34ca2b-8960-4275-8361-7a12abbd7a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:13:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1590161717',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2f80c99-d253-4a13-8242-904d14285b25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d35df6e6f8449ea8441fbaaf47f6cb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:13:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:13:15Z,use_quota=True,user_id='1b95f61ad7c3462db9bde61c4263d3ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-5dd31e8e-8b82-43f5-a2a6-13750fbb2e72 tempest-CreateVolumesFromImageTest-542036154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67731239-506d-41a8-b0fe-4ee7c5de543f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-5dd31e8e-8b82-43f5-a2a6-13750fbb2e72 tempest-CreateVolumesFromImageTest-542036154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67731239-506d-41a8-b0fe-4ee7c5de543f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-5dd31e8e-8b82-43f5-a2a6-13750fbb2e72 tempest-CreateVolumesFromImageTest-542036154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5df1d4a8-65dc-4f7b-a537-e7f22da70497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-5dd31e8e-8b82-43f5-a2a6-13750fbb2e72 tempest-CreateVolumesFromImageTest-542036154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5df1d4a8-65dc-4f7b-a537-e7f22da70497) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2f80c99-d253-4a13-8242-904d14285b25', 'volume_name': 'volume-d2f80c99-d253-4a13-8242-904d14285b25', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-5dd31e8e-8b82-43f5-a2a6-13750fbb2e72 tempest-CreateVolumesFromImageTest-542036154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b60b9438-7dd3-4681-9ba1-e473989ff5e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-5dd31e8e-8b82-43f5-a2a6-13750fbb2e72 tempest-CreateVolumesFromImageTest-542036154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b60b9438-7dd3-4681-9ba1-e473989ff5e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-5dd31e8e-8b82-43f5-a2a6-13750fbb2e72 tempest-CreateVolumesFromImageTest-542036154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e59c03f-58be-4ffe-b170-f7f266a0203e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:14 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-5dd31e8e-8b82-43f5-a2a6-13750fbb2e72 tempest-CreateVolumesFromImageTest-542036154 None] Volume d2f80c99-d253-4a13-8242-904d14285b25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2f80c99-d253-4a13-8242-904d14285b25', 'volume_size': 1}
Apr 15 20:13:14 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-5dd31e8e-8b82-43f5-a2a6-13750fbb2e72 tempest-CreateVolumesFromImageTest-542036154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:13:15 devstack sudo[89800]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:15 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-158c22f6-fe5d-4669-9dcd-e2f0cacc84d4 tempest-CreateVolumesFromImageTest-542036154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d924a44a-cf05-463a-98d4-66329b276701" returned: 0 in 0.508s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:15 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-158c22f6-fe5d-4669-9dcd-e2f0cacc84d4 tempest-CreateVolumesFromImageTest-542036154 None] <== create_volume: return (1180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:13:15 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-158c22f6-fe5d-4669-9dcd-e2f0cacc84d4 tempest-CreateVolumesFromImageTest-542036154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:13:15 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-b424252b-57e9-4cf4-994a-85735e85e5ad tempest-CreateVolumesFromImageTest-542036154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.930s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:13:15 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-b424252b-57e9-4cf4-994a-85735e85e5ad tempest-CreateVolumesFromImageTest-542036154 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:13:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-197515227',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f715b55a-acf6-4379-a850-ab065b8df5e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d35df6e6f8449ea8441fbaaf47f6cb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:13:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:13:14Z,use_quota=True,user_id='1b95f61ad7c3462db9bde61c4263d3ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:13:15 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-b424252b-57e9-4cf4-994a-85735e85e5ad tempest-CreateVolumesFromImageTest-542036154 None] Creating volume f715b55a-acf6-4379-a850-ab065b8df5e9 {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:13:15 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-b424252b-57e9-4cf4-994a-85735e85e5ad tempest-CreateVolumesFromImageTest-542036154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:13:15 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-b424252b-57e9-4cf4-994a-85735e85e5ad tempest-CreateVolumesFromImageTest-542036154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:13:15 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-b424252b-57e9-4cf4-994a-85735e85e5ad tempest-CreateVolumesFromImageTest-542036154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:13:15 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-b424252b-57e9-4cf4-994a-85735e85e5ad tempest-CreateVolumesFromImageTest-542036154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:13:15 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-b424252b-57e9-4cf4-994a-85735e85e5ad tempest-CreateVolumesFromImageTest-542036154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:13:15 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-b424252b-57e9-4cf4-994a-85735e85e5ad tempest-CreateVolumesFromImageTest-542036154 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:13:15 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-b424252b-57e9-4cf4-994a-85735e85e5ad tempest-CreateVolumesFromImageTest-542036154 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:13:15 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b424252b-57e9-4cf4-994a-85735e85e5ad tempest-CreateVolumesFromImageTest-542036154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f715b55a-acf6-4379-a850-ab065b8df5e9 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:15 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-158c22f6-fe5d-4669-9dcd-e2f0cacc84d4 tempest-CreateVolumesFromImageTest-542036154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ed24ba6-7a13-4b3e-8ecd-daa3dfc88e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d924a44a-cf05-463a-98d4-66329b276701', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:15 devstack sudo[89803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f715b55a-acf6-4379-a850-ab065b8df5e9 1073741824
Apr 15 20:13:15 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-158c22f6-fe5d-4669-9dcd-e2f0cacc84d4 tempest-CreateVolumesFromImageTest-542036154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a571a3c4-a147-493f-baae-ea1021d23d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:15 devstack sudo[89803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:15 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-158c22f6-fe5d-4669-9dcd-e2f0cacc84d4 tempest-CreateVolumesFromImageTest-542036154 None] Volume volume-d924a44a-cf05-463a-98d4-66329b276701 (d924a44a-cf05-463a-98d4-66329b276701): created successfully
Apr 15 20:13:15 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-158c22f6-fe5d-4669-9dcd-e2f0cacc84d4 tempest-CreateVolumesFromImageTest-542036154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a571a3c4-a147-493f-baae-ea1021d23d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:15 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-158c22f6-fe5d-4669-9dcd-e2f0cacc84d4 tempest-CreateVolumesFromImageTest-542036154 None] Flow 'volume_create_manager' (832bc310-6343-4781-b520-b2a900efa138) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:13:15 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-158c22f6-fe5d-4669-9dcd-e2f0cacc84d4 tempest-CreateVolumesFromImageTest-542036154 None] Created volume successfully.
Apr 15 20:13:15 devstack sudo[89803]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:15 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b424252b-57e9-4cf4-994a-85735e85e5ad tempest-CreateVolumesFromImageTest-542036154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f715b55a-acf6-4379-a850-ab065b8df5e9 1073741824" returned: 0 in 0.656s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:15 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b424252b-57e9-4cf4-994a-85735e85e5ad tempest-CreateVolumesFromImageTest-542036154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f715b55a-acf6-4379-a850-ab065b8df5e9 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:15 devstack sudo[89808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f715b55a-acf6-4379-a850-ab065b8df5e9
Apr 15 20:13:15 devstack sudo[89808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:16 devstack sudo[89808]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:16 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b424252b-57e9-4cf4-994a-85735e85e5ad tempest-CreateVolumesFromImageTest-542036154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f715b55a-acf6-4379-a850-ab065b8df5e9" returned: 0 in 0.566s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:16 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-b424252b-57e9-4cf4-994a-85735e85e5ad tempest-CreateVolumesFromImageTest-542036154 None] <== create_volume: return (1259ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:13:16 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-b424252b-57e9-4cf4-994a-85735e85e5ad tempest-CreateVolumesFromImageTest-542036154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.262s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:13:16 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-9ee7c85d-a93a-4400-981a-2c8c4681d563 tempest-CreateVolumesFromImageTest-542036154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.944s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:13:16 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-9ee7c85d-a93a-4400-981a-2c8c4681d563 tempest-CreateVolumesFromImageTest-542036154 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:13:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-301175985',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a19fb6a-dec7-4a24-a2dc-1900a2c9105f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d35df6e6f8449ea8441fbaaf47f6cb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:13:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:13:14Z,use_quota=True,user_id='1b95f61ad7c3462db9bde61c4263d3ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:13:16 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-9ee7c85d-a93a-4400-981a-2c8c4681d563 tempest-CreateVolumesFromImageTest-542036154 None] Creating volume 9a19fb6a-dec7-4a24-a2dc-1900a2c9105f {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:13:16 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-9ee7c85d-a93a-4400-981a-2c8c4681d563 tempest-CreateVolumesFromImageTest-542036154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:13:16 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-9ee7c85d-a93a-4400-981a-2c8c4681d563 tempest-CreateVolumesFromImageTest-542036154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:13:16 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-9ee7c85d-a93a-4400-981a-2c8c4681d563 tempest-CreateVolumesFromImageTest-542036154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:13:16 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-9ee7c85d-a93a-4400-981a-2c8c4681d563 tempest-CreateVolumesFromImageTest-542036154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:13:16 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-9ee7c85d-a93a-4400-981a-2c8c4681d563 tempest-CreateVolumesFromImageTest-542036154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:13:16 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-9ee7c85d-a93a-4400-981a-2c8c4681d563 tempest-CreateVolumesFromImageTest-542036154 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:13:16 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-9ee7c85d-a93a-4400-981a-2c8c4681d563 tempest-CreateVolumesFromImageTest-542036154 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:13:16 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-9ee7c85d-a93a-4400-981a-2c8c4681d563 tempest-CreateVolumesFromImageTest-542036154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9a19fb6a-dec7-4a24-a2dc-1900a2c9105f 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:16 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b424252b-57e9-4cf4-994a-85735e85e5ad tempest-CreateVolumesFromImageTest-542036154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc6e1cc4-d961-45e3-a892-83b3aaf7f04b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f715b55a-acf6-4379-a850-ab065b8df5e9', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:16 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b424252b-57e9-4cf4-994a-85735e85e5ad tempest-CreateVolumesFromImageTest-542036154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01a8036b-216d-4c40-a6ec-9e41bd098edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:16 devstack sudo[89812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9a19fb6a-dec7-4a24-a2dc-1900a2c9105f 1073741824
Apr 15 20:13:16 devstack sudo[89812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:16 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-b424252b-57e9-4cf4-994a-85735e85e5ad tempest-CreateVolumesFromImageTest-542036154 None] Volume volume-f715b55a-acf6-4379-a850-ab065b8df5e9 (f715b55a-acf6-4379-a850-ab065b8df5e9): created successfully
Apr 15 20:13:16 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b424252b-57e9-4cf4-994a-85735e85e5ad tempest-CreateVolumesFromImageTest-542036154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01a8036b-216d-4c40-a6ec-9e41bd098edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:16 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b424252b-57e9-4cf4-994a-85735e85e5ad tempest-CreateVolumesFromImageTest-542036154 None] Flow 'volume_create_manager' (093f7953-f57d-4860-bc20-c53b292ba2af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:13:16 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-b424252b-57e9-4cf4-994a-85735e85e5ad tempest-CreateVolumesFromImageTest-542036154 None] Created volume successfully.
Apr 15 20:13:17 devstack sudo[89812]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-9ee7c85d-a93a-4400-981a-2c8c4681d563 tempest-CreateVolumesFromImageTest-542036154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9a19fb6a-dec7-4a24-a2dc-1900a2c9105f 1073741824" returned: 0 in 0.616s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-9ee7c85d-a93a-4400-981a-2c8c4681d563 tempest-CreateVolumesFromImageTest-542036154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9a19fb6a-dec7-4a24-a2dc-1900a2c9105f {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:17 devstack sudo[89817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9a19fb6a-dec7-4a24-a2dc-1900a2c9105f
Apr 15 20:13:17 devstack sudo[89817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:17 devstack sudo[89817]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-9ee7c85d-a93a-4400-981a-2c8c4681d563 tempest-CreateVolumesFromImageTest-542036154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9a19fb6a-dec7-4a24-a2dc-1900a2c9105f" returned: 0 in 0.446s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:17 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-9ee7c85d-a93a-4400-981a-2c8c4681d563 tempest-CreateVolumesFromImageTest-542036154 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:13:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-9ee7c85d-a93a-4400-981a-2c8c4681d563 tempest-CreateVolumesFromImageTest-542036154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:13:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-5f4985c4-4fc9-437d-a73f-fae529643885 tempest-CreateVolumesFromImageTest-542036154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.802s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:13:17 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-5f4985c4-4fc9-437d-a73f-fae529643885 tempest-CreateVolumesFromImageTest-542036154 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:13:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-240526218',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46a8775d-1aa1-444f-9cfa-7dee4aae53bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d35df6e6f8449ea8441fbaaf47f6cb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:13:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:13:15Z,use_quota=True,user_id='1b95f61ad7c3462db9bde61c4263d3ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:13:17 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-5f4985c4-4fc9-437d-a73f-fae529643885 tempest-CreateVolumesFromImageTest-542036154 None] Creating volume 46a8775d-1aa1-444f-9cfa-7dee4aae53bc {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:13:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-5f4985c4-4fc9-437d-a73f-fae529643885 tempest-CreateVolumesFromImageTest-542036154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:13:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-5f4985c4-4fc9-437d-a73f-fae529643885 tempest-CreateVolumesFromImageTest-542036154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:13:17 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-5f4985c4-4fc9-437d-a73f-fae529643885 tempest-CreateVolumesFromImageTest-542036154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:13:17 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-5f4985c4-4fc9-437d-a73f-fae529643885 tempest-CreateVolumesFromImageTest-542036154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:13:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-5f4985c4-4fc9-437d-a73f-fae529643885 tempest-CreateVolumesFromImageTest-542036154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:13:17 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-5f4985c4-4fc9-437d-a73f-fae529643885 tempest-CreateVolumesFromImageTest-542036154 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:13:17 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-5f4985c4-4fc9-437d-a73f-fae529643885 tempest-CreateVolumesFromImageTest-542036154 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:13:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5f4985c4-4fc9-437d-a73f-fae529643885 tempest-CreateVolumesFromImageTest-542036154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46a8775d-1aa1-444f-9cfa-7dee4aae53bc 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-9ee7c85d-a93a-4400-981a-2c8c4681d563 tempest-CreateVolumesFromImageTest-542036154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbb4e31b-48fb-4a7e-a36e-4089c9abd699) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a19fb6a-dec7-4a24-a2dc-1900a2c9105f', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-9ee7c85d-a93a-4400-981a-2c8c4681d563 tempest-CreateVolumesFromImageTest-542036154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bb63c41-50a9-4513-9300-f10ccf060ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:17 devstack sudo[89820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46a8775d-1aa1-444f-9cfa-7dee4aae53bc 1073741824
Apr 15 20:13:17 devstack sudo[89820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:17 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-9ee7c85d-a93a-4400-981a-2c8c4681d563 tempest-CreateVolumesFromImageTest-542036154 None] Volume volume-9a19fb6a-dec7-4a24-a2dc-1900a2c9105f (9a19fb6a-dec7-4a24-a2dc-1900a2c9105f): created successfully
Apr 15 20:13:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-9ee7c85d-a93a-4400-981a-2c8c4681d563 tempest-CreateVolumesFromImageTest-542036154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bb63c41-50a9-4513-9300-f10ccf060ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-9ee7c85d-a93a-4400-981a-2c8c4681d563 tempest-CreateVolumesFromImageTest-542036154 None] Flow 'volume_create_manager' (7e64d8a0-c53c-4cd4-b4bb-64f226fe4cfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:13:17 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-9ee7c85d-a93a-4400-981a-2c8c4681d563 tempest-CreateVolumesFromImageTest-542036154 None] Created volume successfully.
Apr 15 20:13:18 devstack sudo[89820]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5f4985c4-4fc9-437d-a73f-fae529643885 tempest-CreateVolumesFromImageTest-542036154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46a8775d-1aa1-444f-9cfa-7dee4aae53bc 1073741824" returned: 0 in 0.514s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5f4985c4-4fc9-437d-a73f-fae529643885 tempest-CreateVolumesFromImageTest-542036154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46a8775d-1aa1-444f-9cfa-7dee4aae53bc {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:18 devstack sudo[89825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46a8775d-1aa1-444f-9cfa-7dee4aae53bc
Apr 15 20:13:18 devstack sudo[89825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:18 devstack sudo[89825]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5f4985c4-4fc9-437d-a73f-fae529643885 tempest-CreateVolumesFromImageTest-542036154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46a8775d-1aa1-444f-9cfa-7dee4aae53bc" returned: 0 in 0.408s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:18 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-5f4985c4-4fc9-437d-a73f-fae529643885 tempest-CreateVolumesFromImageTest-542036154 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:13:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-5f4985c4-4fc9-437d-a73f-fae529643885 tempest-CreateVolumesFromImageTest-542036154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:13:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-5dd31e8e-8b82-43f5-a2a6-13750fbb2e72 tempest-CreateVolumesFromImageTest-542036154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.587s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:13:18 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-5dd31e8e-8b82-43f5-a2a6-13750fbb2e72 tempest-CreateVolumesFromImageTest-542036154 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:13:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1590161717',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2f80c99-d253-4a13-8242-904d14285b25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d35df6e6f8449ea8441fbaaf47f6cb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:13:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:13:15Z,use_quota=True,user_id='1b95f61ad7c3462db9bde61c4263d3ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:13:18 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-5dd31e8e-8b82-43f5-a2a6-13750fbb2e72 tempest-CreateVolumesFromImageTest-542036154 None] Creating volume d2f80c99-d253-4a13-8242-904d14285b25 {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:13:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-5dd31e8e-8b82-43f5-a2a6-13750fbb2e72 tempest-CreateVolumesFromImageTest-542036154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:13:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-5dd31e8e-8b82-43f5-a2a6-13750fbb2e72 tempest-CreateVolumesFromImageTest-542036154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:13:18 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-5dd31e8e-8b82-43f5-a2a6-13750fbb2e72 tempest-CreateVolumesFromImageTest-542036154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:13:18 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-5dd31e8e-8b82-43f5-a2a6-13750fbb2e72 tempest-CreateVolumesFromImageTest-542036154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:13:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-5dd31e8e-8b82-43f5-a2a6-13750fbb2e72 tempest-CreateVolumesFromImageTest-542036154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:13:18 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-5dd31e8e-8b82-43f5-a2a6-13750fbb2e72 tempest-CreateVolumesFromImageTest-542036154 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:13:18 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-5dd31e8e-8b82-43f5-a2a6-13750fbb2e72 tempest-CreateVolumesFromImageTest-542036154 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:13:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5dd31e8e-8b82-43f5-a2a6-13750fbb2e72 tempest-CreateVolumesFromImageTest-542036154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d2f80c99-d253-4a13-8242-904d14285b25 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:18 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-5f4985c4-4fc9-437d-a73f-fae529643885 tempest-CreateVolumesFromImageTest-542036154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56c34977-c817-406c-b5c8-180a8d7a37f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46a8775d-1aa1-444f-9cfa-7dee4aae53bc', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:18 devstack sudo[89828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d2f80c99-d253-4a13-8242-904d14285b25 1073741824
Apr 15 20:13:18 devstack sudo[89828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:18 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-5f4985c4-4fc9-437d-a73f-fae529643885 tempest-CreateVolumesFromImageTest-542036154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cfdcf4a-db6d-4a39-ad7e-5af1a4a67ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:18 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-5f4985c4-4fc9-437d-a73f-fae529643885 tempest-CreateVolumesFromImageTest-542036154 None] Volume volume-46a8775d-1aa1-444f-9cfa-7dee4aae53bc (46a8775d-1aa1-444f-9cfa-7dee4aae53bc): created successfully
Apr 15 20:13:18 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-5f4985c4-4fc9-437d-a73f-fae529643885 tempest-CreateVolumesFromImageTest-542036154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cfdcf4a-db6d-4a39-ad7e-5af1a4a67ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:18 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-5f4985c4-4fc9-437d-a73f-fae529643885 tempest-CreateVolumesFromImageTest-542036154 None] Flow 'volume_create_manager' (43fd2651-7cd9-4487-ab62-a26bd0d9b293) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:13:18 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-5f4985c4-4fc9-437d-a73f-fae529643885 tempest-CreateVolumesFromImageTest-542036154 None] Created volume successfully.
Apr 15 20:13:18 devstack sudo[89828]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5dd31e8e-8b82-43f5-a2a6-13750fbb2e72 tempest-CreateVolumesFromImageTest-542036154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d2f80c99-d253-4a13-8242-904d14285b25 1073741824" returned: 0 in 0.474s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5dd31e8e-8b82-43f5-a2a6-13750fbb2e72 tempest-CreateVolumesFromImageTest-542036154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d2f80c99-d253-4a13-8242-904d14285b25 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:18 devstack sudo[89833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d2f80c99-d253-4a13-8242-904d14285b25
Apr 15 20:13:18 devstack sudo[89833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:19 devstack sudo[89833]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:19 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5dd31e8e-8b82-43f5-a2a6-13750fbb2e72 tempest-CreateVolumesFromImageTest-542036154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d2f80c99-d253-4a13-8242-904d14285b25" returned: 0 in 0.414s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:19 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-5dd31e8e-8b82-43f5-a2a6-13750fbb2e72 tempest-CreateVolumesFromImageTest-542036154 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:13:19 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-5dd31e8e-8b82-43f5-a2a6-13750fbb2e72 tempest-CreateVolumesFromImageTest-542036154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:13:19 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-5dd31e8e-8b82-43f5-a2a6-13750fbb2e72 tempest-CreateVolumesFromImageTest-542036154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e59c03f-58be-4ffe-b170-f7f266a0203e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2f80c99-d253-4a13-8242-904d14285b25', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:19 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-5dd31e8e-8b82-43f5-a2a6-13750fbb2e72 tempest-CreateVolumesFromImageTest-542036154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bed10a0c-7e95-4a9b-8b8e-8c7fc29c59d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:19 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-5dd31e8e-8b82-43f5-a2a6-13750fbb2e72 tempest-CreateVolumesFromImageTest-542036154 None] Volume volume-d2f80c99-d253-4a13-8242-904d14285b25 (d2f80c99-d253-4a13-8242-904d14285b25): created successfully
Apr 15 20:13:19 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-5dd31e8e-8b82-43f5-a2a6-13750fbb2e72 tempest-CreateVolumesFromImageTest-542036154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bed10a0c-7e95-4a9b-8b8e-8c7fc29c59d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:19 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-5dd31e8e-8b82-43f5-a2a6-13750fbb2e72 tempest-CreateVolumesFromImageTest-542036154 None] Flow 'volume_create_manager' (11502fd7-3c88-4a4f-a7d8-a6fd4ab07b38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:13:19 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-5dd31e8e-8b82-43f5-a2a6-13750fbb2e72 tempest-CreateVolumesFromImageTest-542036154 None] Created volume successfully.
Apr 15 20:13:20 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-d58c8273-ef5b-419b-af5a-27d2d54e751a tempest-CreateVolumesFromImageTest-542036154 None] Acquiring lock "cinder-d2f80c99-d253-4a13-8242-904d14285b25-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:13:20 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-d58c8273-ef5b-419b-af5a-27d2d54e751a tempest-CreateVolumesFromImageTest-542036154 None] Lock "cinder-d2f80c99-d253-4a13-8242-904d14285b25-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:13:20 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-d58c8273-ef5b-419b-af5a-27d2d54e751a tempest-CreateVolumesFromImageTest-542036154 None] Acquiring lock "cinder-quobyte-d2f80c99-d253-4a13-8242-904d14285b25" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:13:20 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-d58c8273-ef5b-419b-af5a-27d2d54e751a tempest-CreateVolumesFromImageTest-542036154 None] Lock "cinder-quobyte-d2f80c99-d253-4a13-8242-904d14285b25" acquired by "delete_volume" :: waited 0.010s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:13:20 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc3e652e-a83c-4ec4-af58-2e0c34446802]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:13:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d58c8273-ef5b-419b-af5a-27d2d54e751a tempest-CreateVolumesFromImageTest-542036154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d2f80c99-d253-4a13-8242-904d14285b25 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:20 devstack sudo[89836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d2f80c99-d253-4a13-8242-904d14285b25
Apr 15 20:13:20 devstack sudo[89836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:20 devstack sudo[89836]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d58c8273-ef5b-419b-af5a-27d2d54e751a tempest-CreateVolumesFromImageTest-542036154 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d2f80c99-d253-4a13-8242-904d14285b25" returned: 0 in 0.503s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d58c8273-ef5b-419b-af5a-27d2d54e751a tempest-CreateVolumesFromImageTest-542036154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d2f80c99-d253-4a13-8242-904d14285b25 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:20 devstack sudo[89841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d2f80c99-d253-4a13-8242-904d14285b25
Apr 15 20:13:20 devstack sudo[89841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:21 devstack sudo[89841]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d58c8273-ef5b-419b-af5a-27d2d54e751a tempest-CreateVolumesFromImageTest-542036154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d2f80c99-d253-4a13-8242-904d14285b25" returned: 0 in 0.400s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:21 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-d58c8273-ef5b-419b-af5a-27d2d54e751a tempest-CreateVolumesFromImageTest-542036154 None] Lock "cinder-quobyte-d2f80c99-d253-4a13-8242-904d14285b25" released by "delete_volume" :: held 0.929s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:13:21 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-d58c8273-ef5b-419b-af5a-27d2d54e751a tempest-CreateVolumesFromImageTest-542036154 None] Created reservations ['849df438-2c4b-48ad-b920-d54137fe6064', 'd68a130b-2675-45b0-ac03-24087d5b7162', 'a24a5812-0eff-4881-be57-82216c50bd2b', '4014991e-5079-44e1-b49d-9687ab2d0f1e'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:13:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-d58c8273-ef5b-419b-af5a-27d2d54e751a tempest-CreateVolumesFromImageTest-542036154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:13:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-d58c8273-ef5b-419b-af5a-27d2d54e751a tempest-CreateVolumesFromImageTest-542036154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:13:21 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-d58c8273-ef5b-419b-af5a-27d2d54e751a tempest-CreateVolumesFromImageTest-542036154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:13:21 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-d58c8273-ef5b-419b-af5a-27d2d54e751a tempest-CreateVolumesFromImageTest-542036154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:13:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-d58c8273-ef5b-419b-af5a-27d2d54e751a tempest-CreateVolumesFromImageTest-542036154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:13:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d58c8273-ef5b-419b-af5a-27d2d54e751a tempest-CreateVolumesFromImageTest-542036154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:21 devstack sudo[89844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:13:21 devstack sudo[89844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:21 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-bede88f5-86bd-4aca-9563-c1e417ee4ad6 tempest-CreateVolumesFromImageTest-542036154 None] Acquiring lock "cinder-46a8775d-1aa1-444f-9cfa-7dee4aae53bc-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:13:21 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-bede88f5-86bd-4aca-9563-c1e417ee4ad6 tempest-CreateVolumesFromImageTest-542036154 None] Lock "cinder-46a8775d-1aa1-444f-9cfa-7dee4aae53bc-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:13:21 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-bede88f5-86bd-4aca-9563-c1e417ee4ad6 tempest-CreateVolumesFromImageTest-542036154 None] Acquiring lock "cinder-quobyte-46a8775d-1aa1-444f-9cfa-7dee4aae53bc" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:13:21 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-bede88f5-86bd-4aca-9563-c1e417ee4ad6 tempest-CreateVolumesFromImageTest-542036154 None] Lock "cinder-quobyte-46a8775d-1aa1-444f-9cfa-7dee4aae53bc" acquired by "delete_volume" :: waited 0.011s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:13:21 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a29960-c2a4-4052-a000-390418eab61a]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:13:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bede88f5-86bd-4aca-9563-c1e417ee4ad6 tempest-CreateVolumesFromImageTest-542036154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46a8775d-1aa1-444f-9cfa-7dee4aae53bc {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:21 devstack sudo[89846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46a8775d-1aa1-444f-9cfa-7dee4aae53bc
Apr 15 20:13:21 devstack sudo[89846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:21 devstack sudo[89844]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d58c8273-ef5b-419b-af5a-27d2d54e751a tempest-CreateVolumesFromImageTest-542036154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.444s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:21 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-d58c8273-ef5b-419b-af5a-27d2d54e751a tempest-CreateVolumesFromImageTest-542036154 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:13:21 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-d58c8273-ef5b-419b-af5a-27d2d54e751a tempest-CreateVolumesFromImageTest-542036154 None] Deleted volume successfully.
Apr 15 20:13:21 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-d58c8273-ef5b-419b-af5a-27d2d54e751a tempest-CreateVolumesFromImageTest-542036154 None] Lock "cinder-d2f80c99-d253-4a13-8242-904d14285b25-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:13:22 devstack sudo[89846]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bede88f5-86bd-4aca-9563-c1e417ee4ad6 tempest-CreateVolumesFromImageTest-542036154 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46a8775d-1aa1-444f-9cfa-7dee4aae53bc" returned: 0 in 0.531s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bede88f5-86bd-4aca-9563-c1e417ee4ad6 tempest-CreateVolumesFromImageTest-542036154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46a8775d-1aa1-444f-9cfa-7dee4aae53bc {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:22 devstack sudo[89852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46a8775d-1aa1-444f-9cfa-7dee4aae53bc
Apr 15 20:13:22 devstack sudo[89852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:22 devstack sudo[89852]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bede88f5-86bd-4aca-9563-c1e417ee4ad6 tempest-CreateVolumesFromImageTest-542036154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46a8775d-1aa1-444f-9cfa-7dee4aae53bc" returned: 0 in 0.436s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:22 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-bede88f5-86bd-4aca-9563-c1e417ee4ad6 tempest-CreateVolumesFromImageTest-542036154 None] Lock "cinder-quobyte-46a8775d-1aa1-444f-9cfa-7dee4aae53bc" released by "delete_volume" :: held 0.992s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:13:22 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-bede88f5-86bd-4aca-9563-c1e417ee4ad6 tempest-CreateVolumesFromImageTest-542036154 None] Created reservations ['aee3a3a7-fa15-49c3-a28a-bde9d71fce42', 'e3b87e0e-4aaa-4371-8781-922baa5abda4', 'b5ac88d9-7e91-4f25-88be-b1688bfc3d63', 'f528b61c-d1a1-41a0-9b0d-63013ad30d0f'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:13:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-bede88f5-86bd-4aca-9563-c1e417ee4ad6 tempest-CreateVolumesFromImageTest-542036154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:13:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-bede88f5-86bd-4aca-9563-c1e417ee4ad6 tempest-CreateVolumesFromImageTest-542036154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:13:22 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-bede88f5-86bd-4aca-9563-c1e417ee4ad6 tempest-CreateVolumesFromImageTest-542036154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:13:22 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-bede88f5-86bd-4aca-9563-c1e417ee4ad6 tempest-CreateVolumesFromImageTest-542036154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:13:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-bede88f5-86bd-4aca-9563-c1e417ee4ad6 tempest-CreateVolumesFromImageTest-542036154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:13:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bede88f5-86bd-4aca-9563-c1e417ee4ad6 tempest-CreateVolumesFromImageTest-542036154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:22 devstack sudo[89855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:13:22 devstack sudo[89855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:22 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-5f18f71e-0649-47b8-bca8-3de0a9f2c638 tempest-CreateVolumesFromImageTest-542036154 None] Acquiring lock "cinder-9a19fb6a-dec7-4a24-a2dc-1900a2c9105f-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:13:22 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-5f18f71e-0649-47b8-bca8-3de0a9f2c638 tempest-CreateVolumesFromImageTest-542036154 None] Lock "cinder-9a19fb6a-dec7-4a24-a2dc-1900a2c9105f-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:13:22 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-5f18f71e-0649-47b8-bca8-3de0a9f2c638 tempest-CreateVolumesFromImageTest-542036154 None] Acquiring lock "cinder-quobyte-9a19fb6a-dec7-4a24-a2dc-1900a2c9105f" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:13:22 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-5f18f71e-0649-47b8-bca8-3de0a9f2c638 tempest-CreateVolumesFromImageTest-542036154 None] Lock "cinder-quobyte-9a19fb6a-dec7-4a24-a2dc-1900a2c9105f" acquired by "delete_volume" :: waited 0.007s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:13:22 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4b1c7e-87b7-429d-8720-9a31a67b2e28]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:13:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5f18f71e-0649-47b8-bca8-3de0a9f2c638 tempest-CreateVolumesFromImageTest-542036154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9a19fb6a-dec7-4a24-a2dc-1900a2c9105f {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:22 devstack sudo[89857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9a19fb6a-dec7-4a24-a2dc-1900a2c9105f
Apr 15 20:13:22 devstack sudo[89857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:23 devstack sudo[89855]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:23 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bede88f5-86bd-4aca-9563-c1e417ee4ad6 tempest-CreateVolumesFromImageTest-542036154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.457s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:23 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-bede88f5-86bd-4aca-9563-c1e417ee4ad6 tempest-CreateVolumesFromImageTest-542036154 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:13:23 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-bede88f5-86bd-4aca-9563-c1e417ee4ad6 tempest-CreateVolumesFromImageTest-542036154 None] Deleted volume successfully.
Apr 15 20:13:23 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-bede88f5-86bd-4aca-9563-c1e417ee4ad6 tempest-CreateVolumesFromImageTest-542036154 None] Lock "cinder-46a8775d-1aa1-444f-9cfa-7dee4aae53bc-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:13:23 devstack sudo[89857]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:23 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5f18f71e-0649-47b8-bca8-3de0a9f2c638 tempest-CreateVolumesFromImageTest-542036154 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9a19fb6a-dec7-4a24-a2dc-1900a2c9105f" returned: 0 in 0.514s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:23 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5f18f71e-0649-47b8-bca8-3de0a9f2c638 tempest-CreateVolumesFromImageTest-542036154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9a19fb6a-dec7-4a24-a2dc-1900a2c9105f {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:23 devstack sudo[89863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9a19fb6a-dec7-4a24-a2dc-1900a2c9105f
Apr 15 20:13:23 devstack sudo[89863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:23 devstack sudo[89863]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:23 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5f18f71e-0649-47b8-bca8-3de0a9f2c638 tempest-CreateVolumesFromImageTest-542036154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9a19fb6a-dec7-4a24-a2dc-1900a2c9105f" returned: 0 in 0.427s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:23 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-5f18f71e-0649-47b8-bca8-3de0a9f2c638 tempest-CreateVolumesFromImageTest-542036154 None] Lock "cinder-quobyte-9a19fb6a-dec7-4a24-a2dc-1900a2c9105f" released by "delete_volume" :: held 0.962s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:13:23 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-5f18f71e-0649-47b8-bca8-3de0a9f2c638 tempest-CreateVolumesFromImageTest-542036154 None] Created reservations ['72388aa9-9b6a-4ca8-ba96-3d4c1b8a3070', 'f94aa7b3-bb33-4ae5-837a-fd6c3f4ed8ee', 'f8d33097-17d5-46f9-9f79-08c661e6d74b', '02c82113-e0dd-4045-9794-eabf28130691'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:13:23 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-5f18f71e-0649-47b8-bca8-3de0a9f2c638 tempest-CreateVolumesFromImageTest-542036154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:13:23 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-5f18f71e-0649-47b8-bca8-3de0a9f2c638 tempest-CreateVolumesFromImageTest-542036154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:13:23 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-5f18f71e-0649-47b8-bca8-3de0a9f2c638 tempest-CreateVolumesFromImageTest-542036154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:13:23 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-5f18f71e-0649-47b8-bca8-3de0a9f2c638 tempest-CreateVolumesFromImageTest-542036154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:13:23 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-5f18f71e-0649-47b8-bca8-3de0a9f2c638 tempest-CreateVolumesFromImageTest-542036154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:13:23 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5f18f71e-0649-47b8-bca8-3de0a9f2c638 tempest-CreateVolumesFromImageTest-542036154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:23 devstack sudo[89866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:13:23 devstack sudo[89866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:23 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-cfa6dd9b-0b22-4413-97ac-4127b119b09b tempest-CreateVolumesFromImageTest-542036154 None] Acquiring lock "cinder-f715b55a-acf6-4379-a850-ab065b8df5e9-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:13:23 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-cfa6dd9b-0b22-4413-97ac-4127b119b09b tempest-CreateVolumesFromImageTest-542036154 None] Lock "cinder-f715b55a-acf6-4379-a850-ab065b8df5e9-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:13:23 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-cfa6dd9b-0b22-4413-97ac-4127b119b09b tempest-CreateVolumesFromImageTest-542036154 None] Acquiring lock "cinder-quobyte-f715b55a-acf6-4379-a850-ab065b8df5e9" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:13:23 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-cfa6dd9b-0b22-4413-97ac-4127b119b09b tempest-CreateVolumesFromImageTest-542036154 None] Lock "cinder-quobyte-f715b55a-acf6-4379-a850-ab065b8df5e9" acquired by "delete_volume" :: waited 0.008s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:13:23 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[3017ef6c-96af-4351-a207-4d8b608f6ef8]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:13:23 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-cfa6dd9b-0b22-4413-97ac-4127b119b09b tempest-CreateVolumesFromImageTest-542036154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f715b55a-acf6-4379-a850-ab065b8df5e9 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:23 devstack sudo[89868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f715b55a-acf6-4379-a850-ab065b8df5e9
Apr 15 20:13:23 devstack sudo[89868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:24 devstack sudo[89866]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5f18f71e-0649-47b8-bca8-3de0a9f2c638 tempest-CreateVolumesFromImageTest-542036154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.421s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:24 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-5f18f71e-0649-47b8-bca8-3de0a9f2c638 tempest-CreateVolumesFromImageTest-542036154 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:13:24 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-5f18f71e-0649-47b8-bca8-3de0a9f2c638 tempest-CreateVolumesFromImageTest-542036154 None] Deleted volume successfully.
Apr 15 20:13:24 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-5f18f71e-0649-47b8-bca8-3de0a9f2c638 tempest-CreateVolumesFromImageTest-542036154 None] Lock "cinder-9a19fb6a-dec7-4a24-a2dc-1900a2c9105f-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:13:24 devstack sudo[89868]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-cfa6dd9b-0b22-4413-97ac-4127b119b09b tempest-CreateVolumesFromImageTest-542036154 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f715b55a-acf6-4379-a850-ab065b8df5e9" returned: 0 in 0.471s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-cfa6dd9b-0b22-4413-97ac-4127b119b09b tempest-CreateVolumesFromImageTest-542036154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f715b55a-acf6-4379-a850-ab065b8df5e9 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:24 devstack sudo[89874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f715b55a-acf6-4379-a850-ab065b8df5e9
Apr 15 20:13:24 devstack sudo[89874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:24 devstack sudo[89874]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-cfa6dd9b-0b22-4413-97ac-4127b119b09b tempest-CreateVolumesFromImageTest-542036154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f715b55a-acf6-4379-a850-ab065b8df5e9" returned: 0 in 0.393s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:24 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-cfa6dd9b-0b22-4413-97ac-4127b119b09b tempest-CreateVolumesFromImageTest-542036154 None] Lock "cinder-quobyte-f715b55a-acf6-4379-a850-ab065b8df5e9" released by "delete_volume" :: held 0.886s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:13:24 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-cfa6dd9b-0b22-4413-97ac-4127b119b09b tempest-CreateVolumesFromImageTest-542036154 None] Created reservations ['34886443-22ce-46e8-86a1-fdf3571f04d9', '7f541a45-83bf-4f64-899f-155d9240c965', '236118d2-0f6e-480c-a276-a5b1d84fa268', '450d0902-ad39-43f5-b688-ade8881c04c8'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:13:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-cfa6dd9b-0b22-4413-97ac-4127b119b09b tempest-CreateVolumesFromImageTest-542036154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:13:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-cfa6dd9b-0b22-4413-97ac-4127b119b09b tempest-CreateVolumesFromImageTest-542036154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:13:24 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-cfa6dd9b-0b22-4413-97ac-4127b119b09b tempest-CreateVolumesFromImageTest-542036154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:13:24 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-cfa6dd9b-0b22-4413-97ac-4127b119b09b tempest-CreateVolumesFromImageTest-542036154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:13:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-cfa6dd9b-0b22-4413-97ac-4127b119b09b tempest-CreateVolumesFromImageTest-542036154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:13:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-cfa6dd9b-0b22-4413-97ac-4127b119b09b tempest-CreateVolumesFromImageTest-542036154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:24 devstack sudo[89877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:13:24 devstack sudo[89877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:24 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-db2a7998-c6c0-4f0a-a207-0ba136ded7fc tempest-CreateVolumesFromImageTest-542036154 None] Acquiring lock "cinder-d924a44a-cf05-463a-98d4-66329b276701-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:13:24 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-db2a7998-c6c0-4f0a-a207-0ba136ded7fc tempest-CreateVolumesFromImageTest-542036154 None] Lock "cinder-d924a44a-cf05-463a-98d4-66329b276701-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:13:24 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-db2a7998-c6c0-4f0a-a207-0ba136ded7fc tempest-CreateVolumesFromImageTest-542036154 None] Acquiring lock "cinder-quobyte-d924a44a-cf05-463a-98d4-66329b276701" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:13:24 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-db2a7998-c6c0-4f0a-a207-0ba136ded7fc tempest-CreateVolumesFromImageTest-542036154 None] Lock "cinder-quobyte-d924a44a-cf05-463a-98d4-66329b276701" acquired by "delete_volume" :: waited 0.009s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:13:24 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[938f53e8-392f-4ec7-9963-0d2ff2dbe6ce]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:13:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-db2a7998-c6c0-4f0a-a207-0ba136ded7fc tempest-CreateVolumesFromImageTest-542036154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d924a44a-cf05-463a-98d4-66329b276701 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:25 devstack sudo[89879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d924a44a-cf05-463a-98d4-66329b276701
Apr 15 20:13:25 devstack sudo[89879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:25 devstack sudo[89877]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:25 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-cfa6dd9b-0b22-4413-97ac-4127b119b09b tempest-CreateVolumesFromImageTest-542036154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.426s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:25 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-cfa6dd9b-0b22-4413-97ac-4127b119b09b tempest-CreateVolumesFromImageTest-542036154 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:13:25 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-cfa6dd9b-0b22-4413-97ac-4127b119b09b tempest-CreateVolumesFromImageTest-542036154 None] Deleted volume successfully.
Apr 15 20:13:25 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-cfa6dd9b-0b22-4413-97ac-4127b119b09b tempest-CreateVolumesFromImageTest-542036154 None] Lock "cinder-f715b55a-acf6-4379-a850-ab065b8df5e9-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:13:25 devstack sudo[89879]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:25 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-db2a7998-c6c0-4f0a-a207-0ba136ded7fc tempest-CreateVolumesFromImageTest-542036154 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d924a44a-cf05-463a-98d4-66329b276701" returned: 0 in 0.482s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:25 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-db2a7998-c6c0-4f0a-a207-0ba136ded7fc tempest-CreateVolumesFromImageTest-542036154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d924a44a-cf05-463a-98d4-66329b276701 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:25 devstack sudo[89885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d924a44a-cf05-463a-98d4-66329b276701
Apr 15 20:13:25 devstack sudo[89885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:25 devstack sudo[89885]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:25 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-db2a7998-c6c0-4f0a-a207-0ba136ded7fc tempest-CreateVolumesFromImageTest-542036154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d924a44a-cf05-463a-98d4-66329b276701" returned: 0 in 0.408s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:25 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-db2a7998-c6c0-4f0a-a207-0ba136ded7fc tempest-CreateVolumesFromImageTest-542036154 None] Lock "cinder-quobyte-d924a44a-cf05-463a-98d4-66329b276701" released by "delete_volume" :: held 0.913s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:13:25 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-db2a7998-c6c0-4f0a-a207-0ba136ded7fc tempest-CreateVolumesFromImageTest-542036154 None] Created reservations ['7d2c94f9-8160-4b0e-ad54-e5ed7726289a', '9b34606b-03c6-4c43-8e71-e50f86d114e3', '579f7a8e-450a-47d3-8ee0-344bf9b1b4bb', '3e3184ca-4f93-4539-9a17-e441d93fcaac'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:13:25 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-db2a7998-c6c0-4f0a-a207-0ba136ded7fc tempest-CreateVolumesFromImageTest-542036154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:13:25 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-db2a7998-c6c0-4f0a-a207-0ba136ded7fc tempest-CreateVolumesFromImageTest-542036154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:13:25 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-db2a7998-c6c0-4f0a-a207-0ba136ded7fc tempest-CreateVolumesFromImageTest-542036154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:13:25 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-db2a7998-c6c0-4f0a-a207-0ba136ded7fc tempest-CreateVolumesFromImageTest-542036154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:13:25 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-db2a7998-c6c0-4f0a-a207-0ba136ded7fc tempest-CreateVolumesFromImageTest-542036154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:13:25 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-db2a7998-c6c0-4f0a-a207-0ba136ded7fc tempest-CreateVolumesFromImageTest-542036154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:25 devstack sudo[89888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:13:25 devstack sudo[89888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:26 devstack sudo[89888]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:26 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-db2a7998-c6c0-4f0a-a207-0ba136ded7fc tempest-CreateVolumesFromImageTest-542036154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.515s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:26 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-db2a7998-c6c0-4f0a-a207-0ba136ded7fc tempest-CreateVolumesFromImageTest-542036154 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:13:26 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-db2a7998-c6c0-4f0a-a207-0ba136ded7fc tempest-CreateVolumesFromImageTest-542036154 None] Deleted volume successfully.
Apr 15 20:13:26 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-db2a7998-c6c0-4f0a-a207-0ba136ded7fc tempest-CreateVolumesFromImageTest-542036154 None] Lock "cinder-d924a44a-cf05-463a-98d4-66329b276701-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:13:27 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba9e3f20-ef5a-4ac0-817d-01dfbb424cb4 tempest-CinderUnicodeTest-1780299941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:13:27 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ba9e3f20-ef5a-4ac0-817d-01dfbb424cb4 tempest-CinderUnicodeTest-1780299941 None] Flow 'volume_create_manager' (e88be5ff-28d5-4eb8-93c8-288e970809fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:13:27 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ba9e3f20-ef5a-4ac0-817d-01dfbb424cb4 tempest-CinderUnicodeTest-1780299941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f78113b-9e4e-4ddc-b6f3-900b9397944e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:27 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ba9e3f20-ef5a-4ac0-817d-01dfbb424cb4 tempest-CinderUnicodeTest-1780299941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f78113b-9e4e-4ddc-b6f3-900b9397944e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:13:28Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a20cc3e-2472-40ca-a604-4d6241d8a402,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcf37d653911476995c7082fa6f728aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:13:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:13:28Z,use_quota=True,user_id='44fab3cf1d884204967e35e26ded1fc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:27 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ba9e3f20-ef5a-4ac0-817d-01dfbb424cb4 tempest-CinderUnicodeTest-1780299941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b76a62d1-3279-4758-bf32-9fd17d8c2003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:27 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ba9e3f20-ef5a-4ac0-817d-01dfbb424cb4 tempest-CinderUnicodeTest-1780299941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b76a62d1-3279-4758-bf32-9fd17d8c2003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:27 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ba9e3f20-ef5a-4ac0-817d-01dfbb424cb4 tempest-CinderUnicodeTest-1780299941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b490dc47-a02d-46d9-a513-38adb9c87b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:27 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ba9e3f20-ef5a-4ac0-817d-01dfbb424cb4 tempest-CinderUnicodeTest-1780299941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b490dc47-a02d-46d9-a513-38adb9c87b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a20cc3e-2472-40ca-a604-4d6241d8a402', 'volume_name': 'volume-0a20cc3e-2472-40ca-a604-4d6241d8a402', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:27 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ba9e3f20-ef5a-4ac0-817d-01dfbb424cb4 tempest-CinderUnicodeTest-1780299941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4090b780-5bb3-4b77-8bf5-27afd1c499fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:27 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ba9e3f20-ef5a-4ac0-817d-01dfbb424cb4 tempest-CinderUnicodeTest-1780299941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4090b780-5bb3-4b77-8bf5-27afd1c499fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:27 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ba9e3f20-ef5a-4ac0-817d-01dfbb424cb4 tempest-CinderUnicodeTest-1780299941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4b1acb2-cec4-44cf-9307-ca7ea1d2487b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:27 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-ba9e3f20-ef5a-4ac0-817d-01dfbb424cb4 tempest-CinderUnicodeTest-1780299941 None] Volume 0a20cc3e-2472-40ca-a604-4d6241d8a402: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a20cc3e-2472-40ca-a604-4d6241d8a402', 'volume_size': 1}
Apr 15 20:13:27 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-ba9e3f20-ef5a-4ac0-817d-01dfbb424cb4 tempest-CinderUnicodeTest-1780299941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:13:27 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-ba9e3f20-ef5a-4ac0-817d-01dfbb424cb4 tempest-CinderUnicodeTest-1780299941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:13:27 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-ba9e3f20-ef5a-4ac0-817d-01dfbb424cb4 tempest-CinderUnicodeTest-1780299941 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:13:28Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a20cc3e-2472-40ca-a604-4d6241d8a402,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcf37d653911476995c7082fa6f728aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:13:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:13:28Z,use_quota=True,user_id='44fab3cf1d884204967e35e26ded1fc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:13:27 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-ba9e3f20-ef5a-4ac0-817d-01dfbb424cb4 tempest-CinderUnicodeTest-1780299941 None] Creating volume 0a20cc3e-2472-40ca-a604-4d6241d8a402 {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:13:27 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-ba9e3f20-ef5a-4ac0-817d-01dfbb424cb4 tempest-CinderUnicodeTest-1780299941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:13:27 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-ba9e3f20-ef5a-4ac0-817d-01dfbb424cb4 tempest-CinderUnicodeTest-1780299941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:13:27 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-ba9e3f20-ef5a-4ac0-817d-01dfbb424cb4 tempest-CinderUnicodeTest-1780299941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:13:27 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-ba9e3f20-ef5a-4ac0-817d-01dfbb424cb4 tempest-CinderUnicodeTest-1780299941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:13:27 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-ba9e3f20-ef5a-4ac0-817d-01dfbb424cb4 tempest-CinderUnicodeTest-1780299941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:13:27 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-ba9e3f20-ef5a-4ac0-817d-01dfbb424cb4 tempest-CinderUnicodeTest-1780299941 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:13:27 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-ba9e3f20-ef5a-4ac0-817d-01dfbb424cb4 tempest-CinderUnicodeTest-1780299941 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:13:27 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-ba9e3f20-ef5a-4ac0-817d-01dfbb424cb4 tempest-CinderUnicodeTest-1780299941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0a20cc3e-2472-40ca-a604-4d6241d8a402 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:27 devstack sudo[89892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0a20cc3e-2472-40ca-a604-4d6241d8a402 1073741824
Apr 15 20:13:27 devstack sudo[89892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:28 devstack sudo[89892]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:28 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-ba9e3f20-ef5a-4ac0-817d-01dfbb424cb4 tempest-CinderUnicodeTest-1780299941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0a20cc3e-2472-40ca-a604-4d6241d8a402 1073741824" returned: 0 in 0.568s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:28 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-ba9e3f20-ef5a-4ac0-817d-01dfbb424cb4 tempest-CinderUnicodeTest-1780299941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0a20cc3e-2472-40ca-a604-4d6241d8a402 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:28 devstack sudo[89897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0a20cc3e-2472-40ca-a604-4d6241d8a402
Apr 15 20:13:28 devstack sudo[89897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:28 devstack sudo[89897]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:28 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-ba9e3f20-ef5a-4ac0-817d-01dfbb424cb4 tempest-CinderUnicodeTest-1780299941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0a20cc3e-2472-40ca-a604-4d6241d8a402" returned: 0 in 0.529s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:28 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-ba9e3f20-ef5a-4ac0-817d-01dfbb424cb4 tempest-CinderUnicodeTest-1780299941 None] <== create_volume: return (1130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:13:28 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-ba9e3f20-ef5a-4ac0-817d-01dfbb424cb4 tempest-CinderUnicodeTest-1780299941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:13:28 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ba9e3f20-ef5a-4ac0-817d-01dfbb424cb4 tempest-CinderUnicodeTest-1780299941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4b1acb2-cec4-44cf-9307-ca7ea1d2487b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a20cc3e-2472-40ca-a604-4d6241d8a402', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:28 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ba9e3f20-ef5a-4ac0-817d-01dfbb424cb4 tempest-CinderUnicodeTest-1780299941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff7bcef9-96af-49c0-a2ce-3cf2e0b27242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:28 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-ba9e3f20-ef5a-4ac0-817d-01dfbb424cb4 tempest-CinderUnicodeTest-1780299941 None] Volume volume-0a20cc3e-2472-40ca-a604-4d6241d8a402 (0a20cc3e-2472-40ca-a604-4d6241d8a402): created successfully
Apr 15 20:13:28 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ba9e3f20-ef5a-4ac0-817d-01dfbb424cb4 tempest-CinderUnicodeTest-1780299941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff7bcef9-96af-49c0-a2ce-3cf2e0b27242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:28 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ba9e3f20-ef5a-4ac0-817d-01dfbb424cb4 tempest-CinderUnicodeTest-1780299941 None] Flow 'volume_create_manager' (e88be5ff-28d5-4eb8-93c8-288e970809fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:13:29 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-ba9e3f20-ef5a-4ac0-817d-01dfbb424cb4 tempest-CinderUnicodeTest-1780299941 None] Created volume successfully.
Apr 15 20:13:30 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0f941c8-d359-4901-b238-b2e22999eb3d tempest-CinderUnicodeTest-1780299941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:13:30 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e0f941c8-d359-4901-b238-b2e22999eb3d tempest-CinderUnicodeTest-1780299941 None] Flow 'volume_create_manager' (bd1acc36-ff00-483e-b641-db54a90cf65f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:13:30 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e0f941c8-d359-4901-b238-b2e22999eb3d tempest-CinderUnicodeTest-1780299941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0a3b057-f5ce-40a2-aa3f-9fddf03a5806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:30 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e0f941c8-d359-4901-b238-b2e22999eb3d tempest-CinderUnicodeTest-1780299941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0a3b057-f5ce-40a2-aa3f-9fddf03a5806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:13:30Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1587855090',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=089ebde4-d42b-4d9f-bd88-58a820b97878,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcf37d653911476995c7082fa6f728aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:13:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:13:30Z,use_quota=True,user_id='44fab3cf1d884204967e35e26ded1fc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:30 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e0f941c8-d359-4901-b238-b2e22999eb3d tempest-CinderUnicodeTest-1780299941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (577276dd-0c07-4209-a3f1-5ca08774512f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:30 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e0f941c8-d359-4901-b238-b2e22999eb3d tempest-CinderUnicodeTest-1780299941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (577276dd-0c07-4209-a3f1-5ca08774512f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:30 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e0f941c8-d359-4901-b238-b2e22999eb3d tempest-CinderUnicodeTest-1780299941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1b749a3-a261-47f0-be98-3883ed0b2119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:30 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e0f941c8-d359-4901-b238-b2e22999eb3d tempest-CinderUnicodeTest-1780299941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1b749a3-a261-47f0-be98-3883ed0b2119) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '089ebde4-d42b-4d9f-bd88-58a820b97878', 'volume_name': 'volume-089ebde4-d42b-4d9f-bd88-58a820b97878', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:30 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e0f941c8-d359-4901-b238-b2e22999eb3d tempest-CinderUnicodeTest-1780299941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8dfb860-4580-4438-aa9b-b2df8b188276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:30 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e0f941c8-d359-4901-b238-b2e22999eb3d tempest-CinderUnicodeTest-1780299941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8dfb860-4580-4438-aa9b-b2df8b188276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:30 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e0f941c8-d359-4901-b238-b2e22999eb3d tempest-CinderUnicodeTest-1780299941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ebcbb96-869d-46aa-b908-e7b1d6bb17ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:30 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-e0f941c8-d359-4901-b238-b2e22999eb3d tempest-CinderUnicodeTest-1780299941 None] Volume 089ebde4-d42b-4d9f-bd88-58a820b97878: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-089ebde4-d42b-4d9f-bd88-58a820b97878', 'volume_size': 1}
Apr 15 20:13:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-e0f941c8-d359-4901-b238-b2e22999eb3d tempest-CinderUnicodeTest-1780299941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:13:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-e0f941c8-d359-4901-b238-b2e22999eb3d tempest-CinderUnicodeTest-1780299941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:13:30 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-e0f941c8-d359-4901-b238-b2e22999eb3d tempest-CinderUnicodeTest-1780299941 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:13:30Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1587855090',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=089ebde4-d42b-4d9f-bd88-58a820b97878,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcf37d653911476995c7082fa6f728aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:13:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:13:30Z,use_quota=True,user_id='44fab3cf1d884204967e35e26ded1fc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:13:30 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-e0f941c8-d359-4901-b238-b2e22999eb3d tempest-CinderUnicodeTest-1780299941 None] Creating volume 089ebde4-d42b-4d9f-bd88-58a820b97878 {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:13:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-e0f941c8-d359-4901-b238-b2e22999eb3d tempest-CinderUnicodeTest-1780299941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:13:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-e0f941c8-d359-4901-b238-b2e22999eb3d tempest-CinderUnicodeTest-1780299941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:13:30 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-e0f941c8-d359-4901-b238-b2e22999eb3d tempest-CinderUnicodeTest-1780299941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:13:30 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-e0f941c8-d359-4901-b238-b2e22999eb3d tempest-CinderUnicodeTest-1780299941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:13:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-e0f941c8-d359-4901-b238-b2e22999eb3d tempest-CinderUnicodeTest-1780299941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:13:30 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-e0f941c8-d359-4901-b238-b2e22999eb3d tempest-CinderUnicodeTest-1780299941 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:13:30 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-e0f941c8-d359-4901-b238-b2e22999eb3d tempest-CinderUnicodeTest-1780299941 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:13:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e0f941c8-d359-4901-b238-b2e22999eb3d tempest-CinderUnicodeTest-1780299941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-089ebde4-d42b-4d9f-bd88-58a820b97878 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:30 devstack sudo[89901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-089ebde4-d42b-4d9f-bd88-58a820b97878 1073741824
Apr 15 20:13:30 devstack sudo[89901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:30 devstack sudo[89901]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e0f941c8-d359-4901-b238-b2e22999eb3d tempest-CinderUnicodeTest-1780299941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-089ebde4-d42b-4d9f-bd88-58a820b97878 1073741824" returned: 0 in 0.589s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e0f941c8-d359-4901-b238-b2e22999eb3d tempest-CinderUnicodeTest-1780299941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-089ebde4-d42b-4d9f-bd88-58a820b97878 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:30 devstack sudo[89906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-089ebde4-d42b-4d9f-bd88-58a820b97878
Apr 15 20:13:30 devstack sudo[89906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:31 devstack sudo[89906]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e0f941c8-d359-4901-b238-b2e22999eb3d tempest-CinderUnicodeTest-1780299941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-089ebde4-d42b-4d9f-bd88-58a820b97878" returned: 0 in 0.500s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:31 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-e0f941c8-d359-4901-b238-b2e22999eb3d tempest-CinderUnicodeTest-1780299941 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:13:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-e0f941c8-d359-4901-b238-b2e22999eb3d tempest-CinderUnicodeTest-1780299941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:13:31 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e0f941c8-d359-4901-b238-b2e22999eb3d tempest-CinderUnicodeTest-1780299941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ebcbb96-869d-46aa-b908-e7b1d6bb17ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-089ebde4-d42b-4d9f-bd88-58a820b97878', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:31 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e0f941c8-d359-4901-b238-b2e22999eb3d tempest-CinderUnicodeTest-1780299941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (965ce3dd-8d3c-4ae3-9e89-2efc866c23f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:31 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-e0f941c8-d359-4901-b238-b2e22999eb3d tempest-CinderUnicodeTest-1780299941 None] Volume volume-089ebde4-d42b-4d9f-bd88-58a820b97878 (089ebde4-d42b-4d9f-bd88-58a820b97878): created successfully
Apr 15 20:13:31 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e0f941c8-d359-4901-b238-b2e22999eb3d tempest-CinderUnicodeTest-1780299941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (965ce3dd-8d3c-4ae3-9e89-2efc866c23f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:31 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e0f941c8-d359-4901-b238-b2e22999eb3d tempest-CinderUnicodeTest-1780299941 None] Flow 'volume_create_manager' (bd1acc36-ff00-483e-b641-db54a90cf65f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:13:31 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-e0f941c8-d359-4901-b238-b2e22999eb3d tempest-CinderUnicodeTest-1780299941 None] Created volume successfully.
Apr 15 20:13:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-b4ab4421-9076-4b20-b0e7-0ea86bce41a2 tempest-CinderUnicodeTest-1780299941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:13:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-b4ab4421-9076-4b20-b0e7-0ea86bce41a2 tempest-CinderUnicodeTest-1780299941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:13:32 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-b4ab4421-9076-4b20-b0e7-0ea86bce41a2 tempest-CinderUnicodeTest-1780299941 None] Creating offline snapshot 8403111a-4748-4a77-8a31-30e4063153fd of volume 089ebde4-d42b-4d9f-bd88-58a820b97878 {{(pid=82646) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 20:13:32 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d46d87-64b1-4135-a2d7-591242aca71d]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:13:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b4ab4421-9076-4b20-b0e7-0ea86bce41a2 tempest-CinderUnicodeTest-1780299941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-089ebde4-d42b-4d9f-bd88-58a820b97878 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:32 devstack sudo[89909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-089ebde4-d42b-4d9f-bd88-58a820b97878
Apr 15 20:13:32 devstack sudo[89909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:33 devstack sudo[89909]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:33 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b4ab4421-9076-4b20-b0e7-0ea86bce41a2 tempest-CinderUnicodeTest-1780299941 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-089ebde4-d42b-4d9f-bd88-58a820b97878" returned: 0 in 0.546s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:33 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b4ab4421-9076-4b20-b0e7-0ea86bce41a2 tempest-CinderUnicodeTest-1780299941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-089ebde4-d42b-4d9f-bd88-58a820b97878,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-089ebde4-d42b-4d9f-bd88-58a820b97878.8403111a-4748-4a77-8a31-30e4063153fd 1G {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:33 devstack sudo[89914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-089ebde4-d42b-4d9f-bd88-58a820b97878,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-089ebde4-d42b-4d9f-bd88-58a820b97878.8403111a-4748-4a77-8a31-30e4063153fd 1G
Apr 15 20:13:33 devstack sudo[89914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:33 devstack sudo[89914]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:33 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b4ab4421-9076-4b20-b0e7-0ea86bce41a2 tempest-CinderUnicodeTest-1780299941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-089ebde4-d42b-4d9f-bd88-58a820b97878,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-089ebde4-d42b-4d9f-bd88-58a820b97878.8403111a-4748-4a77-8a31-30e4063153fd 1G" returned: 0 in 0.557s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:33 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b4ab4421-9076-4b20-b0e7-0ea86bce41a2 tempest-CinderUnicodeTest-1780299941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-089ebde4-d42b-4d9f-bd88-58a820b97878 -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-089ebde4-d42b-4d9f-bd88-58a820b97878.8403111a-4748-4a77-8a31-30e4063153fd {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:33 devstack sudo[89925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-089ebde4-d42b-4d9f-bd88-58a820b97878 -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-089ebde4-d42b-4d9f-bd88-58a820b97878.8403111a-4748-4a77-8a31-30e4063153fd
Apr 15 20:13:33 devstack sudo[89925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:34 devstack sudo[89925]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:34 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b4ab4421-9076-4b20-b0e7-0ea86bce41a2 tempest-CinderUnicodeTest-1780299941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-089ebde4-d42b-4d9f-bd88-58a820b97878 -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-089ebde4-d42b-4d9f-bd88-58a820b97878.8403111a-4748-4a77-8a31-30e4063153fd" returned: 0 in 0.473s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:34 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-b4ab4421-9076-4b20-b0e7-0ea86bce41a2 tempest-CinderUnicodeTest-1780299941 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-089ebde4-d42b-4d9f-bd88-58a820b97878.8403111a-4748-4a77-8a31-30e4063153fd is being set with open permissions: ugo+rw
Apr 15 20:13:34 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b4ab4421-9076-4b20-b0e7-0ea86bce41a2 tempest-CinderUnicodeTest-1780299941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-089ebde4-d42b-4d9f-bd88-58a820b97878.8403111a-4748-4a77-8a31-30e4063153fd {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:34 devstack sudo[89930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-089ebde4-d42b-4d9f-bd88-58a820b97878.8403111a-4748-4a77-8a31-30e4063153fd
Apr 15 20:13:34 devstack sudo[89930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:34 devstack sudo[89930]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:34 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b4ab4421-9076-4b20-b0e7-0ea86bce41a2 tempest-CinderUnicodeTest-1780299941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-089ebde4-d42b-4d9f-bd88-58a820b97878.8403111a-4748-4a77-8a31-30e4063153fd" returned: 0 in 0.409s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:34 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b4ab4421-9076-4b20-b0e7-0ea86bce41a2 tempest-CinderUnicodeTest-1780299941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-089ebde4-d42b-4d9f-bd88-58a820b97878.info {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:34 devstack sudo[89933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-089ebde4-d42b-4d9f-bd88-58a820b97878.info
Apr 15 20:13:34 devstack sudo[89933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:34 devstack sudo[89933]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:34 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b4ab4421-9076-4b20-b0e7-0ea86bce41a2 tempest-CinderUnicodeTest-1780299941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-089ebde4-d42b-4d9f-bd88-58a820b97878.info" returned: 0 in 0.401s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:34 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-b4ab4421-9076-4b20-b0e7-0ea86bce41a2 tempest-CinderUnicodeTest-1780299941 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-089ebde4-d42b-4d9f-bd88-58a820b97878.info is being set with open permissions: ugo+rw
Apr 15 20:13:34 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b4ab4421-9076-4b20-b0e7-0ea86bce41a2 tempest-CinderUnicodeTest-1780299941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-089ebde4-d42b-4d9f-bd88-58a820b97878.info {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:34 devstack sudo[89936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-089ebde4-d42b-4d9f-bd88-58a820b97878.info
Apr 15 20:13:34 devstack sudo[89936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:35 devstack sudo[89936]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:35 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b4ab4421-9076-4b20-b0e7-0ea86bce41a2 tempest-CinderUnicodeTest-1780299941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-089ebde4-d42b-4d9f-bd88-58a820b97878.info" returned: 0 in 0.388s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:35 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-b4ab4421-9076-4b20-b0e7-0ea86bce41a2 tempest-CinderUnicodeTest-1780299941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.842s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:13:35 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-b4ab4421-9076-4b20-b0e7-0ea86bce41a2 tempest-CinderUnicodeTest-1780299941 None] Create snapshot completed successfully
Apr 15 20:13:35 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-415b08e3-a804-4d85-9759-5e32ee7450d2 tempest-CinderUnicodeTest-1780299941 None] Acquiring lock "cinder-8403111a-4748-4a77-8a31-30e4063153fd-delete_snapshot" by "delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:13:35 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-415b08e3-a804-4d85-9759-5e32ee7450d2 tempest-CinderUnicodeTest-1780299941 None] Lock "cinder-8403111a-4748-4a77-8a31-30e4063153fd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:13:35 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-415b08e3-a804-4d85-9759-5e32ee7450d2 tempest-CinderUnicodeTest-1780299941 None] Acquiring lock "cinder-quobyte-089ebde4-d42b-4d9f-bd88-58a820b97878" by "delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:13:35 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-415b08e3-a804-4d85-9759-5e32ee7450d2 tempest-CinderUnicodeTest-1780299941 None] Lock "cinder-quobyte-089ebde4-d42b-4d9f-bd88-58a820b97878" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:13:35 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-415b08e3-a804-4d85-9759-5e32ee7450d2 tempest-CinderUnicodeTest-1780299941 None] Acquiring lock "cinder-quobyte-8403111a-4748-4a77-8a31-30e4063153fd" by "_delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:13:35 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-415b08e3-a804-4d85-9759-5e32ee7450d2 tempest-CinderUnicodeTest-1780299941 None] Lock "cinder-quobyte-8403111a-4748-4a77-8a31-30e4063153fd" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:13:35 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-415b08e3-a804-4d85-9759-5e32ee7450d2 tempest-CinderUnicodeTest-1780299941 None] Deleting offline snapshot 8403111a-4748-4a77-8a31-30e4063153fd of volume 089ebde4-d42b-4d9f-bd88-58a820b97878 {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 20:13:35 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-415b08e3-a804-4d85-9759-5e32ee7450d2 tempest-CinderUnicodeTest-1780299941 None] snapshot_file for this snap is: volume-089ebde4-d42b-4d9f-bd88-58a820b97878.8403111a-4748-4a77-8a31-30e4063153fd {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 20:13:35 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6c45c5-1ea2-4be9-ad5c-b4fc032cb940]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:13:35 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-415b08e3-a804-4d85-9759-5e32ee7450d2 tempest-CinderUnicodeTest-1780299941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-089ebde4-d42b-4d9f-bd88-58a820b97878.8403111a-4748-4a77-8a31-30e4063153fd {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:35 devstack sudo[89939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-089ebde4-d42b-4d9f-bd88-58a820b97878.8403111a-4748-4a77-8a31-30e4063153fd
Apr 15 20:13:35 devstack sudo[89939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:36 devstack sudo[89939]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:36 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-415b08e3-a804-4d85-9759-5e32ee7450d2 tempest-CinderUnicodeTest-1780299941 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-089ebde4-d42b-4d9f-bd88-58a820b97878.8403111a-4748-4a77-8a31-30e4063153fd" returned: 0 in 0.527s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:36 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-415b08e3-a804-4d85-9759-5e32ee7450d2 tempest-CinderUnicodeTest-1780299941 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-089ebde4-d42b-4d9f-bd88-58a820b97878(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82646) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 20:13:36 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[132803b8-14d5-4773-9d96-4c6a3fbedd17]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:13:36 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-415b08e3-a804-4d85-9759-5e32ee7450d2 tempest-CinderUnicodeTest-1780299941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-089ebde4-d42b-4d9f-bd88-58a820b97878 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:36 devstack sudo[89945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-089ebde4-d42b-4d9f-bd88-58a820b97878
Apr 15 20:13:36 devstack sudo[89945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:36 devstack sudo[89945]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:36 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-415b08e3-a804-4d85-9759-5e32ee7450d2 tempest-CinderUnicodeTest-1780299941 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-089ebde4-d42b-4d9f-bd88-58a820b97878" returned: 0 in 0.486s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:36 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-415b08e3-a804-4d85-9759-5e32ee7450d2 tempest-CinderUnicodeTest-1780299941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-089ebde4-d42b-4d9f-bd88-58a820b97878.8403111a-4748-4a77-8a31-30e4063153fd {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:36 devstack sudo[89950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-089ebde4-d42b-4d9f-bd88-58a820b97878.8403111a-4748-4a77-8a31-30e4063153fd
Apr 15 20:13:36 devstack sudo[89950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:37 devstack sudo[89950]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:37 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-415b08e3-a804-4d85-9759-5e32ee7450d2 tempest-CinderUnicodeTest-1780299941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-089ebde4-d42b-4d9f-bd88-58a820b97878.8403111a-4748-4a77-8a31-30e4063153fd" returned: 0 in 0.434s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:37 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-415b08e3-a804-4d85-9759-5e32ee7450d2 tempest-CinderUnicodeTest-1780299941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-089ebde4-d42b-4d9f-bd88-58a820b97878.8403111a-4748-4a77-8a31-30e4063153fd {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:37 devstack sudo[89955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-089ebde4-d42b-4d9f-bd88-58a820b97878.8403111a-4748-4a77-8a31-30e4063153fd
Apr 15 20:13:37 devstack sudo[89955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:37 devstack sudo[89955]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:37 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-415b08e3-a804-4d85-9759-5e32ee7450d2 tempest-CinderUnicodeTest-1780299941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-089ebde4-d42b-4d9f-bd88-58a820b97878.8403111a-4748-4a77-8a31-30e4063153fd" returned: 0 in 0.393s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:37 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-415b08e3-a804-4d85-9759-5e32ee7450d2 tempest-CinderUnicodeTest-1780299941 None] Lock "cinder-quobyte-8403111a-4748-4a77-8a31-30e4063153fd" released by "_delete_snapshot" :: held 1.901s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:13:37 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-415b08e3-a804-4d85-9759-5e32ee7450d2 tempest-CinderUnicodeTest-1780299941 None] Lock "cinder-quobyte-089ebde4-d42b-4d9f-bd88-58a820b97878" released by "delete_snapshot" :: held 1.914s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:13:37 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-415b08e3-a804-4d85-9759-5e32ee7450d2 tempest-CinderUnicodeTest-1780299941 None] Created reservations ['0ef679cc-9c81-4059-8646-628dee538b16', '1bf8f959-2ffc-4182-8d76-ed21037805e8', 'ea5a5c0a-406b-4140-adbe-e2259271b209', '7f739ac0-25da-4ae3-9d28-ac0d3592d3c4'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:13:37 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-415b08e3-a804-4d85-9759-5e32ee7450d2 tempest-CinderUnicodeTest-1780299941 None] Delete snapshot completed successfully.
Apr 15 20:13:37 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-415b08e3-a804-4d85-9759-5e32ee7450d2 tempest-CinderUnicodeTest-1780299941 None] Lock "cinder-8403111a-4748-4a77-8a31-30e4063153fd-delete_snapshot" released by "delete_snapshot" :: held 1.990s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:13:37 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-28d199a3-f6ae-47c2-91fb-fe2bfa0575ae tempest-CinderUnicodeTest-1780299941 None] Acquiring lock "cinder-089ebde4-d42b-4d9f-bd88-58a820b97878-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:13:37 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-28d199a3-f6ae-47c2-91fb-fe2bfa0575ae tempest-CinderUnicodeTest-1780299941 None] Lock "cinder-089ebde4-d42b-4d9f-bd88-58a820b97878-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:13:37 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-28d199a3-f6ae-47c2-91fb-fe2bfa0575ae tempest-CinderUnicodeTest-1780299941 None] Acquiring lock "cinder-quobyte-089ebde4-d42b-4d9f-bd88-58a820b97878" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:13:37 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-28d199a3-f6ae-47c2-91fb-fe2bfa0575ae tempest-CinderUnicodeTest-1780299941 None] Lock "cinder-quobyte-089ebde4-d42b-4d9f-bd88-58a820b97878" acquired by "delete_volume" :: waited 0.013s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:13:37 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[654b231c-7e95-4d0d-8145-254892ef187a]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:13:37 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-28d199a3-f6ae-47c2-91fb-fe2bfa0575ae tempest-CinderUnicodeTest-1780299941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-089ebde4-d42b-4d9f-bd88-58a820b97878 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:37 devstack sudo[89958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-089ebde4-d42b-4d9f-bd88-58a820b97878
Apr 15 20:13:37 devstack sudo[89958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:38 devstack sudo[89958]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:38 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-28d199a3-f6ae-47c2-91fb-fe2bfa0575ae tempest-CinderUnicodeTest-1780299941 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-089ebde4-d42b-4d9f-bd88-58a820b97878" returned: 0 in 0.460s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:38 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-28d199a3-f6ae-47c2-91fb-fe2bfa0575ae tempest-CinderUnicodeTest-1780299941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-089ebde4-d42b-4d9f-bd88-58a820b97878 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:38 devstack sudo[89963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-089ebde4-d42b-4d9f-bd88-58a820b97878
Apr 15 20:13:38 devstack sudo[89963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:38 devstack sudo[89963]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:38 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-28d199a3-f6ae-47c2-91fb-fe2bfa0575ae tempest-CinderUnicodeTest-1780299941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-089ebde4-d42b-4d9f-bd88-58a820b97878" returned: 0 in 0.389s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:38 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-28d199a3-f6ae-47c2-91fb-fe2bfa0575ae tempest-CinderUnicodeTest-1780299941 None] Lock "cinder-quobyte-089ebde4-d42b-4d9f-bd88-58a820b97878" released by "delete_volume" :: held 0.880s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:13:38 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-28d199a3-f6ae-47c2-91fb-fe2bfa0575ae tempest-CinderUnicodeTest-1780299941 None] Created reservations ['a7107b0f-a236-4c2f-8322-730c4973fb18', 'b9063e50-917b-4447-a78d-0fe595d7c7df', 'e23b1dfa-bb39-43c5-8474-a275a0a59057', 'b68d1dea-e2fe-4fc3-a9cc-a62822bf54b8'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:13:38 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-28d199a3-f6ae-47c2-91fb-fe2bfa0575ae tempest-CinderUnicodeTest-1780299941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:13:38 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-28d199a3-f6ae-47c2-91fb-fe2bfa0575ae tempest-CinderUnicodeTest-1780299941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:13:38 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-28d199a3-f6ae-47c2-91fb-fe2bfa0575ae tempest-CinderUnicodeTest-1780299941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:13:38 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-28d199a3-f6ae-47c2-91fb-fe2bfa0575ae tempest-CinderUnicodeTest-1780299941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:13:38 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-28d199a3-f6ae-47c2-91fb-fe2bfa0575ae tempest-CinderUnicodeTest-1780299941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:13:38 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-28d199a3-f6ae-47c2-91fb-fe2bfa0575ae tempest-CinderUnicodeTest-1780299941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:38 devstack sudo[89966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:13:38 devstack sudo[89966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:38 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-a838fd5c-4a42-4fb6-b880-cbc41d651c8e tempest-CinderUnicodeTest-1780299941 None] Acquiring lock "cinder-0a20cc3e-2472-40ca-a604-4d6241d8a402-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:13:38 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-a838fd5c-4a42-4fb6-b880-cbc41d651c8e tempest-CinderUnicodeTest-1780299941 None] Lock "cinder-0a20cc3e-2472-40ca-a604-4d6241d8a402-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:13:38 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-a838fd5c-4a42-4fb6-b880-cbc41d651c8e tempest-CinderUnicodeTest-1780299941 None] Acquiring lock "cinder-quobyte-0a20cc3e-2472-40ca-a604-4d6241d8a402" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:13:38 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-a838fd5c-4a42-4fb6-b880-cbc41d651c8e tempest-CinderUnicodeTest-1780299941 None] Lock "cinder-quobyte-0a20cc3e-2472-40ca-a604-4d6241d8a402" acquired by "delete_volume" :: waited 0.008s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:13:38 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07ccfa7-0fc2-4afa-92a6-50559a3c0125]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:13:38 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-a838fd5c-4a42-4fb6-b880-cbc41d651c8e tempest-CinderUnicodeTest-1780299941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0a20cc3e-2472-40ca-a604-4d6241d8a402 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:39 devstack sudo[89968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0a20cc3e-2472-40ca-a604-4d6241d8a402
Apr 15 20:13:39 devstack sudo[89968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:39 devstack sudo[89966]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:39 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-28d199a3-f6ae-47c2-91fb-fe2bfa0575ae tempest-CinderUnicodeTest-1780299941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.405s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:39 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-28d199a3-f6ae-47c2-91fb-fe2bfa0575ae tempest-CinderUnicodeTest-1780299941 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:13:39 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-28d199a3-f6ae-47c2-91fb-fe2bfa0575ae tempest-CinderUnicodeTest-1780299941 None] Deleted volume successfully.
Apr 15 20:13:39 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-28d199a3-f6ae-47c2-91fb-fe2bfa0575ae tempest-CinderUnicodeTest-1780299941 None] Lock "cinder-089ebde4-d42b-4d9f-bd88-58a820b97878-delete_volume" released by "delete_volume" :: held 1.422s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:13:39 devstack sudo[89968]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:39 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-a838fd5c-4a42-4fb6-b880-cbc41d651c8e tempest-CinderUnicodeTest-1780299941 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0a20cc3e-2472-40ca-a604-4d6241d8a402" returned: 0 in 0.462s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:39 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-a838fd5c-4a42-4fb6-b880-cbc41d651c8e tempest-CinderUnicodeTest-1780299941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0a20cc3e-2472-40ca-a604-4d6241d8a402 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:39 devstack sudo[89974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0a20cc3e-2472-40ca-a604-4d6241d8a402
Apr 15 20:13:39 devstack sudo[89974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:39 devstack sudo[89974]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:39 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-a838fd5c-4a42-4fb6-b880-cbc41d651c8e tempest-CinderUnicodeTest-1780299941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-0a20cc3e-2472-40ca-a604-4d6241d8a402" returned: 0 in 0.425s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:39 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-a838fd5c-4a42-4fb6-b880-cbc41d651c8e tempest-CinderUnicodeTest-1780299941 None] Lock "cinder-quobyte-0a20cc3e-2472-40ca-a604-4d6241d8a402" released by "delete_volume" :: held 0.913s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:13:39 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-a838fd5c-4a42-4fb6-b880-cbc41d651c8e tempest-CinderUnicodeTest-1780299941 None] Created reservations ['dede48c2-031f-4b45-add7-093860663ebd', '314033c4-0420-48e4-bafb-5ecee1bcf8f5', 'df310e31-5a60-4341-88d6-c0e3738e1156', '6d5c41e7-9e65-4df8-8382-f4a110c47dce'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:13:39 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-a838fd5c-4a42-4fb6-b880-cbc41d651c8e tempest-CinderUnicodeTest-1780299941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:13:39 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-a838fd5c-4a42-4fb6-b880-cbc41d651c8e tempest-CinderUnicodeTest-1780299941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:13:39 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-a838fd5c-4a42-4fb6-b880-cbc41d651c8e tempest-CinderUnicodeTest-1780299941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:13:39 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-a838fd5c-4a42-4fb6-b880-cbc41d651c8e tempest-CinderUnicodeTest-1780299941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:13:39 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-a838fd5c-4a42-4fb6-b880-cbc41d651c8e tempest-CinderUnicodeTest-1780299941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:13:39 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-a838fd5c-4a42-4fb6-b880-cbc41d651c8e tempest-CinderUnicodeTest-1780299941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:39 devstack sudo[89977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:13:39 devstack sudo[89977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:40 devstack sudo[89977]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:40 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-a838fd5c-4a42-4fb6-b880-cbc41d651c8e tempest-CinderUnicodeTest-1780299941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.431s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:40 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-a838fd5c-4a42-4fb6-b880-cbc41d651c8e tempest-CinderUnicodeTest-1780299941 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:13:40 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-a838fd5c-4a42-4fb6-b880-cbc41d651c8e tempest-CinderUnicodeTest-1780299941 None] Deleted volume successfully.
Apr 15 20:13:40 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-a838fd5c-4a42-4fb6-b880-cbc41d651c8e tempest-CinderUnicodeTest-1780299941 None] Lock "cinder-0a20cc3e-2472-40ca-a604-4d6241d8a402-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:13:47 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-7110377f-a4e7-4d77-9422-64e41fd613bf tempest-CreateVolumesFromImageTest-1411433811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:13:47 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-7110377f-a4e7-4d77-9422-64e41fd613bf tempest-CreateVolumesFromImageTest-1411433811 None] Flow 'volume_create_manager' (923d7901-ecbc-4430-9425-ee54796e7601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:13:47 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-7110377f-a4e7-4d77-9422-64e41fd613bf tempest-CreateVolumesFromImageTest-1411433811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdc2d6be-d542-411c-8477-f521930a1fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:47 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-7110377f-a4e7-4d77-9422-64e41fd613bf tempest-CreateVolumesFromImageTest-1411433811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdc2d6be-d542-411c-8477-f521930a1fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:13:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1425165763',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0bcfd32-3128-4c30-8e50-ffc84af9f4ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01fbb4654d23430e9bfc0e12f066e44d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:13:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:13:47Z,use_quota=True,user_id='52bb0d7f8f254afea568ca29b5f63557',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:47 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-7110377f-a4e7-4d77-9422-64e41fd613bf tempest-CreateVolumesFromImageTest-1411433811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ecc4390-51b9-4265-80d0-a0f57ef20a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:47 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-7110377f-a4e7-4d77-9422-64e41fd613bf tempest-CreateVolumesFromImageTest-1411433811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ecc4390-51b9-4265-80d0-a0f57ef20a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:47 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-7110377f-a4e7-4d77-9422-64e41fd613bf tempest-CreateVolumesFromImageTest-1411433811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad238f60-cf8c-4d67-ab02-edd9d80a86a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:47 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-7110377f-a4e7-4d77-9422-64e41fd613bf tempest-CreateVolumesFromImageTest-1411433811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad238f60-cf8c-4d67-ab02-edd9d80a86a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0bcfd32-3128-4c30-8e50-ffc84af9f4ae', 'volume_name': 'volume-e0bcfd32-3128-4c30-8e50-ffc84af9f4ae', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:47 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-7110377f-a4e7-4d77-9422-64e41fd613bf tempest-CreateVolumesFromImageTest-1411433811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fa7a07f-cb6f-4cc9-be61-d0eb87ea6b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:47 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-7110377f-a4e7-4d77-9422-64e41fd613bf tempest-CreateVolumesFromImageTest-1411433811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fa7a07f-cb6f-4cc9-be61-d0eb87ea6b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:47 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-7110377f-a4e7-4d77-9422-64e41fd613bf tempest-CreateVolumesFromImageTest-1411433811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c5d23ba-364e-4f8d-892a-572e0fe2bcc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:47 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-7110377f-a4e7-4d77-9422-64e41fd613bf tempest-CreateVolumesFromImageTest-1411433811 None] Volume e0bcfd32-3128-4c30-8e50-ffc84af9f4ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0bcfd32-3128-4c30-8e50-ffc84af9f4ae', 'volume_size': 1}
Apr 15 20:13:47 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-7110377f-a4e7-4d77-9422-64e41fd613bf tempest-CreateVolumesFromImageTest-1411433811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:13:47 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-7110377f-a4e7-4d77-9422-64e41fd613bf tempest-CreateVolumesFromImageTest-1411433811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:13:47 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-7110377f-a4e7-4d77-9422-64e41fd613bf tempest-CreateVolumesFromImageTest-1411433811 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:13:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1425165763',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0bcfd32-3128-4c30-8e50-ffc84af9f4ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01fbb4654d23430e9bfc0e12f066e44d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:13:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:13:47Z,use_quota=True,user_id='52bb0d7f8f254afea568ca29b5f63557',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:13:47 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-7110377f-a4e7-4d77-9422-64e41fd613bf tempest-CreateVolumesFromImageTest-1411433811 None] Creating volume e0bcfd32-3128-4c30-8e50-ffc84af9f4ae {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:13:47 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-7110377f-a4e7-4d77-9422-64e41fd613bf tempest-CreateVolumesFromImageTest-1411433811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:13:47 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-7110377f-a4e7-4d77-9422-64e41fd613bf tempest-CreateVolumesFromImageTest-1411433811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:13:47 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-7110377f-a4e7-4d77-9422-64e41fd613bf tempest-CreateVolumesFromImageTest-1411433811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:13:47 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-7110377f-a4e7-4d77-9422-64e41fd613bf tempest-CreateVolumesFromImageTest-1411433811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:13:47 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-7110377f-a4e7-4d77-9422-64e41fd613bf tempest-CreateVolumesFromImageTest-1411433811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:13:47 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-7110377f-a4e7-4d77-9422-64e41fd613bf tempest-CreateVolumesFromImageTest-1411433811 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:13:47 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-7110377f-a4e7-4d77-9422-64e41fd613bf tempest-CreateVolumesFromImageTest-1411433811 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:13:47 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-7110377f-a4e7-4d77-9422-64e41fd613bf tempest-CreateVolumesFromImageTest-1411433811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e0bcfd32-3128-4c30-8e50-ffc84af9f4ae 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:47 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-15034132-5a5d-48e4-a4a2-041a893a57fd tempest-CreateVolumesFromSnapshotTest-622878184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:13:47 devstack sudo[90056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e0bcfd32-3128-4c30-8e50-ffc84af9f4ae 1073741824
Apr 15 20:13:47 devstack sudo[90056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:47 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-15034132-5a5d-48e4-a4a2-041a893a57fd tempest-CreateVolumesFromSnapshotTest-622878184 None] Flow 'volume_create_manager' (9f343bef-cee5-4cfa-8050-ef8dcecfd3bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:13:47 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-15034132-5a5d-48e4-a4a2-041a893a57fd tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (317b280a-0d6b-4dd9-8da7-125e35baca87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:47 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-15034132-5a5d-48e4-a4a2-041a893a57fd tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (317b280a-0d6b-4dd9-8da7-125e35baca87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:13:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1121230219',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92c99b8f-2c94-4461-8171-4f079b482500,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90296888d81a4c4cae42d9852422dd46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:13:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:13:48Z,use_quota=True,user_id='d4475abfc80947bc8c8e17117bb58bb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:47 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-15034132-5a5d-48e4-a4a2-041a893a57fd tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e336798a-da58-4365-ac1b-c5f0905c66c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:47 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-15034132-5a5d-48e4-a4a2-041a893a57fd tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e336798a-da58-4365-ac1b-c5f0905c66c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:47 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-15034132-5a5d-48e4-a4a2-041a893a57fd tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55c5653e-7ab9-4da5-921f-dcd062ea188f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:47 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-15034132-5a5d-48e4-a4a2-041a893a57fd tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55c5653e-7ab9-4da5-921f-dcd062ea188f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92c99b8f-2c94-4461-8171-4f079b482500', 'volume_name': 'volume-92c99b8f-2c94-4461-8171-4f079b482500', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:47 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-15034132-5a5d-48e4-a4a2-041a893a57fd tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfd535b2-5f05-4465-b510-0185354a601c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:47 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-15034132-5a5d-48e4-a4a2-041a893a57fd tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfd535b2-5f05-4465-b510-0185354a601c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:47 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-15034132-5a5d-48e4-a4a2-041a893a57fd tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4d895c7-fe12-457f-a6ca-c57d05fc2969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:47 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-15034132-5a5d-48e4-a4a2-041a893a57fd tempest-CreateVolumesFromSnapshotTest-622878184 None] Volume 92c99b8f-2c94-4461-8171-4f079b482500: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92c99b8f-2c94-4461-8171-4f079b482500', 'volume_size': 1}
Apr 15 20:13:47 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-15034132-5a5d-48e4-a4a2-041a893a57fd tempest-CreateVolumesFromSnapshotTest-622878184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:13:47 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-555b07df-b04a-4122-8123-6f9fd96e7b89 tempest-CreateVolumesFromImageTest-1411433811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:13:47 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-555b07df-b04a-4122-8123-6f9fd96e7b89 tempest-CreateVolumesFromImageTest-1411433811 None] Flow 'volume_create_manager' (ad0ac3e9-4b01-4029-8629-6a7c18bbafc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:13:47 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-555b07df-b04a-4122-8123-6f9fd96e7b89 tempest-CreateVolumesFromImageTest-1411433811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b576436c-81a4-4bfb-b3c2-1fbaf2fea330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:47 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-c53ad4a3-0cf6-4084-9443-3c7694b39e28 tempest-VolumeDependencyTests-2146631135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:13:47 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-c53ad4a3-0cf6-4084-9443-3c7694b39e28 tempest-VolumeDependencyTests-2146631135 None] Flow 'volume_create_manager' (f707ecca-78ab-4a77-b561-c45bb96582a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:13:47 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-c53ad4a3-0cf6-4084-9443-3c7694b39e28 tempest-VolumeDependencyTests-2146631135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5648adc5-5aca-4eb0-b4fa-0e14e64305f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:47 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-555b07df-b04a-4122-8123-6f9fd96e7b89 tempest-CreateVolumesFromImageTest-1411433811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b576436c-81a4-4bfb-b3c2-1fbaf2fea330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:13:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-633503070',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67050d07-d22d-405b-995f-acd44cc9067e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01fbb4654d23430e9bfc0e12f066e44d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:13:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:13:48Z,use_quota=True,user_id='52bb0d7f8f254afea568ca29b5f63557',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:47 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-555b07df-b04a-4122-8123-6f9fd96e7b89 tempest-CreateVolumesFromImageTest-1411433811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fece6e2d-d274-4f6f-9725-0e0135a2a37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:47 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-555b07df-b04a-4122-8123-6f9fd96e7b89 tempest-CreateVolumesFromImageTest-1411433811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fece6e2d-d274-4f6f-9725-0e0135a2a37c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:47 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-555b07df-b04a-4122-8123-6f9fd96e7b89 tempest-CreateVolumesFromImageTest-1411433811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (359f53d1-0681-4cda-bbe0-63cd6b7b7d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-555b07df-b04a-4122-8123-6f9fd96e7b89 tempest-CreateVolumesFromImageTest-1411433811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (359f53d1-0681-4cda-bbe0-63cd6b7b7d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67050d07-d22d-405b-995f-acd44cc9067e', 'volume_name': 'volume-67050d07-d22d-405b-995f-acd44cc9067e', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-555b07df-b04a-4122-8123-6f9fd96e7b89 tempest-CreateVolumesFromImageTest-1411433811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08c7d9e4-43ae-4ba3-a59f-9e92c86916d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-555b07df-b04a-4122-8123-6f9fd96e7b89 tempest-CreateVolumesFromImageTest-1411433811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08c7d9e4-43ae-4ba3-a59f-9e92c86916d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-555b07df-b04a-4122-8123-6f9fd96e7b89 tempest-CreateVolumesFromImageTest-1411433811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7525ffd1-e3fe-4961-af7e-15764b46863c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:48 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-555b07df-b04a-4122-8123-6f9fd96e7b89 tempest-CreateVolumesFromImageTest-1411433811 None] Volume 67050d07-d22d-405b-995f-acd44cc9067e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67050d07-d22d-405b-995f-acd44cc9067e', 'volume_size': 1}
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-555b07df-b04a-4122-8123-6f9fd96e7b89 tempest-CreateVolumesFromImageTest-1411433811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-c53ad4a3-0cf6-4084-9443-3c7694b39e28 tempest-VolumeDependencyTests-2146631135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5648adc5-5aca-4eb0-b4fa-0e14e64305f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:13:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1533840326',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f32e8a08-8198-4a7d-9bb9-ae3d8792d148,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8beda731ffc94345980fbb9fadc77736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:13:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:13:48Z,use_quota=True,user_id='febc3aa7e59e46e29f55adac7b15c620',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-c53ad4a3-0cf6-4084-9443-3c7694b39e28 tempest-VolumeDependencyTests-2146631135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4e14663-2d12-4725-8075-d9f27fb0884b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-c53ad4a3-0cf6-4084-9443-3c7694b39e28 tempest-VolumeDependencyTests-2146631135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4e14663-2d12-4725-8075-d9f27fb0884b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-c53ad4a3-0cf6-4084-9443-3c7694b39e28 tempest-VolumeDependencyTests-2146631135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (540a5763-c91c-4243-8308-b1529820588d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-c53ad4a3-0cf6-4084-9443-3c7694b39e28 tempest-VolumeDependencyTests-2146631135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (540a5763-c91c-4243-8308-b1529820588d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f32e8a08-8198-4a7d-9bb9-ae3d8792d148', 'volume_name': 'volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-c53ad4a3-0cf6-4084-9443-3c7694b39e28 tempest-VolumeDependencyTests-2146631135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (941cf01c-c060-4434-9eaa-928badf86b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-c53ad4a3-0cf6-4084-9443-3c7694b39e28 tempest-VolumeDependencyTests-2146631135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (941cf01c-c060-4434-9eaa-928badf86b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-c53ad4a3-0cf6-4084-9443-3c7694b39e28 tempest-VolumeDependencyTests-2146631135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d894090c-0bf8-43ae-aa73-584c81477920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:48 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-c53ad4a3-0cf6-4084-9443-3c7694b39e28 tempest-VolumeDependencyTests-2146631135 None] Volume f32e8a08-8198-4a7d-9bb9-ae3d8792d148: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148', 'volume_size': 1}
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-c53ad4a3-0cf6-4084-9443-3c7694b39e28 tempest-VolumeDependencyTests-2146631135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6634808-4263-4a2e-be2d-0f74eafbf9b7 tempest-CreateVolumesFromImageTest-1411433811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e6634808-4263-4a2e-be2d-0f74eafbf9b7 tempest-CreateVolumesFromImageTest-1411433811 None] Flow 'volume_create_manager' (df04fc4a-12a8-4b61-a522-362fd3b390e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e6634808-4263-4a2e-be2d-0f74eafbf9b7 tempest-CreateVolumesFromImageTest-1411433811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02f82b2f-fe26-405c-a111-feb2d4a36131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e6634808-4263-4a2e-be2d-0f74eafbf9b7 tempest-CreateVolumesFromImageTest-1411433811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02f82b2f-fe26-405c-a111-feb2d4a36131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:13:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1137787871',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43e1bab6-2b9d-401a-92fc-25684fc9efae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01fbb4654d23430e9bfc0e12f066e44d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:13:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:13:48Z,use_quota=True,user_id='52bb0d7f8f254afea568ca29b5f63557',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e6634808-4263-4a2e-be2d-0f74eafbf9b7 tempest-CreateVolumesFromImageTest-1411433811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1197a6c-f9a7-4222-b1ee-37fbeeafc798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e6634808-4263-4a2e-be2d-0f74eafbf9b7 tempest-CreateVolumesFromImageTest-1411433811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1197a6c-f9a7-4222-b1ee-37fbeeafc798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e6634808-4263-4a2e-be2d-0f74eafbf9b7 tempest-CreateVolumesFromImageTest-1411433811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d66578d-ece5-400c-a56e-98c6e5b68464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e6634808-4263-4a2e-be2d-0f74eafbf9b7 tempest-CreateVolumesFromImageTest-1411433811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d66578d-ece5-400c-a56e-98c6e5b68464) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43e1bab6-2b9d-401a-92fc-25684fc9efae', 'volume_name': 'volume-43e1bab6-2b9d-401a-92fc-25684fc9efae', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e6634808-4263-4a2e-be2d-0f74eafbf9b7 tempest-CreateVolumesFromImageTest-1411433811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eeedb3c-d520-4de3-875a-bdd18a4d7685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e6634808-4263-4a2e-be2d-0f74eafbf9b7 tempest-CreateVolumesFromImageTest-1411433811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eeedb3c-d520-4de3-875a-bdd18a4d7685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e6634808-4263-4a2e-be2d-0f74eafbf9b7 tempest-CreateVolumesFromImageTest-1411433811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd34dd8b-97b2-4f21-b846-ebf764b142bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:48 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-e6634808-4263-4a2e-be2d-0f74eafbf9b7 tempest-CreateVolumesFromImageTest-1411433811 None] Volume 43e1bab6-2b9d-401a-92fc-25684fc9efae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43e1bab6-2b9d-401a-92fc-25684fc9efae', 'volume_size': 1}
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-e6634808-4263-4a2e-be2d-0f74eafbf9b7 tempest-CreateVolumesFromImageTest-1411433811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e241841-df2c-400b-8193-995e6b822d97 tempest-CreateVolumesFromImageTest-1411433811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-1e241841-df2c-400b-8193-995e6b822d97 tempest-CreateVolumesFromImageTest-1411433811 None] Flow 'volume_create_manager' (1ac05de2-5b3a-41e6-9989-16570ff0c6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-1e241841-df2c-400b-8193-995e6b822d97 tempest-CreateVolumesFromImageTest-1411433811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1360cf1-3fff-4b3b-bf5b-9c4f765ca222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-1e241841-df2c-400b-8193-995e6b822d97 tempest-CreateVolumesFromImageTest-1411433811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1360cf1-3fff-4b3b-bf5b-9c4f765ca222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:13:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1764611435',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3626d4f6-ae90-419c-a12a-d2a7e96f46d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01fbb4654d23430e9bfc0e12f066e44d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:13:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:13:48Z,use_quota=True,user_id='52bb0d7f8f254afea568ca29b5f63557',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-1e241841-df2c-400b-8193-995e6b822d97 tempest-CreateVolumesFromImageTest-1411433811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f32395d-fcfc-4684-ba97-4198cdd6e9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:48 devstack sudo[90056]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-1e241841-df2c-400b-8193-995e6b822d97 tempest-CreateVolumesFromImageTest-1411433811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f32395d-fcfc-4684-ba97-4198cdd6e9ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-1e241841-df2c-400b-8193-995e6b822d97 tempest-CreateVolumesFromImageTest-1411433811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa9ad10d-b686-4989-8e02-9fc3b8024196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-1e241841-df2c-400b-8193-995e6b822d97 tempest-CreateVolumesFromImageTest-1411433811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa9ad10d-b686-4989-8e02-9fc3b8024196) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3626d4f6-ae90-419c-a12a-d2a7e96f46d0', 'volume_name': 'volume-3626d4f6-ae90-419c-a12a-d2a7e96f46d0', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-1e241841-df2c-400b-8193-995e6b822d97 tempest-CreateVolumesFromImageTest-1411433811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b36afe77-4377-41f8-b0e7-ff2d9361ee64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-1e241841-df2c-400b-8193-995e6b822d97 tempest-CreateVolumesFromImageTest-1411433811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b36afe77-4377-41f8-b0e7-ff2d9361ee64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-1e241841-df2c-400b-8193-995e6b822d97 tempest-CreateVolumesFromImageTest-1411433811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93a26e74-4c21-4a13-a0f2-1e4ab028341c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:48 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-1e241841-df2c-400b-8193-995e6b822d97 tempest-CreateVolumesFromImageTest-1411433811 None] Volume 3626d4f6-ae90-419c-a12a-d2a7e96f46d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3626d4f6-ae90-419c-a12a-d2a7e96f46d0', 'volume_size': 1}
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-1e241841-df2c-400b-8193-995e6b822d97 tempest-CreateVolumesFromImageTest-1411433811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-7110377f-a4e7-4d77-9422-64e41fd613bf tempest-CreateVolumesFromImageTest-1411433811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e0bcfd32-3128-4c30-8e50-ffc84af9f4ae 1073741824" returned: 0 in 0.734s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-7110377f-a4e7-4d77-9422-64e41fd613bf tempest-CreateVolumesFromImageTest-1411433811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e0bcfd32-3128-4c30-8e50-ffc84af9f4ae {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:48 devstack sudo[90061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e0bcfd32-3128-4c30-8e50-ffc84af9f4ae
Apr 15 20:13:48 devstack sudo[90061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc8d3654-05c2-492f-a5d5-5a592c0c958a tempest-CreateVolumesFromImageTest-1411433811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-fc8d3654-05c2-492f-a5d5-5a592c0c958a tempest-CreateVolumesFromImageTest-1411433811 None] Flow 'volume_create_manager' (c55025c6-084b-4988-b158-9da78c31475c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-fc8d3654-05c2-492f-a5d5-5a592c0c958a tempest-CreateVolumesFromImageTest-1411433811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfe4ad43-d130-4bcd-9d06-5e914dddae33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-fc8d3654-05c2-492f-a5d5-5a592c0c958a tempest-CreateVolumesFromImageTest-1411433811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfe4ad43-d130-4bcd-9d06-5e914dddae33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:13:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1202249863',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9f3c489-1b69-4bc1-8ba9-49f07a168f3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01fbb4654d23430e9bfc0e12f066e44d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:13:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:13:49Z,use_quota=True,user_id='52bb0d7f8f254afea568ca29b5f63557',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-fc8d3654-05c2-492f-a5d5-5a592c0c958a tempest-CreateVolumesFromImageTest-1411433811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ad5538a-1791-4bbb-9d63-62a94e85ebbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-fc8d3654-05c2-492f-a5d5-5a592c0c958a tempest-CreateVolumesFromImageTest-1411433811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ad5538a-1791-4bbb-9d63-62a94e85ebbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-fc8d3654-05c2-492f-a5d5-5a592c0c958a tempest-CreateVolumesFromImageTest-1411433811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e129f52c-cba5-49a8-88fd-74c6eba33bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-fc8d3654-05c2-492f-a5d5-5a592c0c958a tempest-CreateVolumesFromImageTest-1411433811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e129f52c-cba5-49a8-88fd-74c6eba33bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9f3c489-1b69-4bc1-8ba9-49f07a168f3b', 'volume_name': 'volume-a9f3c489-1b69-4bc1-8ba9-49f07a168f3b', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-fc8d3654-05c2-492f-a5d5-5a592c0c958a tempest-CreateVolumesFromImageTest-1411433811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44a179aa-2783-4fe2-adc6-d7c0937d1886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-fc8d3654-05c2-492f-a5d5-5a592c0c958a tempest-CreateVolumesFromImageTest-1411433811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44a179aa-2783-4fe2-adc6-d7c0937d1886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-fc8d3654-05c2-492f-a5d5-5a592c0c958a tempest-CreateVolumesFromImageTest-1411433811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7473a76-744b-4019-8a2a-2a86c8e9e832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:48 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-fc8d3654-05c2-492f-a5d5-5a592c0c958a tempest-CreateVolumesFromImageTest-1411433811 None] Volume a9f3c489-1b69-4bc1-8ba9-49f07a168f3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9f3c489-1b69-4bc1-8ba9-49f07a168f3b', 'volume_size': 1}
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-fc8d3654-05c2-492f-a5d5-5a592c0c958a tempest-CreateVolumesFromImageTest-1411433811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:13:48 devstack sudo[90061]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-7110377f-a4e7-4d77-9422-64e41fd613bf tempest-CreateVolumesFromImageTest-1411433811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e0bcfd32-3128-4c30-8e50-ffc84af9f4ae" returned: 0 in 0.451s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-7110377f-a4e7-4d77-9422-64e41fd613bf tempest-CreateVolumesFromImageTest-1411433811 None] <== create_volume: return (1213ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-7110377f-a4e7-4d77-9422-64e41fd613bf tempest-CreateVolumesFromImageTest-1411433811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.217s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-15034132-5a5d-48e4-a4a2-041a893a57fd tempest-CreateVolumesFromSnapshotTest-622878184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.013s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-15034132-5a5d-48e4-a4a2-041a893a57fd tempest-CreateVolumesFromSnapshotTest-622878184 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:13:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1121230219',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92c99b8f-2c94-4461-8171-4f079b482500,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90296888d81a4c4cae42d9852422dd46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:13:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:13:48Z,use_quota=True,user_id='d4475abfc80947bc8c8e17117bb58bb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-15034132-5a5d-48e4-a4a2-041a893a57fd tempest-CreateVolumesFromSnapshotTest-622878184 None] Creating volume 92c99b8f-2c94-4461-8171-4f079b482500 {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-15034132-5a5d-48e4-a4a2-041a893a57fd tempest-CreateVolumesFromSnapshotTest-622878184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-15034132-5a5d-48e4-a4a2-041a893a57fd tempest-CreateVolumesFromSnapshotTest-622878184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-15034132-5a5d-48e4-a4a2-041a893a57fd tempest-CreateVolumesFromSnapshotTest-622878184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-15034132-5a5d-48e4-a4a2-041a893a57fd tempest-CreateVolumesFromSnapshotTest-622878184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-15034132-5a5d-48e4-a4a2-041a893a57fd tempest-CreateVolumesFromSnapshotTest-622878184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-15034132-5a5d-48e4-a4a2-041a893a57fd tempest-CreateVolumesFromSnapshotTest-622878184 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:13:48 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-15034132-5a5d-48e4-a4a2-041a893a57fd tempest-CreateVolumesFromSnapshotTest-622878184 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-15034132-5a5d-48e4-a4a2-041a893a57fd tempest-CreateVolumesFromSnapshotTest-622878184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-92c99b8f-2c94-4461-8171-4f079b482500 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG oslo_service.periodic_task [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:48 devstack sudo[90064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-92c99b8f-2c94-4461-8171-4f079b482500 1073741824
Apr 15 20:13:48 devstack sudo[90064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-7110377f-a4e7-4d77-9422-64e41fd613bf tempest-CreateVolumesFromImageTest-1411433811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c5d23ba-364e-4f8d-892a-572e0fe2bcc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0bcfd32-3128-4c30-8e50-ffc84af9f4ae', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-7110377f-a4e7-4d77-9422-64e41fd613bf tempest-CreateVolumesFromImageTest-1411433811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d820ace9-27c2-4a1a-be2c-87676a082b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:48 devstack sudo[90066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:13:48 devstack sudo[90066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:48 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-7110377f-a4e7-4d77-9422-64e41fd613bf tempest-CreateVolumesFromImageTest-1411433811 None] Volume volume-e0bcfd32-3128-4c30-8e50-ffc84af9f4ae (e0bcfd32-3128-4c30-8e50-ffc84af9f4ae): created successfully
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-7110377f-a4e7-4d77-9422-64e41fd613bf tempest-CreateVolumesFromImageTest-1411433811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d820ace9-27c2-4a1a-be2c-87676a082b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:48 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-7110377f-a4e7-4d77-9422-64e41fd613bf tempest-CreateVolumesFromImageTest-1411433811 None] Flow 'volume_create_manager' (923d7901-ecbc-4430-9425-ee54796e7601) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:13:48 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-7110377f-a4e7-4d77-9422-64e41fd613bf tempest-CreateVolumesFromImageTest-1411433811 None] Created volume successfully.
Apr 15 20:13:49 devstack sudo[90066]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:49 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.469s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:49 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:13:49 devstack sudo[90064]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:49 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-15034132-5a5d-48e4-a4a2-041a893a57fd tempest-CreateVolumesFromSnapshotTest-622878184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-92c99b8f-2c94-4461-8171-4f079b482500 1073741824" returned: 0 in 0.626s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:49 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-15034132-5a5d-48e4-a4a2-041a893a57fd tempest-CreateVolumesFromSnapshotTest-622878184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-92c99b8f-2c94-4461-8171-4f079b482500 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:49 devstack sudo[90072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-92c99b8f-2c94-4461-8171-4f079b482500
Apr 15 20:13:49 devstack sudo[90072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:50 devstack sudo[90072]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:50 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-15034132-5a5d-48e4-a4a2-041a893a57fd tempest-CreateVolumesFromSnapshotTest-622878184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-92c99b8f-2c94-4461-8171-4f079b482500" returned: 0 in 0.472s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:50 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-15034132-5a5d-48e4-a4a2-041a893a57fd tempest-CreateVolumesFromSnapshotTest-622878184 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:13:50 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-15034132-5a5d-48e4-a4a2-041a893a57fd tempest-CreateVolumesFromSnapshotTest-622878184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:13:50 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-555b07df-b04a-4122-8123-6f9fd96e7b89 tempest-CreateVolumesFromImageTest-1411433811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.003s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:13:50 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-555b07df-b04a-4122-8123-6f9fd96e7b89 tempest-CreateVolumesFromImageTest-1411433811 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:13:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-633503070',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67050d07-d22d-405b-995f-acd44cc9067e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01fbb4654d23430e9bfc0e12f066e44d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:13:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:13:48Z,use_quota=True,user_id='52bb0d7f8f254afea568ca29b5f63557',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:13:50 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-555b07df-b04a-4122-8123-6f9fd96e7b89 tempest-CreateVolumesFromImageTest-1411433811 None] Creating volume 67050d07-d22d-405b-995f-acd44cc9067e {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:13:50 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-555b07df-b04a-4122-8123-6f9fd96e7b89 tempest-CreateVolumesFromImageTest-1411433811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:13:50 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-555b07df-b04a-4122-8123-6f9fd96e7b89 tempest-CreateVolumesFromImageTest-1411433811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:13:50 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-555b07df-b04a-4122-8123-6f9fd96e7b89 tempest-CreateVolumesFromImageTest-1411433811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:13:50 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-555b07df-b04a-4122-8123-6f9fd96e7b89 tempest-CreateVolumesFromImageTest-1411433811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:13:50 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-555b07df-b04a-4122-8123-6f9fd96e7b89 tempest-CreateVolumesFromImageTest-1411433811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:13:50 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-555b07df-b04a-4122-8123-6f9fd96e7b89 tempest-CreateVolumesFromImageTest-1411433811 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:13:50 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-555b07df-b04a-4122-8123-6f9fd96e7b89 tempest-CreateVolumesFromImageTest-1411433811 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:13:50 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-555b07df-b04a-4122-8123-6f9fd96e7b89 tempest-CreateVolumesFromImageTest-1411433811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-67050d07-d22d-405b-995f-acd44cc9067e 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:50 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-15034132-5a5d-48e4-a4a2-041a893a57fd tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4d895c7-fe12-457f-a6ca-c57d05fc2969) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92c99b8f-2c94-4461-8171-4f079b482500', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:50 devstack sudo[90075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-67050d07-d22d-405b-995f-acd44cc9067e 1073741824
Apr 15 20:13:50 devstack sudo[90075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:50 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-15034132-5a5d-48e4-a4a2-041a893a57fd tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a28c1ea-fbb0-4809-b0e8-0b11d44b4eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:50 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-15034132-5a5d-48e4-a4a2-041a893a57fd tempest-CreateVolumesFromSnapshotTest-622878184 None] Volume volume-92c99b8f-2c94-4461-8171-4f079b482500 (92c99b8f-2c94-4461-8171-4f079b482500): created successfully
Apr 15 20:13:50 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-15034132-5a5d-48e4-a4a2-041a893a57fd tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a28c1ea-fbb0-4809-b0e8-0b11d44b4eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:50 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-15034132-5a5d-48e4-a4a2-041a893a57fd tempest-CreateVolumesFromSnapshotTest-622878184 None] Flow 'volume_create_manager' (9f343bef-cee5-4cfa-8050-ef8dcecfd3bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:13:50 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-15034132-5a5d-48e4-a4a2-041a893a57fd tempest-CreateVolumesFromSnapshotTest-622878184 None] Created volume successfully.
Apr 15 20:13:50 devstack sudo[90075]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:50 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-555b07df-b04a-4122-8123-6f9fd96e7b89 tempest-CreateVolumesFromImageTest-1411433811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-67050d07-d22d-405b-995f-acd44cc9067e 1073741824" returned: 0 in 0.604s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:50 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-555b07df-b04a-4122-8123-6f9fd96e7b89 tempest-CreateVolumesFromImageTest-1411433811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-67050d07-d22d-405b-995f-acd44cc9067e {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:50 devstack sudo[90080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-67050d07-d22d-405b-995f-acd44cc9067e
Apr 15 20:13:50 devstack sudo[90080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:50 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-b2a5898e-efd5-46b0-a3e6-ea4e71311ca6 tempest-CreateVolumesFromSnapshotTest-622878184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:13:51 devstack sudo[90080]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:51 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-555b07df-b04a-4122-8123-6f9fd96e7b89 tempest-CreateVolumesFromImageTest-1411433811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-67050d07-d22d-405b-995f-acd44cc9067e" returned: 0 in 0.669s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:51 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-555b07df-b04a-4122-8123-6f9fd96e7b89 tempest-CreateVolumesFromImageTest-1411433811 None] <== create_volume: return (1301ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:13:51 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-555b07df-b04a-4122-8123-6f9fd96e7b89 tempest-CreateVolumesFromImageTest-1411433811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.305s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:13:51 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-c53ad4a3-0cf6-4084-9443-3c7694b39e28 tempest-VolumeDependencyTests-2146631135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.272s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:13:51 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-c53ad4a3-0cf6-4084-9443-3c7694b39e28 tempest-VolumeDependencyTests-2146631135 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:13:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1533840326',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f32e8a08-8198-4a7d-9bb9-ae3d8792d148,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8beda731ffc94345980fbb9fadc77736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:13:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:13:48Z,use_quota=True,user_id='febc3aa7e59e46e29f55adac7b15c620',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:13:51 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-c53ad4a3-0cf6-4084-9443-3c7694b39e28 tempest-VolumeDependencyTests-2146631135 None] Creating volume f32e8a08-8198-4a7d-9bb9-ae3d8792d148 {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:13:51 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-c53ad4a3-0cf6-4084-9443-3c7694b39e28 tempest-VolumeDependencyTests-2146631135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:13:51 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-c53ad4a3-0cf6-4084-9443-3c7694b39e28 tempest-VolumeDependencyTests-2146631135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:13:51 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-c53ad4a3-0cf6-4084-9443-3c7694b39e28 tempest-VolumeDependencyTests-2146631135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:13:51 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-c53ad4a3-0cf6-4084-9443-3c7694b39e28 tempest-VolumeDependencyTests-2146631135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:13:51 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-c53ad4a3-0cf6-4084-9443-3c7694b39e28 tempest-VolumeDependencyTests-2146631135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:13:51 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-c53ad4a3-0cf6-4084-9443-3c7694b39e28 tempest-VolumeDependencyTests-2146631135 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:13:51 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-c53ad4a3-0cf6-4084-9443-3c7694b39e28 tempest-VolumeDependencyTests-2146631135 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:13:51 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c53ad4a3-0cf6-4084-9443-3c7694b39e28 tempest-VolumeDependencyTests-2146631135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:51 devstack cinder-volume[82646]: DEBUG dbcounter [-] [82646] Writing DB stats cinder:UPDATE=168,cinder:SELECT=120,cinder:DELETE=16,cinder:INSERT=34 {{(pid=82646) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 20:13:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-555b07df-b04a-4122-8123-6f9fd96e7b89 tempest-CreateVolumesFromImageTest-1411433811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7525ffd1-e3fe-4961-af7e-15764b46863c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67050d07-d22d-405b-995f-acd44cc9067e', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-555b07df-b04a-4122-8123-6f9fd96e7b89 tempest-CreateVolumesFromImageTest-1411433811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc070c8a-f241-42f7-9ff4-7176c7e4ff3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:51 devstack sudo[90083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148 1073741824
Apr 15 20:13:51 devstack sudo[90083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:51 devstack cinder-volume[82646]: DEBUG dbcounter [-] [82646] Writing DB stats cinder:UPDATE=173,cinder:DELETE=13,cinder:SELECT=137,cinder:INSERT=49 {{(pid=82646) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 20:13:51 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-555b07df-b04a-4122-8123-6f9fd96e7b89 tempest-CreateVolumesFromImageTest-1411433811 None] Volume volume-67050d07-d22d-405b-995f-acd44cc9067e (67050d07-d22d-405b-995f-acd44cc9067e): created successfully
Apr 15 20:13:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-555b07df-b04a-4122-8123-6f9fd96e7b89 tempest-CreateVolumesFromImageTest-1411433811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc070c8a-f241-42f7-9ff4-7176c7e4ff3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:51 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-555b07df-b04a-4122-8123-6f9fd96e7b89 tempest-CreateVolumesFromImageTest-1411433811 None] Flow 'volume_create_manager' (ad0ac3e9-4b01-4029-8629-6a7c18bbafc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:13:51 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-555b07df-b04a-4122-8123-6f9fd96e7b89 tempest-CreateVolumesFromImageTest-1411433811 None] Created volume successfully.
Apr 15 20:13:51 devstack sudo[90083]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:51 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c53ad4a3-0cf6-4084-9443-3c7694b39e28 tempest-VolumeDependencyTests-2146631135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148 1073741824" returned: 0 in 0.651s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:52 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c53ad4a3-0cf6-4084-9443-3c7694b39e28 tempest-VolumeDependencyTests-2146631135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:52 devstack sudo[90088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148
Apr 15 20:13:52 devstack sudo[90088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:52 devstack sudo[90088]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:52 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c53ad4a3-0cf6-4084-9443-3c7694b39e28 tempest-VolumeDependencyTests-2146631135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148" returned: 0 in 0.473s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:52 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-c53ad4a3-0cf6-4084-9443-3c7694b39e28 tempest-VolumeDependencyTests-2146631135 None] <== create_volume: return (1173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:13:52 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-c53ad4a3-0cf6-4084-9443-3c7694b39e28 tempest-VolumeDependencyTests-2146631135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.178s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:13:52 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-e6634808-4263-4a2e-be2d-0f74eafbf9b7 tempest-CreateVolumesFromImageTest-1411433811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.390s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:13:52 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-e6634808-4263-4a2e-be2d-0f74eafbf9b7 tempest-CreateVolumesFromImageTest-1411433811 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:13:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1137787871',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43e1bab6-2b9d-401a-92fc-25684fc9efae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01fbb4654d23430e9bfc0e12f066e44d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:13:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:13:48Z,use_quota=True,user_id='52bb0d7f8f254afea568ca29b5f63557',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:13:52 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-e6634808-4263-4a2e-be2d-0f74eafbf9b7 tempest-CreateVolumesFromImageTest-1411433811 None] Creating volume 43e1bab6-2b9d-401a-92fc-25684fc9efae {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:13:52 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-e6634808-4263-4a2e-be2d-0f74eafbf9b7 tempest-CreateVolumesFromImageTest-1411433811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:13:52 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-e6634808-4263-4a2e-be2d-0f74eafbf9b7 tempest-CreateVolumesFromImageTest-1411433811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:13:52 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-e6634808-4263-4a2e-be2d-0f74eafbf9b7 tempest-CreateVolumesFromImageTest-1411433811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:13:52 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-e6634808-4263-4a2e-be2d-0f74eafbf9b7 tempest-CreateVolumesFromImageTest-1411433811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:13:52 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-e6634808-4263-4a2e-be2d-0f74eafbf9b7 tempest-CreateVolumesFromImageTest-1411433811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:13:52 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-e6634808-4263-4a2e-be2d-0f74eafbf9b7 tempest-CreateVolumesFromImageTest-1411433811 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:13:52 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-e6634808-4263-4a2e-be2d-0f74eafbf9b7 tempest-CreateVolumesFromImageTest-1411433811 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:13:52 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e6634808-4263-4a2e-be2d-0f74eafbf9b7 tempest-CreateVolumesFromImageTest-1411433811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-43e1bab6-2b9d-401a-92fc-25684fc9efae 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:52 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-c53ad4a3-0cf6-4084-9443-3c7694b39e28 tempest-VolumeDependencyTests-2146631135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d894090c-0bf8-43ae-aa73-584c81477920) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:52 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-c53ad4a3-0cf6-4084-9443-3c7694b39e28 tempest-VolumeDependencyTests-2146631135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43743fd6-87c0-4c84-8c9f-63f9d3c72a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:52 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-c53ad4a3-0cf6-4084-9443-3c7694b39e28 tempest-VolumeDependencyTests-2146631135 None] Volume volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148 (f32e8a08-8198-4a7d-9bb9-ae3d8792d148): created successfully
Apr 15 20:13:52 devstack sudo[90091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-43e1bab6-2b9d-401a-92fc-25684fc9efae 1073741824
Apr 15 20:13:52 devstack sudo[90091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:52 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-c53ad4a3-0cf6-4084-9443-3c7694b39e28 tempest-VolumeDependencyTests-2146631135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43743fd6-87c0-4c84-8c9f-63f9d3c72a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:52 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-c53ad4a3-0cf6-4084-9443-3c7694b39e28 tempest-VolumeDependencyTests-2146631135 None] Flow 'volume_create_manager' (f707ecca-78ab-4a77-b561-c45bb96582a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:13:52 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-c53ad4a3-0cf6-4084-9443-3c7694b39e28 tempest-VolumeDependencyTests-2146631135 None] Created volume successfully.
Apr 15 20:13:53 devstack sudo[90091]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:53 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e6634808-4263-4a2e-be2d-0f74eafbf9b7 tempest-CreateVolumesFromImageTest-1411433811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-43e1bab6-2b9d-401a-92fc-25684fc9efae 1073741824" returned: 0 in 0.693s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:53 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e6634808-4263-4a2e-be2d-0f74eafbf9b7 tempest-CreateVolumesFromImageTest-1411433811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-43e1bab6-2b9d-401a-92fc-25684fc9efae {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:53 devstack sudo[90096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-43e1bab6-2b9d-401a-92fc-25684fc9efae
Apr 15 20:13:53 devstack sudo[90096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:53 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-a628bf8a-a795-461e-8011-0efde0add28a tempest-VolumeDependencyTests-2146631135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:13:53 devstack sudo[90096]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:53 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e6634808-4263-4a2e-be2d-0f74eafbf9b7 tempest-CreateVolumesFromImageTest-1411433811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-43e1bab6-2b9d-401a-92fc-25684fc9efae" returned: 0 in 0.520s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:53 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-e6634808-4263-4a2e-be2d-0f74eafbf9b7 tempest-CreateVolumesFromImageTest-1411433811 None] <== create_volume: return (1240ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:13:53 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-e6634808-4263-4a2e-be2d-0f74eafbf9b7 tempest-CreateVolumesFromImageTest-1411433811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.244s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:13:53 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-1e241841-df2c-400b-8193-995e6b822d97 tempest-CreateVolumesFromImageTest-1411433811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.358s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:13:53 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-1e241841-df2c-400b-8193-995e6b822d97 tempest-CreateVolumesFromImageTest-1411433811 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:13:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1764611435',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3626d4f6-ae90-419c-a12a-d2a7e96f46d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01fbb4654d23430e9bfc0e12f066e44d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:13:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:13:48Z,use_quota=True,user_id='52bb0d7f8f254afea568ca29b5f63557',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:13:53 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-1e241841-df2c-400b-8193-995e6b822d97 tempest-CreateVolumesFromImageTest-1411433811 None] Creating volume 3626d4f6-ae90-419c-a12a-d2a7e96f46d0 {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:13:53 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-1e241841-df2c-400b-8193-995e6b822d97 tempest-CreateVolumesFromImageTest-1411433811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:13:53 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-1e241841-df2c-400b-8193-995e6b822d97 tempest-CreateVolumesFromImageTest-1411433811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:13:53 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-1e241841-df2c-400b-8193-995e6b822d97 tempest-CreateVolumesFromImageTest-1411433811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:13:53 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-1e241841-df2c-400b-8193-995e6b822d97 tempest-CreateVolumesFromImageTest-1411433811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:13:53 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-1e241841-df2c-400b-8193-995e6b822d97 tempest-CreateVolumesFromImageTest-1411433811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:13:53 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-1e241841-df2c-400b-8193-995e6b822d97 tempest-CreateVolumesFromImageTest-1411433811 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:13:53 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-1e241841-df2c-400b-8193-995e6b822d97 tempest-CreateVolumesFromImageTest-1411433811 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:13:53 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-1e241841-df2c-400b-8193-995e6b822d97 tempest-CreateVolumesFromImageTest-1411433811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3626d4f6-ae90-419c-a12a-d2a7e96f46d0 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:53 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e6634808-4263-4a2e-be2d-0f74eafbf9b7 tempest-CreateVolumesFromImageTest-1411433811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd34dd8b-97b2-4f21-b846-ebf764b142bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43e1bab6-2b9d-401a-92fc-25684fc9efae', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:53 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e6634808-4263-4a2e-be2d-0f74eafbf9b7 tempest-CreateVolumesFromImageTest-1411433811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4e58af4-77fd-4e65-80f1-d8d930e5700f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:53 devstack sudo[90099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3626d4f6-ae90-419c-a12a-d2a7e96f46d0 1073741824
Apr 15 20:13:53 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-e6634808-4263-4a2e-be2d-0f74eafbf9b7 tempest-CreateVolumesFromImageTest-1411433811 None] Volume volume-43e1bab6-2b9d-401a-92fc-25684fc9efae (43e1bab6-2b9d-401a-92fc-25684fc9efae): created successfully
Apr 15 20:13:53 devstack sudo[90099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:53 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e6634808-4263-4a2e-be2d-0f74eafbf9b7 tempest-CreateVolumesFromImageTest-1411433811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4e58af4-77fd-4e65-80f1-d8d930e5700f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:53 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-e6634808-4263-4a2e-be2d-0f74eafbf9b7 tempest-CreateVolumesFromImageTest-1411433811 None] Flow 'volume_create_manager' (df04fc4a-12a8-4b61-a522-362fd3b390e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:13:53 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-e6634808-4263-4a2e-be2d-0f74eafbf9b7 tempest-CreateVolumesFromImageTest-1411433811 None] Created volume successfully.
Apr 15 20:13:54 devstack sudo[90099]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:54 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-1e241841-df2c-400b-8193-995e6b822d97 tempest-CreateVolumesFromImageTest-1411433811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3626d4f6-ae90-419c-a12a-d2a7e96f46d0 1073741824" returned: 0 in 0.709s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:54 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-1e241841-df2c-400b-8193-995e6b822d97 tempest-CreateVolumesFromImageTest-1411433811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3626d4f6-ae90-419c-a12a-d2a7e96f46d0 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:54 devstack sudo[90104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3626d4f6-ae90-419c-a12a-d2a7e96f46d0
Apr 15 20:13:54 devstack sudo[90104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:54 devstack sudo[90104]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:54 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-1e241841-df2c-400b-8193-995e6b822d97 tempest-CreateVolumesFromImageTest-1411433811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3626d4f6-ae90-419c-a12a-d2a7e96f46d0" returned: 0 in 0.491s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:54 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-1e241841-df2c-400b-8193-995e6b822d97 tempest-CreateVolumesFromImageTest-1411433811 None] <== create_volume: return (1235ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:13:54 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-1e241841-df2c-400b-8193-995e6b822d97 tempest-CreateVolumesFromImageTest-1411433811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.241s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:13:55 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-fc8d3654-05c2-492f-a5d5-5a592c0c958a tempest-CreateVolumesFromImageTest-1411433811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.340s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:13:55 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-fc8d3654-05c2-492f-a5d5-5a592c0c958a tempest-CreateVolumesFromImageTest-1411433811 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:13:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1202249863',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9f3c489-1b69-4bc1-8ba9-49f07a168f3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01fbb4654d23430e9bfc0e12f066e44d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:13:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:13:49Z,use_quota=True,user_id='52bb0d7f8f254afea568ca29b5f63557',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:13:55 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-fc8d3654-05c2-492f-a5d5-5a592c0c958a tempest-CreateVolumesFromImageTest-1411433811 None] Creating volume a9f3c489-1b69-4bc1-8ba9-49f07a168f3b {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:13:55 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-fc8d3654-05c2-492f-a5d5-5a592c0c958a tempest-CreateVolumesFromImageTest-1411433811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:13:55 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-fc8d3654-05c2-492f-a5d5-5a592c0c958a tempest-CreateVolumesFromImageTest-1411433811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:13:55 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-fc8d3654-05c2-492f-a5d5-5a592c0c958a tempest-CreateVolumesFromImageTest-1411433811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:13:55 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-fc8d3654-05c2-492f-a5d5-5a592c0c958a tempest-CreateVolumesFromImageTest-1411433811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:13:55 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-fc8d3654-05c2-492f-a5d5-5a592c0c958a tempest-CreateVolumesFromImageTest-1411433811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:13:55 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-fc8d3654-05c2-492f-a5d5-5a592c0c958a tempest-CreateVolumesFromImageTest-1411433811 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:13:55 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-fc8d3654-05c2-492f-a5d5-5a592c0c958a tempest-CreateVolumesFromImageTest-1411433811 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:13:55 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-fc8d3654-05c2-492f-a5d5-5a592c0c958a tempest-CreateVolumesFromImageTest-1411433811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a9f3c489-1b69-4bc1-8ba9-49f07a168f3b 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:55 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-1e241841-df2c-400b-8193-995e6b822d97 tempest-CreateVolumesFromImageTest-1411433811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93a26e74-4c21-4a13-a0f2-1e4ab028341c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3626d4f6-ae90-419c-a12a-d2a7e96f46d0', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:55 devstack sudo[90107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a9f3c489-1b69-4bc1-8ba9-49f07a168f3b 1073741824
Apr 15 20:13:55 devstack sudo[90107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:55 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-1e241841-df2c-400b-8193-995e6b822d97 tempest-CreateVolumesFromImageTest-1411433811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fb0e330-5a89-482a-88bf-d51d72794db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:55 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-1e241841-df2c-400b-8193-995e6b822d97 tempest-CreateVolumesFromImageTest-1411433811 None] Volume volume-3626d4f6-ae90-419c-a12a-d2a7e96f46d0 (3626d4f6-ae90-419c-a12a-d2a7e96f46d0): created successfully
Apr 15 20:13:55 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-1e241841-df2c-400b-8193-995e6b822d97 tempest-CreateVolumesFromImageTest-1411433811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fb0e330-5a89-482a-88bf-d51d72794db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:55 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-1e241841-df2c-400b-8193-995e6b822d97 tempest-CreateVolumesFromImageTest-1411433811 None] Flow 'volume_create_manager' (1ac05de2-5b3a-41e6-9989-16570ff0c6df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:13:55 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-1e241841-df2c-400b-8193-995e6b822d97 tempest-CreateVolumesFromImageTest-1411433811 None] Created volume successfully.
Apr 15 20:13:55 devstack sudo[90107]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:55 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-fc8d3654-05c2-492f-a5d5-5a592c0c958a tempest-CreateVolumesFromImageTest-1411433811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a9f3c489-1b69-4bc1-8ba9-49f07a168f3b 1073741824" returned: 0 in 0.683s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:55 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-fc8d3654-05c2-492f-a5d5-5a592c0c958a tempest-CreateVolumesFromImageTest-1411433811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a9f3c489-1b69-4bc1-8ba9-49f07a168f3b {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:55 devstack sudo[90112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a9f3c489-1b69-4bc1-8ba9-49f07a168f3b
Apr 15 20:13:55 devstack sudo[90112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:56 devstack sudo[90112]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:56 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-fc8d3654-05c2-492f-a5d5-5a592c0c958a tempest-CreateVolumesFromImageTest-1411433811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a9f3c489-1b69-4bc1-8ba9-49f07a168f3b" returned: 0 in 0.507s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:56 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-fc8d3654-05c2-492f-a5d5-5a592c0c958a tempest-CreateVolumesFromImageTest-1411433811 None] <== create_volume: return (1221ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:13:56 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-fc8d3654-05c2-492f-a5d5-5a592c0c958a tempest-CreateVolumesFromImageTest-1411433811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.225s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:13:56 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-b2a5898e-efd5-46b0-a3e6-ea4e71311ca6 tempest-CreateVolumesFromSnapshotTest-622878184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.443s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:13:56 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-fc8d3654-05c2-492f-a5d5-5a592c0c958a tempest-CreateVolumesFromImageTest-1411433811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7473a76-744b-4019-8a2a-2a86c8e9e832) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9f3c489-1b69-4bc1-8ba9-49f07a168f3b', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:56 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-fc8d3654-05c2-492f-a5d5-5a592c0c958a tempest-CreateVolumesFromImageTest-1411433811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (901baa0d-dd67-4b4b-967a-58e1d887d483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:13:56 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-b2a5898e-efd5-46b0-a3e6-ea4e71311ca6 tempest-CreateVolumesFromSnapshotTest-622878184 None] Creating offline snapshot 76302e0a-bcb5-4d9d-b854-4c87e8c3e78b of volume 92c99b8f-2c94-4461-8171-4f079b482500 {{(pid=82646) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 20:13:56 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-fc8d3654-05c2-492f-a5d5-5a592c0c958a tempest-CreateVolumesFromImageTest-1411433811 None] Volume volume-a9f3c489-1b69-4bc1-8ba9-49f07a168f3b (a9f3c489-1b69-4bc1-8ba9-49f07a168f3b): created successfully
Apr 15 20:13:56 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-fc8d3654-05c2-492f-a5d5-5a592c0c958a tempest-CreateVolumesFromImageTest-1411433811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (901baa0d-dd67-4b4b-967a-58e1d887d483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:13:56 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-fc8d3654-05c2-492f-a5d5-5a592c0c958a tempest-CreateVolumesFromImageTest-1411433811 None] Flow 'volume_create_manager' (c55025c6-084b-4988-b158-9da78c31475c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:13:56 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2304fb2-6d56-4ac4-955f-a792356cf0c7]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:13:56 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b2a5898e-efd5-46b0-a3e6-ea4e71311ca6 tempest-CreateVolumesFromSnapshotTest-622878184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-92c99b8f-2c94-4461-8171-4f079b482500 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:56 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-fc8d3654-05c2-492f-a5d5-5a592c0c958a tempest-CreateVolumesFromImageTest-1411433811 None] Created volume successfully.
Apr 15 20:13:56 devstack sudo[90116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-92c99b8f-2c94-4461-8171-4f079b482500
Apr 15 20:13:56 devstack sudo[90116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:56 devstack sudo[90116]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:56 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b2a5898e-efd5-46b0-a3e6-ea4e71311ca6 tempest-CreateVolumesFromSnapshotTest-622878184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-92c99b8f-2c94-4461-8171-4f079b482500" returned: 0 in 0.597s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:56 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b2a5898e-efd5-46b0-a3e6-ea4e71311ca6 tempest-CreateVolumesFromSnapshotTest-622878184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-92c99b8f-2c94-4461-8171-4f079b482500,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-92c99b8f-2c94-4461-8171-4f079b482500.76302e0a-bcb5-4d9d-b854-4c87e8c3e78b 1G {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:56 devstack sudo[90121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-92c99b8f-2c94-4461-8171-4f079b482500,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-92c99b8f-2c94-4461-8171-4f079b482500.76302e0a-bcb5-4d9d-b854-4c87e8c3e78b 1G
Apr 15 20:13:56 devstack sudo[90121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:57 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-eeed4602-f108-4a59-a429-615692b45121 tempest-CreateVolumesFromImageTest-1411433811 None] Acquiring lock "cinder-a9f3c489-1b69-4bc1-8ba9-49f07a168f3b-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:13:57 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-eeed4602-f108-4a59-a429-615692b45121 tempest-CreateVolumesFromImageTest-1411433811 None] Lock "cinder-a9f3c489-1b69-4bc1-8ba9-49f07a168f3b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:13:57 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-eeed4602-f108-4a59-a429-615692b45121 tempest-CreateVolumesFromImageTest-1411433811 None] Acquiring lock "cinder-quobyte-a9f3c489-1b69-4bc1-8ba9-49f07a168f3b" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:13:57 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-eeed4602-f108-4a59-a429-615692b45121 tempest-CreateVolumesFromImageTest-1411433811 None] Lock "cinder-quobyte-a9f3c489-1b69-4bc1-8ba9-49f07a168f3b" acquired by "delete_volume" :: waited 0.014s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:13:57 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[4734bb36-b646-4930-8a84-5f19f641a009]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:13:57 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-eeed4602-f108-4a59-a429-615692b45121 tempest-CreateVolumesFromImageTest-1411433811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a9f3c489-1b69-4bc1-8ba9-49f07a168f3b {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:57 devstack sudo[90125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a9f3c489-1b69-4bc1-8ba9-49f07a168f3b
Apr 15 20:13:57 devstack sudo[90125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:57 devstack sudo[90121]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:57 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b2a5898e-efd5-46b0-a3e6-ea4e71311ca6 tempest-CreateVolumesFromSnapshotTest-622878184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-92c99b8f-2c94-4461-8171-4f079b482500,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-92c99b8f-2c94-4461-8171-4f079b482500.76302e0a-bcb5-4d9d-b854-4c87e8c3e78b 1G" returned: 0 in 0.668s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:57 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b2a5898e-efd5-46b0-a3e6-ea4e71311ca6 tempest-CreateVolumesFromSnapshotTest-622878184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92c99b8f-2c94-4461-8171-4f079b482500 -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-92c99b8f-2c94-4461-8171-4f079b482500.76302e0a-bcb5-4d9d-b854-4c87e8c3e78b {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:57 devstack sudo[90128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92c99b8f-2c94-4461-8171-4f079b482500 -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-92c99b8f-2c94-4461-8171-4f079b482500.76302e0a-bcb5-4d9d-b854-4c87e8c3e78b
Apr 15 20:13:57 devstack sudo[90128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:58 devstack sudo[90125]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:58 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-eeed4602-f108-4a59-a429-615692b45121 tempest-CreateVolumesFromImageTest-1411433811 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a9f3c489-1b69-4bc1-8ba9-49f07a168f3b" returned: 0 in 0.698s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:58 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-eeed4602-f108-4a59-a429-615692b45121 tempest-CreateVolumesFromImageTest-1411433811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a9f3c489-1b69-4bc1-8ba9-49f07a168f3b {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:58 devstack sudo[90128]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:58 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b2a5898e-efd5-46b0-a3e6-ea4e71311ca6 tempest-CreateVolumesFromSnapshotTest-622878184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92c99b8f-2c94-4461-8171-4f079b482500 -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-92c99b8f-2c94-4461-8171-4f079b482500.76302e0a-bcb5-4d9d-b854-4c87e8c3e78b" returned: 0 in 0.527s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:58 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-b2a5898e-efd5-46b0-a3e6-ea4e71311ca6 tempest-CreateVolumesFromSnapshotTest-622878184 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-92c99b8f-2c94-4461-8171-4f079b482500.76302e0a-bcb5-4d9d-b854-4c87e8c3e78b is being set with open permissions: ugo+rw
Apr 15 20:13:58 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b2a5898e-efd5-46b0-a3e6-ea4e71311ca6 tempest-CreateVolumesFromSnapshotTest-622878184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-92c99b8f-2c94-4461-8171-4f079b482500.76302e0a-bcb5-4d9d-b854-4c87e8c3e78b {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:58 devstack sudo[90136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a9f3c489-1b69-4bc1-8ba9-49f07a168f3b
Apr 15 20:13:58 devstack sudo[90136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:58 devstack sudo[90137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-92c99b8f-2c94-4461-8171-4f079b482500.76302e0a-bcb5-4d9d-b854-4c87e8c3e78b
Apr 15 20:13:58 devstack sudo[90137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:58 devstack sudo[90137]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:58 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b2a5898e-efd5-46b0-a3e6-ea4e71311ca6 tempest-CreateVolumesFromSnapshotTest-622878184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-92c99b8f-2c94-4461-8171-4f079b482500.76302e0a-bcb5-4d9d-b854-4c87e8c3e78b" returned: 0 in 0.494s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:58 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b2a5898e-efd5-46b0-a3e6-ea4e71311ca6 tempest-CreateVolumesFromSnapshotTest-622878184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-92c99b8f-2c94-4461-8171-4f079b482500.info {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:58 devstack sudo[90142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-92c99b8f-2c94-4461-8171-4f079b482500.info
Apr 15 20:13:58 devstack sudo[90142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:58 devstack sudo[90136]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:58 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-eeed4602-f108-4a59-a429-615692b45121 tempest-CreateVolumesFromImageTest-1411433811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a9f3c489-1b69-4bc1-8ba9-49f07a168f3b" returned: 0 in 0.635s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:58 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-eeed4602-f108-4a59-a429-615692b45121 tempest-CreateVolumesFromImageTest-1411433811 None] Lock "cinder-quobyte-a9f3c489-1b69-4bc1-8ba9-49f07a168f3b" released by "delete_volume" :: held 1.365s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:13:58 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-eeed4602-f108-4a59-a429-615692b45121 tempest-CreateVolumesFromImageTest-1411433811 None] Created reservations ['86326961-2c41-4489-b51d-575a918650ee', '771f338d-b9a7-497a-8c48-e2db4ca78b5e', '993336f2-5fdc-48a4-aadc-9a574b167e53', '70f454ea-9093-46ae-a0c7-795254f04199'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:13:58 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-eeed4602-f108-4a59-a429-615692b45121 tempest-CreateVolumesFromImageTest-1411433811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:13:58 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-eeed4602-f108-4a59-a429-615692b45121 tempest-CreateVolumesFromImageTest-1411433811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:13:58 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-eeed4602-f108-4a59-a429-615692b45121 tempest-CreateVolumesFromImageTest-1411433811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:13:58 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-eeed4602-f108-4a59-a429-615692b45121 tempest-CreateVolumesFromImageTest-1411433811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:13:58 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-eeed4602-f108-4a59-a429-615692b45121 tempest-CreateVolumesFromImageTest-1411433811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:13:58 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-eeed4602-f108-4a59-a429-615692b45121 tempest-CreateVolumesFromImageTest-1411433811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:58 devstack sudo[90144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:13:58 devstack sudo[90144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:59 devstack sudo[90142]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:59 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b2a5898e-efd5-46b0-a3e6-ea4e71311ca6 tempest-CreateVolumesFromSnapshotTest-622878184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-92c99b8f-2c94-4461-8171-4f079b482500.info" returned: 0 in 0.550s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:59 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-b2a5898e-efd5-46b0-a3e6-ea4e71311ca6 tempest-CreateVolumesFromSnapshotTest-622878184 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-92c99b8f-2c94-4461-8171-4f079b482500.info is being set with open permissions: ugo+rw
Apr 15 20:13:59 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b2a5898e-efd5-46b0-a3e6-ea4e71311ca6 tempest-CreateVolumesFromSnapshotTest-622878184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-92c99b8f-2c94-4461-8171-4f079b482500.info {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:59 devstack sudo[90147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-92c99b8f-2c94-4461-8171-4f079b482500.info
Apr 15 20:13:59 devstack sudo[90147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:59 devstack sudo[90144]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:59 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-eeed4602-f108-4a59-a429-615692b45121 tempest-CreateVolumesFromImageTest-1411433811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.452s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:59 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-eeed4602-f108-4a59-a429-615692b45121 tempest-CreateVolumesFromImageTest-1411433811 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:13:59 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-eeed4602-f108-4a59-a429-615692b45121 tempest-CreateVolumesFromImageTest-1411433811 None] Deleted volume successfully.
Apr 15 20:13:59 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-eeed4602-f108-4a59-a429-615692b45121 tempest-CreateVolumesFromImageTest-1411433811 None] Lock "cinder-a9f3c489-1b69-4bc1-8ba9-49f07a168f3b-delete_volume" released by "delete_volume" :: held 2.012s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:13:59 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-bcab4f41-6e40-48d9-a089-437aac467d03 tempest-CreateVolumesFromImageTest-1411433811 None] Acquiring lock "cinder-3626d4f6-ae90-419c-a12a-d2a7e96f46d0-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:13:59 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-bcab4f41-6e40-48d9-a089-437aac467d03 tempest-CreateVolumesFromImageTest-1411433811 None] Lock "cinder-3626d4f6-ae90-419c-a12a-d2a7e96f46d0-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:13:59 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-bcab4f41-6e40-48d9-a089-437aac467d03 tempest-CreateVolumesFromImageTest-1411433811 None] Acquiring lock "cinder-quobyte-3626d4f6-ae90-419c-a12a-d2a7e96f46d0" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:13:59 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-bcab4f41-6e40-48d9-a089-437aac467d03 tempest-CreateVolumesFromImageTest-1411433811 None] Lock "cinder-quobyte-3626d4f6-ae90-419c-a12a-d2a7e96f46d0" acquired by "delete_volume" :: waited 0.010s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:13:59 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb85f918-662b-440b-9f15-5903a54b3d57]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:13:59 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bcab4f41-6e40-48d9-a089-437aac467d03 tempest-CreateVolumesFromImageTest-1411433811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3626d4f6-ae90-419c-a12a-d2a7e96f46d0 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:59 devstack sudo[90150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3626d4f6-ae90-419c-a12a-d2a7e96f46d0
Apr 15 20:13:59 devstack sudo[90150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:13:59 devstack sudo[90147]: pam_unix(sudo:session): session closed for user root
Apr 15 20:13:59 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b2a5898e-efd5-46b0-a3e6-ea4e71311ca6 tempest-CreateVolumesFromSnapshotTest-622878184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-92c99b8f-2c94-4461-8171-4f079b482500.info" returned: 0 in 0.623s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:13:59 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-b2a5898e-efd5-46b0-a3e6-ea4e71311ca6 tempest-CreateVolumesFromSnapshotTest-622878184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.603s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:13:59 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-a628bf8a-a795-461e-8011-0efde0add28a tempest-VolumeDependencyTests-2146631135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.465s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:13:59 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-a628bf8a-a795-461e-8011-0efde0add28a tempest-VolumeDependencyTests-2146631135 None] Creating offline snapshot d19b377d-98df-4d17-9bbc-39a0a0ec8db4 of volume f32e8a08-8198-4a7d-9bb9-ae3d8792d148 {{(pid=82646) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 20:13:59 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-b2a5898e-efd5-46b0-a3e6-ea4e71311ca6 tempest-CreateVolumesFromSnapshotTest-622878184 None] Create snapshot completed successfully
Apr 15 20:13:59 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[940b7e76-a0d9-499a-beaf-1930d76dde98]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:13:59 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-a628bf8a-a795-461e-8011-0efde0add28a tempest-VolumeDependencyTests-2146631135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:13:59 devstack sudo[90154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148
Apr 15 20:13:59 devstack sudo[90154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:00 devstack sudo[90150]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:00 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bcab4f41-6e40-48d9-a089-437aac467d03 tempest-CreateVolumesFromImageTest-1411433811 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3626d4f6-ae90-419c-a12a-d2a7e96f46d0" returned: 0 in 0.586s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:00 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bcab4f41-6e40-48d9-a089-437aac467d03 tempest-CreateVolumesFromImageTest-1411433811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3626d4f6-ae90-419c-a12a-d2a7e96f46d0 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:00 devstack sudo[90159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3626d4f6-ae90-419c-a12a-d2a7e96f46d0
Apr 15 20:14:00 devstack sudo[90159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:00 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-9667a736-6dd6-4f41-83d7-ae7f7b70583e tempest-CreateVolumesFromSnapshotTest-622878184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:14:00 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-9667a736-6dd6-4f41-83d7-ae7f7b70583e tempest-CreateVolumesFromSnapshotTest-622878184 None] Flow 'volume_create_manager' (4fad446f-aa58-4f7b-80c3-470a7c130139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:14:00 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-9667a736-6dd6-4f41-83d7-ae7f7b70583e tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a242760-f1f6-43a5-9236-378a0c5e0ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:00 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-9667a736-6dd6-4f41-83d7-ae7f7b70583e tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a242760-f1f6-43a5-9236-378a0c5e0ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:14:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-457291345',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96e5d05f-a5b8-4dc6-b3dd-5d5d47d34a5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90296888d81a4c4cae42d9852422dd46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:00Z,use_quota=True,user_id='d4475abfc80947bc8c8e17117bb58bb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:00 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-9667a736-6dd6-4f41-83d7-ae7f7b70583e tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd033178-b1c9-4409-b8c4-25539ffc37cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:00 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-9667a736-6dd6-4f41-83d7-ae7f7b70583e tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd033178-b1c9-4409-b8c4-25539ffc37cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:00 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-9667a736-6dd6-4f41-83d7-ae7f7b70583e tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55915153-b018-42de-86d7-8880cea5b0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:00 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-9667a736-6dd6-4f41-83d7-ae7f7b70583e tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55915153-b018-42de-86d7-8880cea5b0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96e5d05f-a5b8-4dc6-b3dd-5d5d47d34a5c', 'volume_name': 'volume-96e5d05f-a5b8-4dc6-b3dd-5d5d47d34a5c', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:00 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-9667a736-6dd6-4f41-83d7-ae7f7b70583e tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04d18e73-a110-4501-8acf-cd2590e9a742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:00 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-9667a736-6dd6-4f41-83d7-ae7f7b70583e tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04d18e73-a110-4501-8acf-cd2590e9a742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:00 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-9667a736-6dd6-4f41-83d7-ae7f7b70583e tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e85c0fd-5a8f-4ec0-91cd-b11279569562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:00 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-9667a736-6dd6-4f41-83d7-ae7f7b70583e tempest-CreateVolumesFromSnapshotTest-622878184 None] Volume 96e5d05f-a5b8-4dc6-b3dd-5d5d47d34a5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96e5d05f-a5b8-4dc6-b3dd-5d5d47d34a5c', 'volume_size': 1}
Apr 15 20:14:00 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-9667a736-6dd6-4f41-83d7-ae7f7b70583e tempest-CreateVolumesFromSnapshotTest-622878184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:14:00 devstack sudo[90154]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:00 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-a628bf8a-a795-461e-8011-0efde0add28a tempest-VolumeDependencyTests-2146631135 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148" returned: 0 in 0.841s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:00 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-a628bf8a-a795-461e-8011-0efde0add28a tempest-VolumeDependencyTests-2146631135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148.d19b377d-98df-4d17-9bbc-39a0a0ec8db4 1G {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:00 devstack sudo[90164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148.d19b377d-98df-4d17-9bbc-39a0a0ec8db4 1G
Apr 15 20:14:00 devstack sudo[90164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:00 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c8324e3-127f-4773-a99d-8137298f5b96 tempest-CreateVolumesFromSnapshotTest-622878184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:14:00 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-7c8324e3-127f-4773-a99d-8137298f5b96 tempest-CreateVolumesFromSnapshotTest-622878184 None] Flow 'volume_create_manager' (c0413606-3d18-4b13-8b7a-b5adda1af394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:14:00 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-7c8324e3-127f-4773-a99d-8137298f5b96 tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19dab5c1-3434-4bea-83a0-57eb8ce29157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:00 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-7c8324e3-127f-4773-a99d-8137298f5b96 tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19dab5c1-3434-4bea-83a0-57eb8ce29157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:14:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1838224461',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c016cca-c76a-4651-8946-5799661120d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90296888d81a4c4cae42d9852422dd46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:01Z,use_quota=True,user_id='d4475abfc80947bc8c8e17117bb58bb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:00 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-7c8324e3-127f-4773-a99d-8137298f5b96 tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a07e466-66a5-4f87-9627-8ef6f7ad9c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:00 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-7c8324e3-127f-4773-a99d-8137298f5b96 tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a07e466-66a5-4f87-9627-8ef6f7ad9c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:00 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-7c8324e3-127f-4773-a99d-8137298f5b96 tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbb46c52-6b94-4510-bc97-f773b62e21b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:00 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-7c8324e3-127f-4773-a99d-8137298f5b96 tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbb46c52-6b94-4510-bc97-f773b62e21b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c016cca-c76a-4651-8946-5799661120d6', 'volume_name': 'volume-8c016cca-c76a-4651-8946-5799661120d6', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:00 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-7c8324e3-127f-4773-a99d-8137298f5b96 tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad785e9a-033c-456d-844f-66a627130440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:00 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-7c8324e3-127f-4773-a99d-8137298f5b96 tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad785e9a-033c-456d-844f-66a627130440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:00 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-7c8324e3-127f-4773-a99d-8137298f5b96 tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a262ce04-128a-48fd-877d-6c4393ea1433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:00 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-7c8324e3-127f-4773-a99d-8137298f5b96 tempest-CreateVolumesFromSnapshotTest-622878184 None] Volume 8c016cca-c76a-4651-8946-5799661120d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c016cca-c76a-4651-8946-5799661120d6', 'volume_size': 1}
Apr 15 20:14:00 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-7c8324e3-127f-4773-a99d-8137298f5b96 tempest-CreateVolumesFromSnapshotTest-622878184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:14:01 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-d68fd06a-f01c-4e43-bd32-fe80cade1515 tempest-CreateVolumesFromSnapshotTest-622878184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:14:01 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d68fd06a-f01c-4e43-bd32-fe80cade1515 tempest-CreateVolumesFromSnapshotTest-622878184 None] Flow 'volume_create_manager' (f531d5fa-b503-4c7f-bfc4-b10e1e093dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:14:01 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d68fd06a-f01c-4e43-bd32-fe80cade1515 tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d83d288-166c-4500-8b4d-ba42e4a1f153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:01 devstack sudo[90159]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:01 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d68fd06a-f01c-4e43-bd32-fe80cade1515 tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d83d288-166c-4500-8b4d-ba42e4a1f153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:14:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1199522750',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3af14053-bcc4-48c3-b23a-e2203150e87b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90296888d81a4c4cae42d9852422dd46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:01Z,use_quota=True,user_id='d4475abfc80947bc8c8e17117bb58bb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:01 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d68fd06a-f01c-4e43-bd32-fe80cade1515 tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb265731-1d43-480c-a70a-2ab58f178c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:01 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d68fd06a-f01c-4e43-bd32-fe80cade1515 tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb265731-1d43-480c-a70a-2ab58f178c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:01 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d68fd06a-f01c-4e43-bd32-fe80cade1515 tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf200018-f713-4de4-87de-15596ab0c0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:01 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d68fd06a-f01c-4e43-bd32-fe80cade1515 tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf200018-f713-4de4-87de-15596ab0c0d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3af14053-bcc4-48c3-b23a-e2203150e87b', 'volume_name': 'volume-3af14053-bcc4-48c3-b23a-e2203150e87b', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:01 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d68fd06a-f01c-4e43-bd32-fe80cade1515 tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c54fe304-9f67-46dd-8341-3a2d0c01c962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:01 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d68fd06a-f01c-4e43-bd32-fe80cade1515 tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c54fe304-9f67-46dd-8341-3a2d0c01c962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:01 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d68fd06a-f01c-4e43-bd32-fe80cade1515 tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b1bce7d-1c83-41f3-b977-bf2ab5f08b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:01 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-d68fd06a-f01c-4e43-bd32-fe80cade1515 tempest-CreateVolumesFromSnapshotTest-622878184 None] Volume 3af14053-bcc4-48c3-b23a-e2203150e87b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3af14053-bcc4-48c3-b23a-e2203150e87b', 'volume_size': 1}
Apr 15 20:14:01 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-d68fd06a-f01c-4e43-bd32-fe80cade1515 tempest-CreateVolumesFromSnapshotTest-622878184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:14:01 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bcab4f41-6e40-48d9-a089-437aac467d03 tempest-CreateVolumesFromImageTest-1411433811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3626d4f6-ae90-419c-a12a-d2a7e96f46d0" returned: 0 in 0.931s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:01 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-bcab4f41-6e40-48d9-a089-437aac467d03 tempest-CreateVolumesFromImageTest-1411433811 None] Lock "cinder-quobyte-3626d4f6-ae90-419c-a12a-d2a7e96f46d0" released by "delete_volume" :: held 1.544s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:14:01 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-bcab4f41-6e40-48d9-a089-437aac467d03 tempest-CreateVolumesFromImageTest-1411433811 None] Created reservations ['f7d47036-9a89-4ce8-b571-8bd6e91277f4', 'ea72026f-b947-42e3-860a-93d3165b05c1', 'f25e2851-da31-432f-baae-e6deb579d5c0', '4411f5a2-e72d-4eb0-bc9b-191ac328505f'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:14:01 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-bcab4f41-6e40-48d9-a089-437aac467d03 tempest-CreateVolumesFromImageTest-1411433811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:14:01 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-bcab4f41-6e40-48d9-a089-437aac467d03 tempest-CreateVolumesFromImageTest-1411433811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:14:01 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-bcab4f41-6e40-48d9-a089-437aac467d03 tempest-CreateVolumesFromImageTest-1411433811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:14:01 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-bcab4f41-6e40-48d9-a089-437aac467d03 tempest-CreateVolumesFromImageTest-1411433811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:14:01 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-bcab4f41-6e40-48d9-a089-437aac467d03 tempest-CreateVolumesFromImageTest-1411433811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:14:01 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bcab4f41-6e40-48d9-a089-437aac467d03 tempest-CreateVolumesFromImageTest-1411433811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:01 devstack sudo[90167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:14:01 devstack sudo[90167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:01 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff5ba38c-2ba0-4604-9321-9f346b2bf90d tempest-CreateVolumesFromSnapshotTest-622878184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:14:01 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ff5ba38c-2ba0-4604-9321-9f346b2bf90d tempest-CreateVolumesFromSnapshotTest-622878184 None] Flow 'volume_create_manager' (36fe8d53-260f-4bbb-a31a-d9f58c1ce68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:14:01 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ff5ba38c-2ba0-4604-9321-9f346b2bf90d tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78f45fc4-e994-4bac-93ae-3e2e7f00a8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:01 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ff5ba38c-2ba0-4604-9321-9f346b2bf90d tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78f45fc4-e994-4bac-93ae-3e2e7f00a8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:14:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-798143307',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=309a5d32-e062-49ea-a68e-3630952bf1f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90296888d81a4c4cae42d9852422dd46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:01Z,use_quota=True,user_id='d4475abfc80947bc8c8e17117bb58bb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:01 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ff5ba38c-2ba0-4604-9321-9f346b2bf90d tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (897691a8-f9ab-4a6b-8fc2-1f49411a887e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:01 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ff5ba38c-2ba0-4604-9321-9f346b2bf90d tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (897691a8-f9ab-4a6b-8fc2-1f49411a887e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:01 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ff5ba38c-2ba0-4604-9321-9f346b2bf90d tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baa34a24-b684-49d6-9637-b28fecf9dd2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:01 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ff5ba38c-2ba0-4604-9321-9f346b2bf90d tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baa34a24-b684-49d6-9637-b28fecf9dd2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '309a5d32-e062-49ea-a68e-3630952bf1f6', 'volume_name': 'volume-309a5d32-e062-49ea-a68e-3630952bf1f6', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:01 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ff5ba38c-2ba0-4604-9321-9f346b2bf90d tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6f16121-82bf-48ae-873c-8b2021f27c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:01 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ff5ba38c-2ba0-4604-9321-9f346b2bf90d tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6f16121-82bf-48ae-873c-8b2021f27c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:01 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ff5ba38c-2ba0-4604-9321-9f346b2bf90d tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18a3c04d-78d0-4b22-90bc-c6013f3e3ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:01 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-ff5ba38c-2ba0-4604-9321-9f346b2bf90d tempest-CreateVolumesFromSnapshotTest-622878184 None] Volume 309a5d32-e062-49ea-a68e-3630952bf1f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-309a5d32-e062-49ea-a68e-3630952bf1f6', 'volume_size': 1}
Apr 15 20:14:01 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-ff5ba38c-2ba0-4604-9321-9f346b2bf90d tempest-CreateVolumesFromSnapshotTest-622878184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:14:01 devstack sudo[90164]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:01 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-a628bf8a-a795-461e-8011-0efde0add28a tempest-VolumeDependencyTests-2146631135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148.d19b377d-98df-4d17-9bbc-39a0a0ec8db4 1G" returned: 0 in 0.791s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:01 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-a628bf8a-a795-461e-8011-0efde0add28a tempest-VolumeDependencyTests-2146631135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148 -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148.d19b377d-98df-4d17-9bbc-39a0a0ec8db4 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:01 devstack sudo[90172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148 -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148.d19b377d-98df-4d17-9bbc-39a0a0ec8db4
Apr 15 20:14:01 devstack sudo[90172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:01 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-95d29919-eab8-4ab7-b694-4187dda9f422 tempest-CreateVolumesFromSnapshotTest-622878184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:14:01 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-95d29919-eab8-4ab7-b694-4187dda9f422 tempest-CreateVolumesFromSnapshotTest-622878184 None] Flow 'volume_create_manager' (59c07e99-bd81-4050-967b-9e441dcfb5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:14:01 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-95d29919-eab8-4ab7-b694-4187dda9f422 tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28f1b826-a372-4656-a269-351e7463f660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:01 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-95d29919-eab8-4ab7-b694-4187dda9f422 tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28f1b826-a372-4656-a269-351e7463f660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:14:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-629873220',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bd2d8c5-6218-4626-965b-f0d11412e3c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90296888d81a4c4cae42d9852422dd46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:02Z,use_quota=True,user_id='d4475abfc80947bc8c8e17117bb58bb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:01 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-95d29919-eab8-4ab7-b694-4187dda9f422 tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c54ed699-99bd-443d-b22e-b6244b52c1a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:01 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-95d29919-eab8-4ab7-b694-4187dda9f422 tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c54ed699-99bd-443d-b22e-b6244b52c1a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:01 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-95d29919-eab8-4ab7-b694-4187dda9f422 tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9b22515-5987-42dc-b3cb-7d5754b03d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:01 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-95d29919-eab8-4ab7-b694-4187dda9f422 tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9b22515-5987-42dc-b3cb-7d5754b03d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bd2d8c5-6218-4626-965b-f0d11412e3c0', 'volume_name': 'volume-5bd2d8c5-6218-4626-965b-f0d11412e3c0', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:01 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-95d29919-eab8-4ab7-b694-4187dda9f422 tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc43f36d-e7bf-4b03-be54-c8bc8b76c593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:01 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-95d29919-eab8-4ab7-b694-4187dda9f422 tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc43f36d-e7bf-4b03-be54-c8bc8b76c593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:01 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-95d29919-eab8-4ab7-b694-4187dda9f422 tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (741135fc-6deb-4bc8-a770-552736ff18af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:01 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-95d29919-eab8-4ab7-b694-4187dda9f422 tempest-CreateVolumesFromSnapshotTest-622878184 None] Volume 5bd2d8c5-6218-4626-965b-f0d11412e3c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bd2d8c5-6218-4626-965b-f0d11412e3c0', 'volume_size': 1}
Apr 15 20:14:01 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-95d29919-eab8-4ab7-b694-4187dda9f422 tempest-CreateVolumesFromSnapshotTest-622878184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:14:01 devstack sudo[90167]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:01 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bcab4f41-6e40-48d9-a089-437aac467d03 tempest-CreateVolumesFromImageTest-1411433811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.638s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:01 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-bcab4f41-6e40-48d9-a089-437aac467d03 tempest-CreateVolumesFromImageTest-1411433811 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:14:01 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-7223a016-8fa6-496c-9851-51df0a8f898d tempest-CreateVolumesFromImageTest-1411433811 None] Acquiring lock "cinder-43e1bab6-2b9d-401a-92fc-25684fc9efae-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:14:01 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-bcab4f41-6e40-48d9-a089-437aac467d03 tempest-CreateVolumesFromImageTest-1411433811 None] Deleted volume successfully.
Apr 15 20:14:01 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-7223a016-8fa6-496c-9851-51df0a8f898d tempest-CreateVolumesFromImageTest-1411433811 None] Lock "cinder-43e1bab6-2b9d-401a-92fc-25684fc9efae-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:14:01 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-bcab4f41-6e40-48d9-a089-437aac467d03 tempest-CreateVolumesFromImageTest-1411433811 None] Lock "cinder-3626d4f6-ae90-419c-a12a-d2a7e96f46d0-delete_volume" released by "delete_volume" :: held 2.379s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:14:01 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-7223a016-8fa6-496c-9851-51df0a8f898d tempest-CreateVolumesFromImageTest-1411433811 None] Acquiring lock "cinder-quobyte-43e1bab6-2b9d-401a-92fc-25684fc9efae" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:14:01 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-7223a016-8fa6-496c-9851-51df0a8f898d tempest-CreateVolumesFromImageTest-1411433811 None] Lock "cinder-quobyte-43e1bab6-2b9d-401a-92fc-25684fc9efae" acquired by "delete_volume" :: waited 0.008s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:14:01 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[07fd3495-6072-4121-bb36-dc7754f39c69]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:14:01 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-7223a016-8fa6-496c-9851-51df0a8f898d tempest-CreateVolumesFromImageTest-1411433811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-43e1bab6-2b9d-401a-92fc-25684fc9efae {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:02 devstack sudo[90175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-43e1bab6-2b9d-401a-92fc-25684fc9efae
Apr 15 20:14:02 devstack sudo[90175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:02 devstack sudo[90172]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:02 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-a628bf8a-a795-461e-8011-0efde0add28a tempest-VolumeDependencyTests-2146631135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148 -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148.d19b377d-98df-4d17-9bbc-39a0a0ec8db4" returned: 0 in 0.667s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:02 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-a628bf8a-a795-461e-8011-0efde0add28a tempest-VolumeDependencyTests-2146631135 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148.d19b377d-98df-4d17-9bbc-39a0a0ec8db4 is being set with open permissions: ugo+rw
Apr 15 20:14:02 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-a628bf8a-a795-461e-8011-0efde0add28a tempest-VolumeDependencyTests-2146631135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148.d19b377d-98df-4d17-9bbc-39a0a0ec8db4 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:02 devstack sudo[90180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148.d19b377d-98df-4d17-9bbc-39a0a0ec8db4
Apr 15 20:14:02 devstack sudo[90180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:02 devstack sudo[90175]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:02 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-7223a016-8fa6-496c-9851-51df0a8f898d tempest-CreateVolumesFromImageTest-1411433811 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-43e1bab6-2b9d-401a-92fc-25684fc9efae" returned: 0 in 0.633s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:02 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-7223a016-8fa6-496c-9851-51df0a8f898d tempest-CreateVolumesFromImageTest-1411433811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-43e1bab6-2b9d-401a-92fc-25684fc9efae {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:02 devstack sudo[90185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-43e1bab6-2b9d-401a-92fc-25684fc9efae
Apr 15 20:14:02 devstack sudo[90185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:02 devstack sudo[90180]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:02 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-a628bf8a-a795-461e-8011-0efde0add28a tempest-VolumeDependencyTests-2146631135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148.d19b377d-98df-4d17-9bbc-39a0a0ec8db4" returned: 0 in 0.589s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:02 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-a628bf8a-a795-461e-8011-0efde0add28a tempest-VolumeDependencyTests-2146631135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148.info {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:02 devstack sudo[90188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148.info
Apr 15 20:14:02 devstack sudo[90188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:03 devstack sudo[90185]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:03 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-7223a016-8fa6-496c-9851-51df0a8f898d tempest-CreateVolumesFromImageTest-1411433811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-43e1bab6-2b9d-401a-92fc-25684fc9efae" returned: 0 in 0.523s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:03 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-7223a016-8fa6-496c-9851-51df0a8f898d tempest-CreateVolumesFromImageTest-1411433811 None] Lock "cinder-quobyte-43e1bab6-2b9d-401a-92fc-25684fc9efae" released by "delete_volume" :: held 1.185s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:14:03 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-7223a016-8fa6-496c-9851-51df0a8f898d tempest-CreateVolumesFromImageTest-1411433811 None] Created reservations ['f39c0157-3614-478c-bc53-97542d9913f5', '3ae971c3-3153-46af-b42f-0d6736208fd5', '9dcc19ab-60b3-4727-a2e6-420a2b592038', '445ed0e4-56d6-46c8-944c-f0a834c5371b'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:14:03 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-7223a016-8fa6-496c-9851-51df0a8f898d tempest-CreateVolumesFromImageTest-1411433811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:14:03 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-7223a016-8fa6-496c-9851-51df0a8f898d tempest-CreateVolumesFromImageTest-1411433811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:14:03 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-7223a016-8fa6-496c-9851-51df0a8f898d tempest-CreateVolumesFromImageTest-1411433811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:14:03 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-7223a016-8fa6-496c-9851-51df0a8f898d tempest-CreateVolumesFromImageTest-1411433811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:14:03 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-7223a016-8fa6-496c-9851-51df0a8f898d tempest-CreateVolumesFromImageTest-1411433811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:14:03 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-7223a016-8fa6-496c-9851-51df0a8f898d tempest-CreateVolumesFromImageTest-1411433811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:03 devstack sudo[90191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:14:03 devstack sudo[90191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:03 devstack sudo[90188]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:03 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-a628bf8a-a795-461e-8011-0efde0add28a tempest-VolumeDependencyTests-2146631135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148.info" returned: 0 in 0.505s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:03 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-a628bf8a-a795-461e-8011-0efde0add28a tempest-VolumeDependencyTests-2146631135 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148.info is being set with open permissions: ugo+rw
Apr 15 20:14:03 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-a628bf8a-a795-461e-8011-0efde0add28a tempest-VolumeDependencyTests-2146631135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148.info {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:03 devstack sudo[90194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148.info
Apr 15 20:14:03 devstack sudo[90194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:03 devstack sudo[90191]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:03 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-7223a016-8fa6-496c-9851-51df0a8f898d tempest-CreateVolumesFromImageTest-1411433811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.475s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:03 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-7223a016-8fa6-496c-9851-51df0a8f898d tempest-CreateVolumesFromImageTest-1411433811 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:14:03 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-7223a016-8fa6-496c-9851-51df0a8f898d tempest-CreateVolumesFromImageTest-1411433811 None] Deleted volume successfully.
Apr 15 20:14:03 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-7223a016-8fa6-496c-9851-51df0a8f898d tempest-CreateVolumesFromImageTest-1411433811 None] Lock "cinder-43e1bab6-2b9d-401a-92fc-25684fc9efae-delete_volume" released by "delete_volume" :: held 1.815s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:14:03 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-745b8c25-2a5b-49de-8a12-0d5755f0b85a tempest-SnapshotDependencyTests-404514513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:14:03 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-745b8c25-2a5b-49de-8a12-0d5755f0b85a tempest-SnapshotDependencyTests-404514513 None] Flow 'volume_create_manager' (9ca68268-aca4-49f4-ba1c-2ec8a0c54c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:14:03 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-745b8c25-2a5b-49de-8a12-0d5755f0b85a tempest-SnapshotDependencyTests-404514513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e1de3bc-75ef-4d1c-92f7-4b14b6fda4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:03 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-745b8c25-2a5b-49de-8a12-0d5755f0b85a tempest-SnapshotDependencyTests-404514513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e1de3bc-75ef-4d1c-92f7-4b14b6fda4f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:14:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-684392532',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=444c2edb-5699-4c6f-97a3-57e19485ef02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e50c266d15c448cba19d340f7c30a1f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:04Z,use_quota=True,user_id='36cff39c229f48eda5e4688d8e1216e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:03 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-745b8c25-2a5b-49de-8a12-0d5755f0b85a tempest-SnapshotDependencyTests-404514513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a771c627-4acc-4dd1-899c-22ad010c5950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:03 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-745b8c25-2a5b-49de-8a12-0d5755f0b85a tempest-SnapshotDependencyTests-404514513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a771c627-4acc-4dd1-899c-22ad010c5950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:03 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-745b8c25-2a5b-49de-8a12-0d5755f0b85a tempest-SnapshotDependencyTests-404514513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a1a4418-68bd-4852-962c-33a3bf8d6b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:03 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-745b8c25-2a5b-49de-8a12-0d5755f0b85a tempest-SnapshotDependencyTests-404514513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a1a4418-68bd-4852-962c-33a3bf8d6b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '444c2edb-5699-4c6f-97a3-57e19485ef02', 'volume_name': 'volume-444c2edb-5699-4c6f-97a3-57e19485ef02', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:03 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-745b8c25-2a5b-49de-8a12-0d5755f0b85a tempest-SnapshotDependencyTests-404514513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00dac31a-4502-4db1-b8e9-7088b7590229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:03 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-745b8c25-2a5b-49de-8a12-0d5755f0b85a tempest-SnapshotDependencyTests-404514513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00dac31a-4502-4db1-b8e9-7088b7590229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:03 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-745b8c25-2a5b-49de-8a12-0d5755f0b85a tempest-SnapshotDependencyTests-404514513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7850e6f7-9ff8-4827-ac6f-4cf72e201b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:03 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-745b8c25-2a5b-49de-8a12-0d5755f0b85a tempest-SnapshotDependencyTests-404514513 None] Volume 444c2edb-5699-4c6f-97a3-57e19485ef02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-444c2edb-5699-4c6f-97a3-57e19485ef02', 'volume_size': 1}
Apr 15 20:14:03 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-745b8c25-2a5b-49de-8a12-0d5755f0b85a tempest-SnapshotDependencyTests-404514513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:14:03 devstack sudo[90194]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:03 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-a628bf8a-a795-461e-8011-0efde0add28a tempest-VolumeDependencyTests-2146631135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148.info" returned: 0 in 0.507s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:03 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-a628bf8a-a795-461e-8011-0efde0add28a tempest-VolumeDependencyTests-2146631135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.974s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:14:03 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-9667a736-6dd6-4f41-83d7-ae7f7b70583e tempest-CreateVolumesFromSnapshotTest-622878184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.260s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:14:03 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-9667a736-6dd6-4f41-83d7-ae7f7b70583e tempest-CreateVolumesFromSnapshotTest-622878184 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:14:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-457291345',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96e5d05f-a5b8-4dc6-b3dd-5d5d47d34a5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90296888d81a4c4cae42d9852422dd46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:00Z,use_quota=True,user_id='d4475abfc80947bc8c8e17117bb58bb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:14:03 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-9667a736-6dd6-4f41-83d7-ae7f7b70583e tempest-CreateVolumesFromSnapshotTest-622878184 None] Creating volume 96e5d05f-a5b8-4dc6-b3dd-5d5d47d34a5c {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:14:03 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-9667a736-6dd6-4f41-83d7-ae7f7b70583e tempest-CreateVolumesFromSnapshotTest-622878184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:14:03 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-9667a736-6dd6-4f41-83d7-ae7f7b70583e tempest-CreateVolumesFromSnapshotTest-622878184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:14:03 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-9667a736-6dd6-4f41-83d7-ae7f7b70583e tempest-CreateVolumesFromSnapshotTest-622878184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:14:03 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-9667a736-6dd6-4f41-83d7-ae7f7b70583e tempest-CreateVolumesFromSnapshotTest-622878184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:14:03 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-9667a736-6dd6-4f41-83d7-ae7f7b70583e tempest-CreateVolumesFromSnapshotTest-622878184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:14:03 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-9667a736-6dd6-4f41-83d7-ae7f7b70583e tempest-CreateVolumesFromSnapshotTest-622878184 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:14:03 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-9667a736-6dd6-4f41-83d7-ae7f7b70583e tempest-CreateVolumesFromSnapshotTest-622878184 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:14:03 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-9667a736-6dd6-4f41-83d7-ae7f7b70583e tempest-CreateVolumesFromSnapshotTest-622878184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-96e5d05f-a5b8-4dc6-b3dd-5d5d47d34a5c 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:03 devstack sudo[90198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-96e5d05f-a5b8-4dc6-b3dd-5d5d47d34a5c 1073741824
Apr 15 20:14:03 devstack sudo[90198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:03 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-a628bf8a-a795-461e-8011-0efde0add28a tempest-VolumeDependencyTests-2146631135 None] Create snapshot completed successfully
Apr 15 20:14:04 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-1c49aaa9-b2e6-4fa2-9327-630fe0de6493 tempest-CreateVolumesFromImageTest-1411433811 None] Acquiring lock "cinder-67050d07-d22d-405b-995f-acd44cc9067e-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:14:04 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-1c49aaa9-b2e6-4fa2-9327-630fe0de6493 tempest-CreateVolumesFromImageTest-1411433811 None] Lock "cinder-67050d07-d22d-405b-995f-acd44cc9067e-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:14:04 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-1c49aaa9-b2e6-4fa2-9327-630fe0de6493 tempest-CreateVolumesFromImageTest-1411433811 None] Acquiring lock "cinder-quobyte-67050d07-d22d-405b-995f-acd44cc9067e" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:14:04 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-1c49aaa9-b2e6-4fa2-9327-630fe0de6493 tempest-CreateVolumesFromImageTest-1411433811 None] Lock "cinder-quobyte-67050d07-d22d-405b-995f-acd44cc9067e" acquired by "delete_volume" :: waited 0.008s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:14:04 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b478a58-39d6-4d47-b5d3-8c3172fd76a4]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:14:04 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-1c49aaa9-b2e6-4fa2-9327-630fe0de6493 tempest-CreateVolumesFromImageTest-1411433811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-67050d07-d22d-405b-995f-acd44cc9067e {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:04 devstack sudo[90200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-67050d07-d22d-405b-995f-acd44cc9067e
Apr 15 20:14:04 devstack sudo[90200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:04 devstack sudo[90198]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:04 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-9667a736-6dd6-4f41-83d7-ae7f7b70583e tempest-CreateVolumesFromSnapshotTest-622878184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-96e5d05f-a5b8-4dc6-b3dd-5d5d47d34a5c 1073741824" returned: 0 in 0.515s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:04 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-9667a736-6dd6-4f41-83d7-ae7f7b70583e tempest-CreateVolumesFromSnapshotTest-622878184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-96e5d05f-a5b8-4dc6-b3dd-5d5d47d34a5c {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:04 devstack sudo[90205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-96e5d05f-a5b8-4dc6-b3dd-5d5d47d34a5c
Apr 15 20:14:04 devstack sudo[90205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:04 devstack sudo[90200]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:04 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-1c49aaa9-b2e6-4fa2-9327-630fe0de6493 tempest-CreateVolumesFromImageTest-1411433811 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-67050d07-d22d-405b-995f-acd44cc9067e" returned: 0 in 0.540s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:04 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-1c49aaa9-b2e6-4fa2-9327-630fe0de6493 tempest-CreateVolumesFromImageTest-1411433811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-67050d07-d22d-405b-995f-acd44cc9067e {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:04 devstack sudo[90210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-67050d07-d22d-405b-995f-acd44cc9067e
Apr 15 20:14:04 devstack sudo[90210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:04 devstack sudo[90205]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:04 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-9667a736-6dd6-4f41-83d7-ae7f7b70583e tempest-CreateVolumesFromSnapshotTest-622878184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-96e5d05f-a5b8-4dc6-b3dd-5d5d47d34a5c" returned: 0 in 0.462s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:04 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-9667a736-6dd6-4f41-83d7-ae7f7b70583e tempest-CreateVolumesFromSnapshotTest-622878184 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:14:04 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-9667a736-6dd6-4f41-83d7-ae7f7b70583e tempest-CreateVolumesFromSnapshotTest-622878184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:14:04 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-7c8324e3-127f-4773-a99d-8137298f5b96 tempest-CreateVolumesFromSnapshotTest-622878184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.859s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:14:04 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-7c8324e3-127f-4773-a99d-8137298f5b96 tempest-CreateVolumesFromSnapshotTest-622878184 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:14:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1838224461',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c016cca-c76a-4651-8946-5799661120d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90296888d81a4c4cae42d9852422dd46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:01Z,use_quota=True,user_id='d4475abfc80947bc8c8e17117bb58bb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:14:04 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-7c8324e3-127f-4773-a99d-8137298f5b96 tempest-CreateVolumesFromSnapshotTest-622878184 None] Creating volume 8c016cca-c76a-4651-8946-5799661120d6 {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:14:04 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-7c8324e3-127f-4773-a99d-8137298f5b96 tempest-CreateVolumesFromSnapshotTest-622878184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:14:04 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-7c8324e3-127f-4773-a99d-8137298f5b96 tempest-CreateVolumesFromSnapshotTest-622878184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:14:04 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-7c8324e3-127f-4773-a99d-8137298f5b96 tempest-CreateVolumesFromSnapshotTest-622878184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:14:04 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-7c8324e3-127f-4773-a99d-8137298f5b96 tempest-CreateVolumesFromSnapshotTest-622878184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:14:04 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-7c8324e3-127f-4773-a99d-8137298f5b96 tempest-CreateVolumesFromSnapshotTest-622878184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:14:04 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-7c8324e3-127f-4773-a99d-8137298f5b96 tempest-CreateVolumesFromSnapshotTest-622878184 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:14:04 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-7c8324e3-127f-4773-a99d-8137298f5b96 tempest-CreateVolumesFromSnapshotTest-622878184 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:14:04 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-7c8324e3-127f-4773-a99d-8137298f5b96 tempest-CreateVolumesFromSnapshotTest-622878184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8c016cca-c76a-4651-8946-5799661120d6 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:04 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-9667a736-6dd6-4f41-83d7-ae7f7b70583e tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e85c0fd-5a8f-4ec0-91cd-b11279569562) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96e5d05f-a5b8-4dc6-b3dd-5d5d47d34a5c', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:04 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-9667a736-6dd6-4f41-83d7-ae7f7b70583e tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aedf25a1-3661-48e4-93fd-be75285354f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:04 devstack sudo[90213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8c016cca-c76a-4651-8946-5799661120d6 1073741824
Apr 15 20:14:04 devstack sudo[90213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:04 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-9667a736-6dd6-4f41-83d7-ae7f7b70583e tempest-CreateVolumesFromSnapshotTest-622878184 None] Volume volume-96e5d05f-a5b8-4dc6-b3dd-5d5d47d34a5c (96e5d05f-a5b8-4dc6-b3dd-5d5d47d34a5c): created successfully
Apr 15 20:14:04 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-9667a736-6dd6-4f41-83d7-ae7f7b70583e tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aedf25a1-3661-48e4-93fd-be75285354f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:04 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-9667a736-6dd6-4f41-83d7-ae7f7b70583e tempest-CreateVolumesFromSnapshotTest-622878184 None] Flow 'volume_create_manager' (4fad446f-aa58-4f7b-80c3-470a7c130139) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:14:04 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-9667a736-6dd6-4f41-83d7-ae7f7b70583e tempest-CreateVolumesFromSnapshotTest-622878184 None] Created volume successfully.
Apr 15 20:14:05 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-8aa5d796-d22d-4d70-add4-87a17b3048d4 tempest-VolumeDependencyTests-2146631135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:14:05 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-8aa5d796-d22d-4d70-add4-87a17b3048d4 tempest-VolumeDependencyTests-2146631135 None] Flow 'volume_create_manager' (2664607e-91ee-4165-8420-06e81811faa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:14:05 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-8aa5d796-d22d-4d70-add4-87a17b3048d4 tempest-VolumeDependencyTests-2146631135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (095b367d-3cea-4527-9634-0d6b4e99d13e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:05 devstack sudo[90210]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:05 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-1c49aaa9-b2e6-4fa2-9327-630fe0de6493 tempest-CreateVolumesFromImageTest-1411433811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-67050d07-d22d-405b-995f-acd44cc9067e" returned: 0 in 0.532s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:05 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-8aa5d796-d22d-4d70-add4-87a17b3048d4 tempest-VolumeDependencyTests-2146631135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (095b367d-3cea-4527-9634-0d6b4e99d13e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:14:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2110548860',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ff267a1-912d-4e38-a419-867191f84b15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8beda731ffc94345980fbb9fadc77736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d19b377d-98df-4d17-9bbc-39a0a0ec8db4,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:05Z,use_quota=True,user_id='febc3aa7e59e46e29f55adac7b15c620',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:05 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-8aa5d796-d22d-4d70-add4-87a17b3048d4 tempest-VolumeDependencyTests-2146631135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52018f0f-d505-4283-90cf-1ad5d7e18b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:05 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-8aa5d796-d22d-4d70-add4-87a17b3048d4 tempest-VolumeDependencyTests-2146631135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52018f0f-d505-4283-90cf-1ad5d7e18b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:05 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-8aa5d796-d22d-4d70-add4-87a17b3048d4 tempest-VolumeDependencyTests-2146631135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4d6e92f-4350-434d-891a-bd4ae868e7fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:05 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-8aa5d796-d22d-4d70-add4-87a17b3048d4 tempest-VolumeDependencyTests-2146631135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4d6e92f-4350-434d-891a-bd4ae868e7fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6ff267a1-912d-4e38-a419-867191f84b15', 'volume_name': 'volume-6ff267a1-912d-4e38-a419-867191f84b15', 'volume_size': 1, 'snapshot_id': 'd19b377d-98df-4d17-9bbc-39a0a0ec8db4'}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:05 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-8aa5d796-d22d-4d70-add4-87a17b3048d4 tempest-VolumeDependencyTests-2146631135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35d2e1e1-2aa0-4148-bb22-d3a977b32f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:05 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-8aa5d796-d22d-4d70-add4-87a17b3048d4 tempest-VolumeDependencyTests-2146631135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35d2e1e1-2aa0-4148-bb22-d3a977b32f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:05 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-8aa5d796-d22d-4d70-add4-87a17b3048d4 tempest-VolumeDependencyTests-2146631135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7ca5c0d-7966-4b5f-94fd-27d547081918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:05 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-8aa5d796-d22d-4d70-add4-87a17b3048d4 tempest-VolumeDependencyTests-2146631135 None] Volume 6ff267a1-912d-4e38-a419-867191f84b15: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6ff267a1-912d-4e38-a419-867191f84b15', 'volume_size': 1, 'snapshot_id': 'd19b377d-98df-4d17-9bbc-39a0a0ec8db4'}
Apr 15 20:14:05 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-1c49aaa9-b2e6-4fa2-9327-630fe0de6493 tempest-CreateVolumesFromImageTest-1411433811 None] Lock "cinder-quobyte-67050d07-d22d-405b-995f-acd44cc9067e" released by "delete_volume" :: held 1.140s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:14:05 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-8aa5d796-d22d-4d70-add4-87a17b3048d4 tempest-VolumeDependencyTests-2146631135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:14:05 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-1c49aaa9-b2e6-4fa2-9327-630fe0de6493 tempest-CreateVolumesFromImageTest-1411433811 None] Created reservations ['d7a0e43e-1b15-4494-b675-c5cd8a01f510', '6b029051-5d53-4a1a-bc8f-667c925c98fc', 'c3258df5-73cd-4b57-9687-09aefa384de2', 'b87f8cda-4084-4af0-b0ec-6c9f2f5a7fe5'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:14:05 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-1c49aaa9-b2e6-4fa2-9327-630fe0de6493 tempest-CreateVolumesFromImageTest-1411433811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:14:05 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-1c49aaa9-b2e6-4fa2-9327-630fe0de6493 tempest-CreateVolumesFromImageTest-1411433811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:14:05 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-1c49aaa9-b2e6-4fa2-9327-630fe0de6493 tempest-CreateVolumesFromImageTest-1411433811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:14:05 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-1c49aaa9-b2e6-4fa2-9327-630fe0de6493 tempest-CreateVolumesFromImageTest-1411433811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:14:05 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-1c49aaa9-b2e6-4fa2-9327-630fe0de6493 tempest-CreateVolumesFromImageTest-1411433811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:14:05 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-1c49aaa9-b2e6-4fa2-9327-630fe0de6493 tempest-CreateVolumesFromImageTest-1411433811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:05 devstack sudo[90217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:14:05 devstack sudo[90217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:05 devstack sudo[90213]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:05 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-7c8324e3-127f-4773-a99d-8137298f5b96 tempest-CreateVolumesFromSnapshotTest-622878184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8c016cca-c76a-4651-8946-5799661120d6 1073741824" returned: 0 in 0.583s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:05 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-7c8324e3-127f-4773-a99d-8137298f5b96 tempest-CreateVolumesFromSnapshotTest-622878184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8c016cca-c76a-4651-8946-5799661120d6 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:05 devstack sudo[90221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8c016cca-c76a-4651-8946-5799661120d6
Apr 15 20:14:05 devstack sudo[90221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:05 devstack sudo[90217]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:05 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-1c49aaa9-b2e6-4fa2-9327-630fe0de6493 tempest-CreateVolumesFromImageTest-1411433811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.471s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:05 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-1c49aaa9-b2e6-4fa2-9327-630fe0de6493 tempest-CreateVolumesFromImageTest-1411433811 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:14:05 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-1c49aaa9-b2e6-4fa2-9327-630fe0de6493 tempest-CreateVolumesFromImageTest-1411433811 None] Deleted volume successfully.
Apr 15 20:14:05 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-1c49aaa9-b2e6-4fa2-9327-630fe0de6493 tempest-CreateVolumesFromImageTest-1411433811 None] Lock "cinder-67050d07-d22d-405b-995f-acd44cc9067e-delete_volume" released by "delete_volume" :: held 1.732s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:14:05 devstack sudo[90221]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:05 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-7c8324e3-127f-4773-a99d-8137298f5b96 tempest-CreateVolumesFromSnapshotTest-622878184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8c016cca-c76a-4651-8946-5799661120d6" returned: 0 in 0.465s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:05 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-7c8324e3-127f-4773-a99d-8137298f5b96 tempest-CreateVolumesFromSnapshotTest-622878184 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:14:05 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-7c8324e3-127f-4773-a99d-8137298f5b96 tempest-CreateVolumesFromSnapshotTest-622878184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:14:05 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-d68fd06a-f01c-4e43-bd32-fe80cade1515 tempest-CreateVolumesFromSnapshotTest-622878184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.831s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:14:05 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-d68fd06a-f01c-4e43-bd32-fe80cade1515 tempest-CreateVolumesFromSnapshotTest-622878184 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:14:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1199522750',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3af14053-bcc4-48c3-b23a-e2203150e87b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90296888d81a4c4cae42d9852422dd46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:01Z,use_quota=True,user_id='d4475abfc80947bc8c8e17117bb58bb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:14:05 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-d68fd06a-f01c-4e43-bd32-fe80cade1515 tempest-CreateVolumesFromSnapshotTest-622878184 None] Creating volume 3af14053-bcc4-48c3-b23a-e2203150e87b {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:14:05 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-d68fd06a-f01c-4e43-bd32-fe80cade1515 tempest-CreateVolumesFromSnapshotTest-622878184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:14:05 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-d68fd06a-f01c-4e43-bd32-fe80cade1515 tempest-CreateVolumesFromSnapshotTest-622878184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:14:05 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-d68fd06a-f01c-4e43-bd32-fe80cade1515 tempest-CreateVolumesFromSnapshotTest-622878184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:14:05 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-d68fd06a-f01c-4e43-bd32-fe80cade1515 tempest-CreateVolumesFromSnapshotTest-622878184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:14:05 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-d68fd06a-f01c-4e43-bd32-fe80cade1515 tempest-CreateVolumesFromSnapshotTest-622878184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:14:05 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-d68fd06a-f01c-4e43-bd32-fe80cade1515 tempest-CreateVolumesFromSnapshotTest-622878184 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:14:05 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-d68fd06a-f01c-4e43-bd32-fe80cade1515 tempest-CreateVolumesFromSnapshotTest-622878184 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:14:05 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d68fd06a-f01c-4e43-bd32-fe80cade1515 tempest-CreateVolumesFromSnapshotTest-622878184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3af14053-bcc4-48c3-b23a-e2203150e87b 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:05 devstack sudo[90225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3af14053-bcc4-48c3-b23a-e2203150e87b 1073741824
Apr 15 20:14:05 devstack sudo[90225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:05 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-7c8324e3-127f-4773-a99d-8137298f5b96 tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a262ce04-128a-48fd-877d-6c4393ea1433) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c016cca-c76a-4651-8946-5799661120d6', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:05 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-7c8324e3-127f-4773-a99d-8137298f5b96 tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24c27729-ad10-488c-a0a2-ed53585fa4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:05 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-7c8324e3-127f-4773-a99d-8137298f5b96 tempest-CreateVolumesFromSnapshotTest-622878184 None] Volume volume-8c016cca-c76a-4651-8946-5799661120d6 (8c016cca-c76a-4651-8946-5799661120d6): created successfully
Apr 15 20:14:05 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-7c8324e3-127f-4773-a99d-8137298f5b96 tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24c27729-ad10-488c-a0a2-ed53585fa4a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:05 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-7c8324e3-127f-4773-a99d-8137298f5b96 tempest-CreateVolumesFromSnapshotTest-622878184 None] Flow 'volume_create_manager' (c0413606-3d18-4b13-8b7a-b5adda1af394) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:14:06 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-7c8324e3-127f-4773-a99d-8137298f5b96 tempest-CreateVolumesFromSnapshotTest-622878184 None] Created volume successfully.
Apr 15 20:14:06 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-9b7eaffc-e3b7-49bb-bf91-337f2cec78a3 tempest-CreateVolumesFromImageTest-1411433811 None] Acquiring lock "cinder-e0bcfd32-3128-4c30-8e50-ffc84af9f4ae-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:14:06 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-9b7eaffc-e3b7-49bb-bf91-337f2cec78a3 tempest-CreateVolumesFromImageTest-1411433811 None] Lock "cinder-e0bcfd32-3128-4c30-8e50-ffc84af9f4ae-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:14:06 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-9b7eaffc-e3b7-49bb-bf91-337f2cec78a3 tempest-CreateVolumesFromImageTest-1411433811 None] Acquiring lock "cinder-quobyte-e0bcfd32-3128-4c30-8e50-ffc84af9f4ae" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:14:06 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-9b7eaffc-e3b7-49bb-bf91-337f2cec78a3 tempest-CreateVolumesFromImageTest-1411433811 None] Lock "cinder-quobyte-e0bcfd32-3128-4c30-8e50-ffc84af9f4ae" acquired by "delete_volume" :: waited 0.019s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:14:06 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[1225d794-c5ed-49a5-bfd4-359133db2e0d]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:14:06 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-9b7eaffc-e3b7-49bb-bf91-337f2cec78a3 tempest-CreateVolumesFromImageTest-1411433811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e0bcfd32-3128-4c30-8e50-ffc84af9f4ae {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:06 devstack sudo[90229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e0bcfd32-3128-4c30-8e50-ffc84af9f4ae
Apr 15 20:14:06 devstack sudo[90229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:06 devstack sudo[90225]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:06 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d68fd06a-f01c-4e43-bd32-fe80cade1515 tempest-CreateVolumesFromSnapshotTest-622878184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3af14053-bcc4-48c3-b23a-e2203150e87b 1073741824" returned: 0 in 0.524s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:06 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d68fd06a-f01c-4e43-bd32-fe80cade1515 tempest-CreateVolumesFromSnapshotTest-622878184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3af14053-bcc4-48c3-b23a-e2203150e87b {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:06 devstack sudo[90233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3af14053-bcc4-48c3-b23a-e2203150e87b
Apr 15 20:14:06 devstack sudo[90233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:06 devstack sudo[90229]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:06 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-9b7eaffc-e3b7-49bb-bf91-337f2cec78a3 tempest-CreateVolumesFromImageTest-1411433811 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e0bcfd32-3128-4c30-8e50-ffc84af9f4ae" returned: 0 in 0.532s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:06 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-9b7eaffc-e3b7-49bb-bf91-337f2cec78a3 tempest-CreateVolumesFromImageTest-1411433811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e0bcfd32-3128-4c30-8e50-ffc84af9f4ae {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:06 devstack sudo[90239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e0bcfd32-3128-4c30-8e50-ffc84af9f4ae
Apr 15 20:14:06 devstack sudo[90239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:06 devstack sudo[90233]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:06 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d68fd06a-f01c-4e43-bd32-fe80cade1515 tempest-CreateVolumesFromSnapshotTest-622878184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3af14053-bcc4-48c3-b23a-e2203150e87b" returned: 0 in 0.414s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:06 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-d68fd06a-f01c-4e43-bd32-fe80cade1515 tempest-CreateVolumesFromSnapshotTest-622878184 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:14:06 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-d68fd06a-f01c-4e43-bd32-fe80cade1515 tempest-CreateVolumesFromSnapshotTest-622878184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:14:06 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-ff5ba38c-2ba0-4604-9321-9f346b2bf90d tempest-CreateVolumesFromSnapshotTest-622878184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.441s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:14:06 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-ff5ba38c-2ba0-4604-9321-9f346b2bf90d tempest-CreateVolumesFromSnapshotTest-622878184 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:14:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-798143307',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=309a5d32-e062-49ea-a68e-3630952bf1f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90296888d81a4c4cae42d9852422dd46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:01Z,use_quota=True,user_id='d4475abfc80947bc8c8e17117bb58bb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:14:06 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-ff5ba38c-2ba0-4604-9321-9f346b2bf90d tempest-CreateVolumesFromSnapshotTest-622878184 None] Creating volume 309a5d32-e062-49ea-a68e-3630952bf1f6 {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:14:06 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-ff5ba38c-2ba0-4604-9321-9f346b2bf90d tempest-CreateVolumesFromSnapshotTest-622878184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:14:06 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-ff5ba38c-2ba0-4604-9321-9f346b2bf90d tempest-CreateVolumesFromSnapshotTest-622878184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:14:06 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-ff5ba38c-2ba0-4604-9321-9f346b2bf90d tempest-CreateVolumesFromSnapshotTest-622878184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:14:06 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-ff5ba38c-2ba0-4604-9321-9f346b2bf90d tempest-CreateVolumesFromSnapshotTest-622878184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:14:06 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-ff5ba38c-2ba0-4604-9321-9f346b2bf90d tempest-CreateVolumesFromSnapshotTest-622878184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:14:06 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-ff5ba38c-2ba0-4604-9321-9f346b2bf90d tempest-CreateVolumesFromSnapshotTest-622878184 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:14:06 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-ff5ba38c-2ba0-4604-9321-9f346b2bf90d tempest-CreateVolumesFromSnapshotTest-622878184 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:14:06 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-ff5ba38c-2ba0-4604-9321-9f346b2bf90d tempest-CreateVolumesFromSnapshotTest-622878184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-309a5d32-e062-49ea-a68e-3630952bf1f6 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:06 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d68fd06a-f01c-4e43-bd32-fe80cade1515 tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b1bce7d-1c83-41f3-b977-bf2ab5f08b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3af14053-bcc4-48c3-b23a-e2203150e87b', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:06 devstack sudo[90241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-309a5d32-e062-49ea-a68e-3630952bf1f6 1073741824
Apr 15 20:14:06 devstack sudo[90241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:06 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d68fd06a-f01c-4e43-bd32-fe80cade1515 tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5388d1cf-b00b-43bb-9e5f-685ae3e939da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:06 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-d68fd06a-f01c-4e43-bd32-fe80cade1515 tempest-CreateVolumesFromSnapshotTest-622878184 None] Volume volume-3af14053-bcc4-48c3-b23a-e2203150e87b (3af14053-bcc4-48c3-b23a-e2203150e87b): created successfully
Apr 15 20:14:06 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d68fd06a-f01c-4e43-bd32-fe80cade1515 tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5388d1cf-b00b-43bb-9e5f-685ae3e939da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:06 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-d68fd06a-f01c-4e43-bd32-fe80cade1515 tempest-CreateVolumesFromSnapshotTest-622878184 None] Flow 'volume_create_manager' (f531d5fa-b503-4c7f-bfc4-b10e1e093dc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:14:06 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-d68fd06a-f01c-4e43-bd32-fe80cade1515 tempest-CreateVolumesFromSnapshotTest-622878184 None] Created volume successfully.
Apr 15 20:14:07 devstack sudo[90239]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:07 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-9b7eaffc-e3b7-49bb-bf91-337f2cec78a3 tempest-CreateVolumesFromImageTest-1411433811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-e0bcfd32-3128-4c30-8e50-ffc84af9f4ae" returned: 0 in 0.458s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:07 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-9b7eaffc-e3b7-49bb-bf91-337f2cec78a3 tempest-CreateVolumesFromImageTest-1411433811 None] Lock "cinder-quobyte-e0bcfd32-3128-4c30-8e50-ffc84af9f4ae" released by "delete_volume" :: held 1.013s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:14:07 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-9b7eaffc-e3b7-49bb-bf91-337f2cec78a3 tempest-CreateVolumesFromImageTest-1411433811 None] Created reservations ['c33a5015-49f4-4da3-a911-98bbeca1e43d', 'ae5cbd6e-f878-4f44-91f4-d567ef938db8', '736208eb-e711-4b45-9f4c-292437b6036e', '45c436ac-f2be-469e-8be9-f086451eb552'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:14:07 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-9b7eaffc-e3b7-49bb-bf91-337f2cec78a3 tempest-CreateVolumesFromImageTest-1411433811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:14:07 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-9b7eaffc-e3b7-49bb-bf91-337f2cec78a3 tempest-CreateVolumesFromImageTest-1411433811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:14:07 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-9b7eaffc-e3b7-49bb-bf91-337f2cec78a3 tempest-CreateVolumesFromImageTest-1411433811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:14:07 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-9b7eaffc-e3b7-49bb-bf91-337f2cec78a3 tempest-CreateVolumesFromImageTest-1411433811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:14:07 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-9b7eaffc-e3b7-49bb-bf91-337f2cec78a3 tempest-CreateVolumesFromImageTest-1411433811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:14:07 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-9b7eaffc-e3b7-49bb-bf91-337f2cec78a3 tempest-CreateVolumesFromImageTest-1411433811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:07 devstack sudo[90247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:14:07 devstack sudo[90247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:07 devstack sudo[90241]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:07 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-ff5ba38c-2ba0-4604-9321-9f346b2bf90d tempest-CreateVolumesFromSnapshotTest-622878184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-309a5d32-e062-49ea-a68e-3630952bf1f6 1073741824" returned: 0 in 0.592s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:07 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-ff5ba38c-2ba0-4604-9321-9f346b2bf90d tempest-CreateVolumesFromSnapshotTest-622878184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-309a5d32-e062-49ea-a68e-3630952bf1f6 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:07 devstack sudo[90249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-309a5d32-e062-49ea-a68e-3630952bf1f6
Apr 15 20:14:07 devstack sudo[90249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:07 devstack sudo[90247]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:07 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-9b7eaffc-e3b7-49bb-bf91-337f2cec78a3 tempest-CreateVolumesFromImageTest-1411433811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.448s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:07 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-9b7eaffc-e3b7-49bb-bf91-337f2cec78a3 tempest-CreateVolumesFromImageTest-1411433811 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:14:07 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-9b7eaffc-e3b7-49bb-bf91-337f2cec78a3 tempest-CreateVolumesFromImageTest-1411433811 None] Deleted volume successfully.
Apr 15 20:14:07 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-9b7eaffc-e3b7-49bb-bf91-337f2cec78a3 tempest-CreateVolumesFromImageTest-1411433811 None] Lock "cinder-e0bcfd32-3128-4c30-8e50-ffc84af9f4ae-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:14:07 devstack sudo[90249]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:07 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-ff5ba38c-2ba0-4604-9321-9f346b2bf90d tempest-CreateVolumesFromSnapshotTest-622878184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-309a5d32-e062-49ea-a68e-3630952bf1f6" returned: 0 in 0.449s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:07 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-ff5ba38c-2ba0-4604-9321-9f346b2bf90d tempest-CreateVolumesFromSnapshotTest-622878184 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:14:07 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-ff5ba38c-2ba0-4604-9321-9f346b2bf90d tempest-CreateVolumesFromSnapshotTest-622878184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:14:07 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-95d29919-eab8-4ab7-b694-4187dda9f422 tempest-CreateVolumesFromSnapshotTest-622878184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.164s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:14:07 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-95d29919-eab8-4ab7-b694-4187dda9f422 tempest-CreateVolumesFromSnapshotTest-622878184 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:14:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-629873220',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bd2d8c5-6218-4626-965b-f0d11412e3c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90296888d81a4c4cae42d9852422dd46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:02Z,use_quota=True,user_id='d4475abfc80947bc8c8e17117bb58bb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:14:07 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-95d29919-eab8-4ab7-b694-4187dda9f422 tempest-CreateVolumesFromSnapshotTest-622878184 None] Creating volume 5bd2d8c5-6218-4626-965b-f0d11412e3c0 {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:14:07 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-95d29919-eab8-4ab7-b694-4187dda9f422 tempest-CreateVolumesFromSnapshotTest-622878184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:14:07 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-95d29919-eab8-4ab7-b694-4187dda9f422 tempest-CreateVolumesFromSnapshotTest-622878184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:14:07 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-95d29919-eab8-4ab7-b694-4187dda9f422 tempest-CreateVolumesFromSnapshotTest-622878184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:14:07 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-95d29919-eab8-4ab7-b694-4187dda9f422 tempest-CreateVolumesFromSnapshotTest-622878184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:14:07 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-95d29919-eab8-4ab7-b694-4187dda9f422 tempest-CreateVolumesFromSnapshotTest-622878184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:14:07 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-95d29919-eab8-4ab7-b694-4187dda9f422 tempest-CreateVolumesFromSnapshotTest-622878184 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:14:07 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-95d29919-eab8-4ab7-b694-4187dda9f422 tempest-CreateVolumesFromSnapshotTest-622878184 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:14:07 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-95d29919-eab8-4ab7-b694-4187dda9f422 tempest-CreateVolumesFromSnapshotTest-622878184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5bd2d8c5-6218-4626-965b-f0d11412e3c0 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:08 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ff5ba38c-2ba0-4604-9321-9f346b2bf90d tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18a3c04d-78d0-4b22-90bc-c6013f3e3ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-309a5d32-e062-49ea-a68e-3630952bf1f6', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:08 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ff5ba38c-2ba0-4604-9321-9f346b2bf90d tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (003a618d-3028-44c1-bf87-ec0617a1d591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:08 devstack sudo[90253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5bd2d8c5-6218-4626-965b-f0d11412e3c0 1073741824
Apr 15 20:14:08 devstack sudo[90253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:08 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-ff5ba38c-2ba0-4604-9321-9f346b2bf90d tempest-CreateVolumesFromSnapshotTest-622878184 None] Volume volume-309a5d32-e062-49ea-a68e-3630952bf1f6 (309a5d32-e062-49ea-a68e-3630952bf1f6): created successfully
Apr 15 20:14:08 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ff5ba38c-2ba0-4604-9321-9f346b2bf90d tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (003a618d-3028-44c1-bf87-ec0617a1d591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:08 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-ff5ba38c-2ba0-4604-9321-9f346b2bf90d tempest-CreateVolumesFromSnapshotTest-622878184 None] Flow 'volume_create_manager' (36fe8d53-260f-4bbb-a31a-d9f58c1ce68a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:14:08 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-ff5ba38c-2ba0-4604-9321-9f346b2bf90d tempest-CreateVolumesFromSnapshotTest-622878184 None] Created volume successfully.
Apr 15 20:14:08 devstack sudo[90253]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:08 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-95d29919-eab8-4ab7-b694-4187dda9f422 tempest-CreateVolumesFromSnapshotTest-622878184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5bd2d8c5-6218-4626-965b-f0d11412e3c0 1073741824" returned: 0 in 0.528s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:08 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-95d29919-eab8-4ab7-b694-4187dda9f422 tempest-CreateVolumesFromSnapshotTest-622878184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5bd2d8c5-6218-4626-965b-f0d11412e3c0 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:08 devstack sudo[90258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5bd2d8c5-6218-4626-965b-f0d11412e3c0
Apr 15 20:14:08 devstack sudo[90258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:09 devstack sudo[90258]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-95d29919-eab8-4ab7-b694-4187dda9f422 tempest-CreateVolumesFromSnapshotTest-622878184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5bd2d8c5-6218-4626-965b-f0d11412e3c0" returned: 0 in 0.471s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:09 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-95d29919-eab8-4ab7-b694-4187dda9f422 tempest-CreateVolumesFromSnapshotTest-622878184 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:14:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-95d29919-eab8-4ab7-b694-4187dda9f422 tempest-CreateVolumesFromSnapshotTest-622878184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:14:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-745b8c25-2a5b-49de-8a12-0d5755f0b85a tempest-SnapshotDependencyTests-404514513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.201s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:14:09 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-745b8c25-2a5b-49de-8a12-0d5755f0b85a tempest-SnapshotDependencyTests-404514513 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:14:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-684392532',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=444c2edb-5699-4c6f-97a3-57e19485ef02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e50c266d15c448cba19d340f7c30a1f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:04Z,use_quota=True,user_id='36cff39c229f48eda5e4688d8e1216e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:14:09 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-745b8c25-2a5b-49de-8a12-0d5755f0b85a tempest-SnapshotDependencyTests-404514513 None] Creating volume 444c2edb-5699-4c6f-97a3-57e19485ef02 {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:14:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-745b8c25-2a5b-49de-8a12-0d5755f0b85a tempest-SnapshotDependencyTests-404514513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:14:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-745b8c25-2a5b-49de-8a12-0d5755f0b85a tempest-SnapshotDependencyTests-404514513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:14:09 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-745b8c25-2a5b-49de-8a12-0d5755f0b85a tempest-SnapshotDependencyTests-404514513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:14:09 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-745b8c25-2a5b-49de-8a12-0d5755f0b85a tempest-SnapshotDependencyTests-404514513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:14:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-745b8c25-2a5b-49de-8a12-0d5755f0b85a tempest-SnapshotDependencyTests-404514513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:14:09 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-745b8c25-2a5b-49de-8a12-0d5755f0b85a tempest-SnapshotDependencyTests-404514513 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:14:09 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-745b8c25-2a5b-49de-8a12-0d5755f0b85a tempest-SnapshotDependencyTests-404514513 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:14:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-745b8c25-2a5b-49de-8a12-0d5755f0b85a tempest-SnapshotDependencyTests-404514513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-444c2edb-5699-4c6f-97a3-57e19485ef02 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:09 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-95d29919-eab8-4ab7-b694-4187dda9f422 tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (741135fc-6deb-4bc8-a770-552736ff18af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bd2d8c5-6218-4626-965b-f0d11412e3c0', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:09 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-95d29919-eab8-4ab7-b694-4187dda9f422 tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54449469-43a2-459b-94c1-494b30d8b213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:09 devstack sudo[90261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-444c2edb-5699-4c6f-97a3-57e19485ef02 1073741824
Apr 15 20:14:09 devstack sudo[90261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:09 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-95d29919-eab8-4ab7-b694-4187dda9f422 tempest-CreateVolumesFromSnapshotTest-622878184 None] Volume volume-5bd2d8c5-6218-4626-965b-f0d11412e3c0 (5bd2d8c5-6218-4626-965b-f0d11412e3c0): created successfully
Apr 15 20:14:09 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-95d29919-eab8-4ab7-b694-4187dda9f422 tempest-CreateVolumesFromSnapshotTest-622878184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54449469-43a2-459b-94c1-494b30d8b213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:09 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-95d29919-eab8-4ab7-b694-4187dda9f422 tempest-CreateVolumesFromSnapshotTest-622878184 None] Flow 'volume_create_manager' (59c07e99-bd81-4050-967b-9e441dcfb5a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:14:09 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-95d29919-eab8-4ab7-b694-4187dda9f422 tempest-CreateVolumesFromSnapshotTest-622878184 None] Created volume successfully.
Apr 15 20:14:09 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-224e0d91-ca88-4e62-990d-ffde6198d5d1 tempest-CreateVolumesFromSnapshotTest-622878184 None] Acquiring lock "cinder-5bd2d8c5-6218-4626-965b-f0d11412e3c0-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:14:09 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-224e0d91-ca88-4e62-990d-ffde6198d5d1 tempest-CreateVolumesFromSnapshotTest-622878184 None] Lock "cinder-5bd2d8c5-6218-4626-965b-f0d11412e3c0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:14:09 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-224e0d91-ca88-4e62-990d-ffde6198d5d1 tempest-CreateVolumesFromSnapshotTest-622878184 None] Acquiring lock "cinder-quobyte-5bd2d8c5-6218-4626-965b-f0d11412e3c0" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:14:09 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-224e0d91-ca88-4e62-990d-ffde6198d5d1 tempest-CreateVolumesFromSnapshotTest-622878184 None] Lock "cinder-quobyte-5bd2d8c5-6218-4626-965b-f0d11412e3c0" acquired by "delete_volume" :: waited 0.009s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:14:09 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[477bd831-146f-4149-8588-2f3a3d7c7d89]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:14:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-224e0d91-ca88-4e62-990d-ffde6198d5d1 tempest-CreateVolumesFromSnapshotTest-622878184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5bd2d8c5-6218-4626-965b-f0d11412e3c0 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:09 devstack sudo[90263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5bd2d8c5-6218-4626-965b-f0d11412e3c0
Apr 15 20:14:09 devstack sudo[90263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:09 devstack sudo[90261]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-745b8c25-2a5b-49de-8a12-0d5755f0b85a tempest-SnapshotDependencyTests-404514513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-444c2edb-5699-4c6f-97a3-57e19485ef02 1073741824" returned: 0 in 0.668s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-745b8c25-2a5b-49de-8a12-0d5755f0b85a tempest-SnapshotDependencyTests-404514513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-444c2edb-5699-4c6f-97a3-57e19485ef02 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:09 devstack sudo[90268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-444c2edb-5699-4c6f-97a3-57e19485ef02
Apr 15 20:14:09 devstack sudo[90268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:09 devstack sudo[90263]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-224e0d91-ca88-4e62-990d-ffde6198d5d1 tempest-CreateVolumesFromSnapshotTest-622878184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5bd2d8c5-6218-4626-965b-f0d11412e3c0" returned: 0 in 0.562s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:09 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-224e0d91-ca88-4e62-990d-ffde6198d5d1 tempest-CreateVolumesFromSnapshotTest-622878184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5bd2d8c5-6218-4626-965b-f0d11412e3c0 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:10 devstack sudo[90273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5bd2d8c5-6218-4626-965b-f0d11412e3c0
Apr 15 20:14:10 devstack sudo[90273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:10 devstack sudo[90268]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:10 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-745b8c25-2a5b-49de-8a12-0d5755f0b85a tempest-SnapshotDependencyTests-404514513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-444c2edb-5699-4c6f-97a3-57e19485ef02" returned: 0 in 0.483s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:10 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-745b8c25-2a5b-49de-8a12-0d5755f0b85a tempest-SnapshotDependencyTests-404514513 None] <== create_volume: return (1185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:14:10 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-745b8c25-2a5b-49de-8a12-0d5755f0b85a tempest-SnapshotDependencyTests-404514513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:14:10 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-8aa5d796-d22d-4d70-add4-87a17b3048d4 tempest-VolumeDependencyTests-2146631135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.006s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:14:10 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-8aa5d796-d22d-4d70-add4-87a17b3048d4 tempest-VolumeDependencyTests-2146631135 None] Acquiring lock "cinder-quobyte-d19b377d-98df-4d17-9bbc-39a0a0ec8db4-6ff267a1-912d-4e38-a419-867191f84b15" by "_create_volume_from_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:14:10 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-745b8c25-2a5b-49de-8a12-0d5755f0b85a tempest-SnapshotDependencyTests-404514513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7850e6f7-9ff8-4827-ac6f-4cf72e201b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-444c2edb-5699-4c6f-97a3-57e19485ef02', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:10 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-745b8c25-2a5b-49de-8a12-0d5755f0b85a tempest-SnapshotDependencyTests-404514513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (201c2be0-7e31-4ae6-92ce-86e81e4427b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:10 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-723ff4d5-7f51-4d8f-b00f-38542ae04311 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:14:10 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-723ff4d5-7f51-4d8f-b00f-38542ae04311 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Flow 'volume_create_manager' (c74b4edd-8aff-4671-af75-090083680df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:14:10 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-723ff4d5-7f51-4d8f-b00f-38542ae04311 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b813992b-2662-45f0-95ac-21ae276a1e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:10 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-8aa5d796-d22d-4d70-add4-87a17b3048d4 tempest-VolumeDependencyTests-2146631135 None] Lock "cinder-quobyte-d19b377d-98df-4d17-9bbc-39a0a0ec8db4-6ff267a1-912d-4e38-a419-867191f84b15" acquired by "_create_volume_from_snapshot" :: waited 0.069s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:14:10 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-8aa5d796-d22d-4d70-add4-87a17b3048d4 tempest-VolumeDependencyTests-2146631135 None] Creating volume 6ff267a1-912d-4e38-a419-867191f84b15 from snapshot d19b377d-98df-4d17-9bbc-39a0a0ec8db4 {{(pid=82646) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 15 20:14:10 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-8aa5d796-d22d-4d70-add4-87a17b3048d4 tempest-VolumeDependencyTests-2146631135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:14:10 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-8aa5d796-d22d-4d70-add4-87a17b3048d4 tempest-VolumeDependencyTests-2146631135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:14:10 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-8aa5d796-d22d-4d70-add4-87a17b3048d4 tempest-VolumeDependencyTests-2146631135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:14:10 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-8aa5d796-d22d-4d70-add4-87a17b3048d4 tempest-VolumeDependencyTests-2146631135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:14:10 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-8aa5d796-d22d-4d70-add4-87a17b3048d4 tempest-VolumeDependencyTests-2146631135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:14:10 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-8aa5d796-d22d-4d70-add4-87a17b3048d4 tempest-VolumeDependencyTests-2146631135 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:14:10 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-8aa5d796-d22d-4d70-add4-87a17b3048d4 tempest-VolumeDependencyTests-2146631135 None] Acquiring lock "cinder-quobyte-6ff267a1-912d-4e38-a419-867191f84b15" by "_copy_volume_from_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:14:10 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-723ff4d5-7f51-4d8f-b00f-38542ae04311 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b813992b-2662-45f0-95ac-21ae276a1e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1956543268',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4144cf9-c659-4c22-93f4-8a7c20e93dcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a1f5ae17c2943ba885c848f93851600',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:10Z,use_quota=True,user_id='77b9c6fd5b904cac92d8b9fc762e1055',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:10 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-723ff4d5-7f51-4d8f-b00f-38542ae04311 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b203cc32-8714-470a-be79-ef4b076b171d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:10 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-723ff4d5-7f51-4d8f-b00f-38542ae04311 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b203cc32-8714-470a-be79-ef4b076b171d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:10 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-723ff4d5-7f51-4d8f-b00f-38542ae04311 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1cce71f-cc69-4cdc-aa42-83d3e6657e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:10 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-723ff4d5-7f51-4d8f-b00f-38542ae04311 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1cce71f-cc69-4cdc-aa42-83d3e6657e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4144cf9-c659-4c22-93f4-8a7c20e93dcb', 'volume_name': 'volume-d4144cf9-c659-4c22-93f4-8a7c20e93dcb', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:10 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-723ff4d5-7f51-4d8f-b00f-38542ae04311 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19f2da3c-4d4c-4202-a830-d56a27586784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:10 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-723ff4d5-7f51-4d8f-b00f-38542ae04311 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19f2da3c-4d4c-4202-a830-d56a27586784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:10 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-723ff4d5-7f51-4d8f-b00f-38542ae04311 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (452b75a7-2e07-4133-8da5-62c6f47dfa19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:10 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-723ff4d5-7f51-4d8f-b00f-38542ae04311 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Volume d4144cf9-c659-4c22-93f4-8a7c20e93dcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4144cf9-c659-4c22-93f4-8a7c20e93dcb', 'volume_size': 1}
Apr 15 20:14:10 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-723ff4d5-7f51-4d8f-b00f-38542ae04311 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:14:10 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-745b8c25-2a5b-49de-8a12-0d5755f0b85a tempest-SnapshotDependencyTests-404514513 None] Volume volume-444c2edb-5699-4c6f-97a3-57e19485ef02 (444c2edb-5699-4c6f-97a3-57e19485ef02): created successfully
Apr 15 20:14:10 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-745b8c25-2a5b-49de-8a12-0d5755f0b85a tempest-SnapshotDependencyTests-404514513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (201c2be0-7e31-4ae6-92ce-86e81e4427b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:10 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-745b8c25-2a5b-49de-8a12-0d5755f0b85a tempest-SnapshotDependencyTests-404514513 None] Flow 'volume_create_manager' (9ca68268-aca4-49f4-ba1c-2ec8a0c54c53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:14:10 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-8aa5d796-d22d-4d70-add4-87a17b3048d4 tempest-VolumeDependencyTests-2146631135 None] Lock "cinder-quobyte-6ff267a1-912d-4e38-a419-867191f84b15" acquired by "_copy_volume_from_snapshot" :: waited 0.052s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:14:10 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-8aa5d796-d22d-4d70-add4-87a17b3048d4 tempest-VolumeDependencyTests-2146631135 None] snapshot: d19b377d-98df-4d17-9bbc-39a0a0ec8db4, volume: 6ff267a1-912d-4e38-a419-867191f84b15,  {{(pid=82646) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 15 20:14:10 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-745b8c25-2a5b-49de-8a12-0d5755f0b85a tempest-SnapshotDependencyTests-404514513 None] Created volume successfully.
Apr 15 20:14:10 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-8aa5d796-d22d-4d70-add4-87a17b3048d4 tempest-VolumeDependencyTests-2146631135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:14:10 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-8aa5d796-d22d-4d70-add4-87a17b3048d4 tempest-VolumeDependencyTests-2146631135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:14:10 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-8aa5d796-d22d-4d70-add4-87a17b3048d4 tempest-VolumeDependencyTests-2146631135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:14:10 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-8aa5d796-d22d-4d70-add4-87a17b3048d4 tempest-VolumeDependencyTests-2146631135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:14:10 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-8aa5d796-d22d-4d70-add4-87a17b3048d4 tempest-VolumeDependencyTests-2146631135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:14:10 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[d154cc13-04c9-4bb2-a1d9-c8a25a967d3f]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:14:10 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-8aa5d796-d22d-4d70-add4-87a17b3048d4 tempest-VolumeDependencyTests-2146631135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148.d19b377d-98df-4d17-9bbc-39a0a0ec8db4 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:10 devstack sudo[90277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148.d19b377d-98df-4d17-9bbc-39a0a0ec8db4
Apr 15 20:14:10 devstack sudo[90277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:10 devstack sudo[90273]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:10 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-224e0d91-ca88-4e62-990d-ffde6198d5d1 tempest-CreateVolumesFromSnapshotTest-622878184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5bd2d8c5-6218-4626-965b-f0d11412e3c0" returned: 0 in 0.483s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:10 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-224e0d91-ca88-4e62-990d-ffde6198d5d1 tempest-CreateVolumesFromSnapshotTest-622878184 None] Lock "cinder-quobyte-5bd2d8c5-6218-4626-965b-f0d11412e3c0" released by "delete_volume" :: held 1.070s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:14:10 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-224e0d91-ca88-4e62-990d-ffde6198d5d1 tempest-CreateVolumesFromSnapshotTest-622878184 None] Created reservations ['bb61a1df-b3b9-415b-ae07-95b7c3757311', '4ad58bcb-feb8-464e-b6f0-f55f4fe126df', 'a17353b4-0f86-48d8-a14e-4bd8ddad6e52', '3de52d4c-201f-444b-b925-d992ee0ef742'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:14:10 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-224e0d91-ca88-4e62-990d-ffde6198d5d1 tempest-CreateVolumesFromSnapshotTest-622878184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:14:10 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-224e0d91-ca88-4e62-990d-ffde6198d5d1 tempest-CreateVolumesFromSnapshotTest-622878184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:14:10 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-224e0d91-ca88-4e62-990d-ffde6198d5d1 tempest-CreateVolumesFromSnapshotTest-622878184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:14:10 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-224e0d91-ca88-4e62-990d-ffde6198d5d1 tempest-CreateVolumesFromSnapshotTest-622878184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:14:10 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-224e0d91-ca88-4e62-990d-ffde6198d5d1 tempest-CreateVolumesFromSnapshotTest-622878184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:14:10 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-224e0d91-ca88-4e62-990d-ffde6198d5d1 tempest-CreateVolumesFromSnapshotTest-622878184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:10 devstack sudo[90279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:14:10 devstack sudo[90279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:10 devstack sudo[90277]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:10 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-8aa5d796-d22d-4d70-add4-87a17b3048d4 tempest-VolumeDependencyTests-2146631135 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148.d19b377d-98df-4d17-9bbc-39a0a0ec8db4" returned: 0 in 0.507s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:10 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-8aa5d796-d22d-4d70-add4-87a17b3048d4 tempest-VolumeDependencyTests-2146631135 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82646) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 20:14:10 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-8aa5d796-d22d-4d70-add4-87a17b3048d4 tempest-VolumeDependencyTests-2146631135 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148 {{(pid=82646) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 15 20:14:10 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-8aa5d796-d22d-4d70-add4-87a17b3048d4 tempest-VolumeDependencyTests-2146631135 None] Creating direct copy from snapshot {{(pid=82646) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 15 20:14:10 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b09e905-ddf2-40ee-abb1-49e2c3940435]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:14:10 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-8aa5d796-d22d-4d70-add4-87a17b3048d4 tempest-VolumeDependencyTests-2146631135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:10 devstack sudo[90284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148
Apr 15 20:14:10 devstack sudo[90284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:10 devstack sudo[90279]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:10 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-224e0d91-ca88-4e62-990d-ffde6198d5d1 tempest-CreateVolumesFromSnapshotTest-622878184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.437s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:10 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-224e0d91-ca88-4e62-990d-ffde6198d5d1 tempest-CreateVolumesFromSnapshotTest-622878184 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:14:10 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-224e0d91-ca88-4e62-990d-ffde6198d5d1 tempest-CreateVolumesFromSnapshotTest-622878184 None] Deleted volume successfully.
Apr 15 20:14:11 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-224e0d91-ca88-4e62-990d-ffde6198d5d1 tempest-CreateVolumesFromSnapshotTest-622878184 None] Lock "cinder-5bd2d8c5-6218-4626-965b-f0d11412e3c0-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:14:11 devstack sudo[90284]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:11 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-8aa5d796-d22d-4d70-add4-87a17b3048d4 tempest-VolumeDependencyTests-2146631135 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148" returned: 0 in 0.487s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:11 devstack cinder-volume[82646]: DEBUG cinder.utils [None req-8aa5d796-d22d-4d70-add4-87a17b3048d4 tempest-VolumeDependencyTests-2146631135 None] Path /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6ff267a1-912d-4e38-a419-867191f84b15 not found in is_blk_device check {{(pid=82646) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 15 20:14:11 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-8aa5d796-d22d-4d70-add4-87a17b3048d4 tempest-VolumeDependencyTests-2146631135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6ff267a1-912d-4e38-a419-867191f84b15 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:11 devstack sudo[90290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6ff267a1-912d-4e38-a419-867191f84b15
Apr 15 20:14:11 devstack sudo[90290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:11 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-e3ba0519-5a1b-44f1-afc0-e4d631f129c1 tempest-CreateVolumesFromSnapshotTest-622878184 None] Acquiring lock "cinder-309a5d32-e062-49ea-a68e-3630952bf1f6-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:14:11 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-e3ba0519-5a1b-44f1-afc0-e4d631f129c1 tempest-CreateVolumesFromSnapshotTest-622878184 None] Lock "cinder-309a5d32-e062-49ea-a68e-3630952bf1f6-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:14:11 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-032a6c3b-ed37-40e0-83e1-23f6d618eefc tempest-SnapshotDependencyTests-404514513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:14:11 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-e3ba0519-5a1b-44f1-afc0-e4d631f129c1 tempest-CreateVolumesFromSnapshotTest-622878184 None] Acquiring lock "cinder-quobyte-309a5d32-e062-49ea-a68e-3630952bf1f6" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:14:11 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-e3ba0519-5a1b-44f1-afc0-e4d631f129c1 tempest-CreateVolumesFromSnapshotTest-622878184 None] Lock "cinder-quobyte-309a5d32-e062-49ea-a68e-3630952bf1f6" acquired by "delete_volume" :: waited 0.012s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:14:11 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b28b2b6-ebc7-4e72-b2d2-26c3038639ed]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:14:11 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e3ba0519-5a1b-44f1-afc0-e4d631f129c1 tempest-CreateVolumesFromSnapshotTest-622878184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-309a5d32-e062-49ea-a68e-3630952bf1f6 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:11 devstack sudo[90292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-309a5d32-e062-49ea-a68e-3630952bf1f6
Apr 15 20:14:11 devstack sudo[90292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:12 devstack sudo[90292]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:12 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e3ba0519-5a1b-44f1-afc0-e4d631f129c1 tempest-CreateVolumesFromSnapshotTest-622878184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-309a5d32-e062-49ea-a68e-3630952bf1f6" returned: 0 in 0.858s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:12 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e3ba0519-5a1b-44f1-afc0-e4d631f129c1 tempest-CreateVolumesFromSnapshotTest-622878184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-309a5d32-e062-49ea-a68e-3630952bf1f6 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:12 devstack sudo[90309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-309a5d32-e062-49ea-a68e-3630952bf1f6
Apr 15 20:14:12 devstack sudo[90309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:13 devstack sudo[90309]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:13 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e3ba0519-5a1b-44f1-afc0-e4d631f129c1 tempest-CreateVolumesFromSnapshotTest-622878184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-309a5d32-e062-49ea-a68e-3630952bf1f6" returned: 0 in 0.915s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:13 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-e3ba0519-5a1b-44f1-afc0-e4d631f129c1 tempest-CreateVolumesFromSnapshotTest-622878184 None] Lock "cinder-quobyte-309a5d32-e062-49ea-a68e-3630952bf1f6" released by "delete_volume" :: held 1.807s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:14:13 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-e3ba0519-5a1b-44f1-afc0-e4d631f129c1 tempest-CreateVolumesFromSnapshotTest-622878184 None] Created reservations ['affe02c6-38d8-4fbe-91d5-02d8d9a1ce7c', 'ef39c634-c2f2-40c9-9c28-44e012949337', 'fec35581-7afc-4e8f-9a70-e108e24b092d', '04b02f40-226c-40f3-832d-231e7fe2b6cf'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:14:13 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-e3ba0519-5a1b-44f1-afc0-e4d631f129c1 tempest-CreateVolumesFromSnapshotTest-622878184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:14:13 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-e3ba0519-5a1b-44f1-afc0-e4d631f129c1 tempest-CreateVolumesFromSnapshotTest-622878184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:14:13 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-e3ba0519-5a1b-44f1-afc0-e4d631f129c1 tempest-CreateVolumesFromSnapshotTest-622878184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:14:13 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-e3ba0519-5a1b-44f1-afc0-e4d631f129c1 tempest-CreateVolumesFromSnapshotTest-622878184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:14:13 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-e3ba0519-5a1b-44f1-afc0-e4d631f129c1 tempest-CreateVolumesFromSnapshotTest-622878184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:14:13 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e3ba0519-5a1b-44f1-afc0-e4d631f129c1 tempest-CreateVolumesFromSnapshotTest-622878184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:13 devstack sudo[90312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:14:13 devstack sudo[90312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:13 devstack sudo[90290]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:13 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-8aa5d796-d22d-4d70-add4-87a17b3048d4 tempest-VolumeDependencyTests-2146631135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6ff267a1-912d-4e38-a419-867191f84b15" returned: 0 in 2.306s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:13 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[544e6a87-0e98-45dc-9d48-478624cbd016]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:14:13 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-8aa5d796-d22d-4d70-add4-87a17b3048d4 tempest-VolumeDependencyTests-2146631135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:13 devstack sudo[90314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148
Apr 15 20:14:13 devstack sudo[90314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:13 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-498d1854-68cb-4bac-869f-427f82059b90 tempest-CreateVolumesFromSnapshotTest-622878184 None] Acquiring lock "cinder-3af14053-bcc4-48c3-b23a-e2203150e87b-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:14:13 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-498d1854-68cb-4bac-869f-427f82059b90 tempest-CreateVolumesFromSnapshotTest-622878184 None] Lock "cinder-3af14053-bcc4-48c3-b23a-e2203150e87b-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:14:13 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-498d1854-68cb-4bac-869f-427f82059b90 tempest-CreateVolumesFromSnapshotTest-622878184 None] Acquiring lock "cinder-quobyte-3af14053-bcc4-48c3-b23a-e2203150e87b" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:14:13 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-498d1854-68cb-4bac-869f-427f82059b90 tempest-CreateVolumesFromSnapshotTest-622878184 None] Lock "cinder-quobyte-3af14053-bcc4-48c3-b23a-e2203150e87b" acquired by "delete_volume" :: waited 0.006s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:14:13 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[f51ab267-773d-4327-a844-a27f7372b470]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:14:13 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-498d1854-68cb-4bac-869f-427f82059b90 tempest-CreateVolumesFromSnapshotTest-622878184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3af14053-bcc4-48c3-b23a-e2203150e87b {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:13 devstack sudo[90316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3af14053-bcc4-48c3-b23a-e2203150e87b
Apr 15 20:14:13 devstack sudo[90316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:14 devstack sudo[90312]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:14 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e3ba0519-5a1b-44f1-afc0-e4d631f129c1 tempest-CreateVolumesFromSnapshotTest-622878184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.443s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:14 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-e3ba0519-5a1b-44f1-afc0-e4d631f129c1 tempest-CreateVolumesFromSnapshotTest-622878184 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:14:14 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-e3ba0519-5a1b-44f1-afc0-e4d631f129c1 tempest-CreateVolumesFromSnapshotTest-622878184 None] Deleted volume successfully.
Apr 15 20:14:14 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-e3ba0519-5a1b-44f1-afc0-e4d631f129c1 tempest-CreateVolumesFromSnapshotTest-622878184 None] Lock "cinder-309a5d32-e062-49ea-a68e-3630952bf1f6-delete_volume" released by "delete_volume" :: held 2.509s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:14:14 devstack sudo[90314]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:14 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-8aa5d796-d22d-4d70-add4-87a17b3048d4 tempest-VolumeDependencyTests-2146631135 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148" returned: 0 in 0.651s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:14 devstack cinder-volume[82646]: DEBUG cinder.image.image_utils [None req-8aa5d796-d22d-4d70-add4-87a17b3048d4 tempest-VolumeDependencyTests-2146631135 None] Image conversion details: src /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148, size 1024.00 MB, duration 2.31 sec, destination /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6ff267a1-912d-4e38-a419-867191f84b15 {{(pid=82646) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 20:14:14 devstack cinder-volume[82646]: INFO cinder.image.image_utils [None req-8aa5d796-d22d-4d70-add4-87a17b3048d4 tempest-VolumeDependencyTests-2146631135 None] Converted 1024.00 MB image at 443.80 MB/s
Apr 15 20:14:14 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-8aa5d796-d22d-4d70-add4-87a17b3048d4 tempest-VolumeDependencyTests-2146631135 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6ff267a1-912d-4e38-a419-867191f84b15 is being set with open permissions: ugo+rw
Apr 15 20:14:14 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-8aa5d796-d22d-4d70-add4-87a17b3048d4 tempest-VolumeDependencyTests-2146631135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6ff267a1-912d-4e38-a419-867191f84b15 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:14 devstack sudo[90325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6ff267a1-912d-4e38-a419-867191f84b15
Apr 15 20:14:14 devstack sudo[90325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:14 devstack sudo[90316]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:14 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-498d1854-68cb-4bac-869f-427f82059b90 tempest-CreateVolumesFromSnapshotTest-622878184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3af14053-bcc4-48c3-b23a-e2203150e87b" returned: 0 in 0.484s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:14 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-498d1854-68cb-4bac-869f-427f82059b90 tempest-CreateVolumesFromSnapshotTest-622878184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3af14053-bcc4-48c3-b23a-e2203150e87b {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:14 devstack sudo[90327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3af14053-bcc4-48c3-b23a-e2203150e87b
Apr 15 20:14:14 devstack sudo[90327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:14 devstack sudo[90325]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:14 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-8aa5d796-d22d-4d70-add4-87a17b3048d4 tempest-VolumeDependencyTests-2146631135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6ff267a1-912d-4e38-a419-867191f84b15" returned: 0 in 0.454s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:14 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-8aa5d796-d22d-4d70-add4-87a17b3048d4 tempest-VolumeDependencyTests-2146631135 None] Lock "cinder-quobyte-6ff267a1-912d-4e38-a419-867191f84b15" released by "_copy_volume_from_snapshot" :: held 4.466s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:14:14 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-8aa5d796-d22d-4d70-add4-87a17b3048d4 tempest-VolumeDependencyTests-2146631135 None] Lock "cinder-quobyte-d19b377d-98df-4d17-9bbc-39a0a0ec8db4-6ff267a1-912d-4e38-a419-867191f84b15" released by "_create_volume_from_snapshot" :: held 4.527s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:14:14 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-8aa5d796-d22d-4d70-add4-87a17b3048d4 tempest-VolumeDependencyTests-2146631135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.597s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:14:14 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-723ff4d5-7f51-4d8f-b00f-38542ae04311 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.491s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:14:14 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-723ff4d5-7f51-4d8f-b00f-38542ae04311 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1956543268',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4144cf9-c659-4c22-93f4-8a7c20e93dcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a1f5ae17c2943ba885c848f93851600',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:10Z,use_quota=True,user_id='77b9c6fd5b904cac92d8b9fc762e1055',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:14:14 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-723ff4d5-7f51-4d8f-b00f-38542ae04311 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Creating volume d4144cf9-c659-4c22-93f4-8a7c20e93dcb {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:14:14 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-723ff4d5-7f51-4d8f-b00f-38542ae04311 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:14:14 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-723ff4d5-7f51-4d8f-b00f-38542ae04311 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:14:14 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-723ff4d5-7f51-4d8f-b00f-38542ae04311 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:14:14 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-723ff4d5-7f51-4d8f-b00f-38542ae04311 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:14:14 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-723ff4d5-7f51-4d8f-b00f-38542ae04311 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:14:14 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-723ff4d5-7f51-4d8f-b00f-38542ae04311 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:14:14 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-723ff4d5-7f51-4d8f-b00f-38542ae04311 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:14:14 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-723ff4d5-7f51-4d8f-b00f-38542ae04311 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d4144cf9-c659-4c22-93f4-8a7c20e93dcb 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:14 devstack sudo[90331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d4144cf9-c659-4c22-93f4-8a7c20e93dcb 1073741824
Apr 15 20:14:14 devstack sudo[90331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-8aa5d796-d22d-4d70-add4-87a17b3048d4 tempest-VolumeDependencyTests-2146631135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7ca5c0d-7966-4b5f-94fd-27d547081918) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ff267a1-912d-4e38-a419-867191f84b15', 'volume_size': 1, 'snapshot_id': 'd19b377d-98df-4d17-9bbc-39a0a0ec8db4'}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:14 devstack sudo[90327]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-8aa5d796-d22d-4d70-add4-87a17b3048d4 tempest-VolumeDependencyTests-2146631135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4178fb2c-448f-4742-a96b-b9552b61c1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:14 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-498d1854-68cb-4bac-869f-427f82059b90 tempest-CreateVolumesFromSnapshotTest-622878184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-3af14053-bcc4-48c3-b23a-e2203150e87b" returned: 0 in 0.467s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:14 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-8aa5d796-d22d-4d70-add4-87a17b3048d4 tempest-VolumeDependencyTests-2146631135 None] Volume volume-6ff267a1-912d-4e38-a419-867191f84b15 (6ff267a1-912d-4e38-a419-867191f84b15): created successfully
Apr 15 20:14:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-8aa5d796-d22d-4d70-add4-87a17b3048d4 tempest-VolumeDependencyTests-2146631135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4178fb2c-448f-4742-a96b-b9552b61c1f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:14 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-8aa5d796-d22d-4d70-add4-87a17b3048d4 tempest-VolumeDependencyTests-2146631135 None] Flow 'volume_create_manager' (2664607e-91ee-4165-8420-06e81811faa9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:14:14 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-498d1854-68cb-4bac-869f-427f82059b90 tempest-CreateVolumesFromSnapshotTest-622878184 None] Lock "cinder-quobyte-3af14053-bcc4-48c3-b23a-e2203150e87b" released by "delete_volume" :: held 0.983s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:14:14 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-8aa5d796-d22d-4d70-add4-87a17b3048d4 tempest-VolumeDependencyTests-2146631135 None] Created volume successfully.
Apr 15 20:14:14 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-498d1854-68cb-4bac-869f-427f82059b90 tempest-CreateVolumesFromSnapshotTest-622878184 None] Created reservations ['df78183f-2a9e-4c2f-b09a-08c417c4db27', 'faba72a5-ffa8-40ec-9e22-ab650faeaa23', 'ea16a673-adcc-4645-9dc0-867a34037547', '2ab0c142-b2e6-4f48-931b-26c9bc2e43ff'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:14:14 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-498d1854-68cb-4bac-869f-427f82059b90 tempest-CreateVolumesFromSnapshotTest-622878184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:14:14 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-498d1854-68cb-4bac-869f-427f82059b90 tempest-CreateVolumesFromSnapshotTest-622878184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:14:14 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-498d1854-68cb-4bac-869f-427f82059b90 tempest-CreateVolumesFromSnapshotTest-622878184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:14:14 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-498d1854-68cb-4bac-869f-427f82059b90 tempest-CreateVolumesFromSnapshotTest-622878184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:14:14 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-498d1854-68cb-4bac-869f-427f82059b90 tempest-CreateVolumesFromSnapshotTest-622878184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:14:14 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-498d1854-68cb-4bac-869f-427f82059b90 tempest-CreateVolumesFromSnapshotTest-622878184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:14 devstack sudo[90333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:14:14 devstack sudo[90333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:15 devstack sudo[90331]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:15 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-723ff4d5-7f51-4d8f-b00f-38542ae04311 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d4144cf9-c659-4c22-93f4-8a7c20e93dcb 1073741824" returned: 0 in 0.529s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:15 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-723ff4d5-7f51-4d8f-b00f-38542ae04311 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d4144cf9-c659-4c22-93f4-8a7c20e93dcb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:15 devstack sudo[90339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d4144cf9-c659-4c22-93f4-8a7c20e93dcb
Apr 15 20:14:15 devstack sudo[90339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:15 devstack sudo[90333]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:15 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-498d1854-68cb-4bac-869f-427f82059b90 tempest-CreateVolumesFromSnapshotTest-622878184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.465s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:15 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-498d1854-68cb-4bac-869f-427f82059b90 tempest-CreateVolumesFromSnapshotTest-622878184 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:14:15 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-498d1854-68cb-4bac-869f-427f82059b90 tempest-CreateVolumesFromSnapshotTest-622878184 None] Deleted volume successfully.
Apr 15 20:14:15 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-498d1854-68cb-4bac-869f-427f82059b90 tempest-CreateVolumesFromSnapshotTest-622878184 None] Lock "cinder-3af14053-bcc4-48c3-b23a-e2203150e87b-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:14:15 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-021b377b-0df5-4f5d-b4b8-039c2a3d9b7c tempest-VolumeDependencyTests-2146631135 None] Acquiring lock "cinder-d19b377d-98df-4d17-9bbc-39a0a0ec8db4-delete_snapshot" by "delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:14:15 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-021b377b-0df5-4f5d-b4b8-039c2a3d9b7c tempest-VolumeDependencyTests-2146631135 None] Lock "cinder-d19b377d-98df-4d17-9bbc-39a0a0ec8db4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:14:15 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-021b377b-0df5-4f5d-b4b8-039c2a3d9b7c tempest-VolumeDependencyTests-2146631135 None] Acquiring lock "cinder-quobyte-f32e8a08-8198-4a7d-9bb9-ae3d8792d148" by "delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:14:15 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-021b377b-0df5-4f5d-b4b8-039c2a3d9b7c tempest-VolumeDependencyTests-2146631135 None] Lock "cinder-quobyte-f32e8a08-8198-4a7d-9bb9-ae3d8792d148" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:14:15 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-021b377b-0df5-4f5d-b4b8-039c2a3d9b7c tempest-VolumeDependencyTests-2146631135 None] Acquiring lock "cinder-quobyte-d19b377d-98df-4d17-9bbc-39a0a0ec8db4" by "_delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:14:15 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-021b377b-0df5-4f5d-b4b8-039c2a3d9b7c tempest-VolumeDependencyTests-2146631135 None] Lock "cinder-quobyte-d19b377d-98df-4d17-9bbc-39a0a0ec8db4" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:14:15 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-021b377b-0df5-4f5d-b4b8-039c2a3d9b7c tempest-VolumeDependencyTests-2146631135 None] Deleting offline snapshot d19b377d-98df-4d17-9bbc-39a0a0ec8db4 of volume f32e8a08-8198-4a7d-9bb9-ae3d8792d148 {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 20:14:15 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-021b377b-0df5-4f5d-b4b8-039c2a3d9b7c tempest-VolumeDependencyTests-2146631135 None] snapshot_file for this snap is: volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148.d19b377d-98df-4d17-9bbc-39a0a0ec8db4 {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 20:14:15 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[7426f8f0-36fe-49fb-8a98-0be5efd56833]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:14:15 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-021b377b-0df5-4f5d-b4b8-039c2a3d9b7c tempest-VolumeDependencyTests-2146631135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148.d19b377d-98df-4d17-9bbc-39a0a0ec8db4 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:15 devstack sudo[90339]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:15 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-723ff4d5-7f51-4d8f-b00f-38542ae04311 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d4144cf9-c659-4c22-93f4-8a7c20e93dcb" returned: 0 in 0.489s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:15 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-723ff4d5-7f51-4d8f-b00f-38542ae04311 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:14:15 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-723ff4d5-7f51-4d8f-b00f-38542ae04311 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:14:15 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-032a6c3b-ed37-40e0-83e1-23f6d618eefc tempest-SnapshotDependencyTests-404514513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.286s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:14:15 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-723ff4d5-7f51-4d8f-b00f-38542ae04311 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (452b75a7-2e07-4133-8da5-62c6f47dfa19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4144cf9-c659-4c22-93f4-8a7c20e93dcb', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:15 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-723ff4d5-7f51-4d8f-b00f-38542ae04311 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (901adbf0-2e98-4042-9fd4-94545e186b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:15 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-032a6c3b-ed37-40e0-83e1-23f6d618eefc tempest-SnapshotDependencyTests-404514513 None] Creating offline snapshot 9abc9611-096b-4035-bc06-a5bd81331506 of volume 444c2edb-5699-4c6f-97a3-57e19485ef02 {{(pid=82646) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 20:14:15 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-723ff4d5-7f51-4d8f-b00f-38542ae04311 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Volume volume-d4144cf9-c659-4c22-93f4-8a7c20e93dcb (d4144cf9-c659-4c22-93f4-8a7c20e93dcb): created successfully
Apr 15 20:14:15 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-723ff4d5-7f51-4d8f-b00f-38542ae04311 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (901adbf0-2e98-4042-9fd4-94545e186b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:15 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-723ff4d5-7f51-4d8f-b00f-38542ae04311 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Flow 'volume_create_manager' (c74b4edd-8aff-4671-af75-090083680df8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:14:15 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3db4190-dc26-4b79-96a8-a87cb7516954]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:14:15 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-032a6c3b-ed37-40e0-83e1-23f6d618eefc tempest-SnapshotDependencyTests-404514513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-444c2edb-5699-4c6f-97a3-57e19485ef02 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:15 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-723ff4d5-7f51-4d8f-b00f-38542ae04311 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Created volume successfully.
Apr 15 20:14:15 devstack sudo[90342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148.d19b377d-98df-4d17-9bbc-39a0a0ec8db4
Apr 15 20:14:15 devstack sudo[90342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:15 devstack sudo[90343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-444c2edb-5699-4c6f-97a3-57e19485ef02
Apr 15 20:14:15 devstack sudo[90343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:16 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-259a75d4-c0ae-4e51-ac66-9ce5ca196d53 tempest-CreateVolumesFromSnapshotTest-622878184 None] Acquiring lock "cinder-8c016cca-c76a-4651-8946-5799661120d6-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:14:16 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-259a75d4-c0ae-4e51-ac66-9ce5ca196d53 tempest-CreateVolumesFromSnapshotTest-622878184 None] Lock "cinder-8c016cca-c76a-4651-8946-5799661120d6-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:14:16 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-259a75d4-c0ae-4e51-ac66-9ce5ca196d53 tempest-CreateVolumesFromSnapshotTest-622878184 None] Acquiring lock "cinder-quobyte-8c016cca-c76a-4651-8946-5799661120d6" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:14:16 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-259a75d4-c0ae-4e51-ac66-9ce5ca196d53 tempest-CreateVolumesFromSnapshotTest-622878184 None] Lock "cinder-quobyte-8c016cca-c76a-4651-8946-5799661120d6" acquired by "delete_volume" :: waited 0.007s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:14:16 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc91b18-fa6e-4f97-a5dc-e125073aa4d3]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:14:16 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-259a75d4-c0ae-4e51-ac66-9ce5ca196d53 tempest-CreateVolumesFromSnapshotTest-622878184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8c016cca-c76a-4651-8946-5799661120d6 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:16 devstack sudo[90347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8c016cca-c76a-4651-8946-5799661120d6
Apr 15 20:14:16 devstack sudo[90347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:16 devstack sudo[90342]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:16 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-021b377b-0df5-4f5d-b4b8-039c2a3d9b7c tempest-VolumeDependencyTests-2146631135 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148.d19b377d-98df-4d17-9bbc-39a0a0ec8db4" returned: 0 in 0.590s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:16 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-021b377b-0df5-4f5d-b4b8-039c2a3d9b7c tempest-VolumeDependencyTests-2146631135 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82646) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 20:14:16 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[514e2742-c69b-4e6c-b413-5d91f4f433cb]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:14:16 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-021b377b-0df5-4f5d-b4b8-039c2a3d9b7c tempest-VolumeDependencyTests-2146631135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:16 devstack sudo[90343]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:16 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-032a6c3b-ed37-40e0-83e1-23f6d618eefc tempest-SnapshotDependencyTests-404514513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-444c2edb-5699-4c6f-97a3-57e19485ef02" returned: 0 in 0.564s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:16 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-032a6c3b-ed37-40e0-83e1-23f6d618eefc tempest-SnapshotDependencyTests-404514513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-444c2edb-5699-4c6f-97a3-57e19485ef02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-444c2edb-5699-4c6f-97a3-57e19485ef02.9abc9611-096b-4035-bc06-a5bd81331506 1G {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:16 devstack sudo[90357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-444c2edb-5699-4c6f-97a3-57e19485ef02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-444c2edb-5699-4c6f-97a3-57e19485ef02.9abc9611-096b-4035-bc06-a5bd81331506 1G
Apr 15 20:14:16 devstack sudo[90357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:16 devstack sudo[90355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148
Apr 15 20:14:16 devstack sudo[90355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:16 devstack sudo[90347]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:16 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-259a75d4-c0ae-4e51-ac66-9ce5ca196d53 tempest-CreateVolumesFromSnapshotTest-622878184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8c016cca-c76a-4651-8946-5799661120d6" returned: 0 in 0.533s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:16 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-259a75d4-c0ae-4e51-ac66-9ce5ca196d53 tempest-CreateVolumesFromSnapshotTest-622878184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8c016cca-c76a-4651-8946-5799661120d6 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:16 devstack sudo[90362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8c016cca-c76a-4651-8946-5799661120d6
Apr 15 20:14:16 devstack sudo[90362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:16 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-a06d5443-932b-4fd8-986b-eb75c39bc9c6 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:14:16 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-a06d5443-932b-4fd8-986b-eb75c39bc9c6 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Flow 'volume_create_manager' (bdca4b32-f173-4a43-aaff-3844ab365a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:14:16 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-a06d5443-932b-4fd8-986b-eb75c39bc9c6 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c996081-a1c8-43ae-af62-bd3691afe77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:16 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-a06d5443-932b-4fd8-986b-eb75c39bc9c6 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c996081-a1c8-43ae-af62-bd3691afe77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:14:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1289687418',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d19f68ad-edc8-454f-ad7d-acde77a7b353,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a1f5ae17c2943ba885c848f93851600',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:17Z,use_quota=True,user_id='77b9c6fd5b904cac92d8b9fc762e1055',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-a06d5443-932b-4fd8-986b-eb75c39bc9c6 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca7f8b91-7863-4182-a747-ecfce1e6687c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-a06d5443-932b-4fd8-986b-eb75c39bc9c6 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca7f8b91-7863-4182-a747-ecfce1e6687c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-a06d5443-932b-4fd8-986b-eb75c39bc9c6 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67c33180-1d41-469c-9dd8-83419f5cb35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-a06d5443-932b-4fd8-986b-eb75c39bc9c6 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67c33180-1d41-469c-9dd8-83419f5cb35d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd19f68ad-edc8-454f-ad7d-acde77a7b353', 'volume_name': 'volume-d19f68ad-edc8-454f-ad7d-acde77a7b353', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-a06d5443-932b-4fd8-986b-eb75c39bc9c6 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (254e184b-1e31-43d1-98f4-be322aef5c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-a06d5443-932b-4fd8-986b-eb75c39bc9c6 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (254e184b-1e31-43d1-98f4-be322aef5c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-a06d5443-932b-4fd8-986b-eb75c39bc9c6 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecb7d99c-048d-4502-a6e4-ba74ee552266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:17 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-a06d5443-932b-4fd8-986b-eb75c39bc9c6 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Volume d19f68ad-edc8-454f-ad7d-acde77a7b353: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d19f68ad-edc8-454f-ad7d-acde77a7b353', 'volume_size': 1}
Apr 15 20:14:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-a06d5443-932b-4fd8-986b-eb75c39bc9c6 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:14:17 devstack sudo[90357]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-032a6c3b-ed37-40e0-83e1-23f6d618eefc tempest-SnapshotDependencyTests-404514513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-444c2edb-5699-4c6f-97a3-57e19485ef02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-444c2edb-5699-4c6f-97a3-57e19485ef02.9abc9611-096b-4035-bc06-a5bd81331506 1G" returned: 0 in 0.622s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-032a6c3b-ed37-40e0-83e1-23f6d618eefc tempest-SnapshotDependencyTests-404514513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-444c2edb-5699-4c6f-97a3-57e19485ef02 -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-444c2edb-5699-4c6f-97a3-57e19485ef02.9abc9611-096b-4035-bc06-a5bd81331506 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:17 devstack sudo[90371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-444c2edb-5699-4c6f-97a3-57e19485ef02 -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-444c2edb-5699-4c6f-97a3-57e19485ef02.9abc9611-096b-4035-bc06-a5bd81331506
Apr 15 20:14:17 devstack sudo[90371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:17 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-410f6298-82ee-42e7-8859-64788b18d129 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:14:17 devstack sudo[90355]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-410f6298-82ee-42e7-8859-64788b18d129 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Flow 'volume_create_manager' (7b54a83f-ccb9-4f85-8e7f-82dbb5c1cbcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:14:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-410f6298-82ee-42e7-8859-64788b18d129 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e315feac-a935-4436-8965-72ba412ed28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:17 devstack sudo[90362]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-410f6298-82ee-42e7-8859-64788b18d129 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e315feac-a935-4436-8965-72ba412ed28c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:14:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-52408987',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7bf4b1f-eb94-40ef-b8e4-a7e2c6020b32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a1f5ae17c2943ba885c848f93851600',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:17Z,use_quota=True,user_id='77b9c6fd5b904cac92d8b9fc762e1055',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-410f6298-82ee-42e7-8859-64788b18d129 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac2b2517-7b5b-4b8a-8417-4820d3da1ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-410f6298-82ee-42e7-8859-64788b18d129 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac2b2517-7b5b-4b8a-8417-4820d3da1ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-410f6298-82ee-42e7-8859-64788b18d129 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f71fe87-7a5a-45b8-a373-360a22a07e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-410f6298-82ee-42e7-8859-64788b18d129 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f71fe87-7a5a-45b8-a373-360a22a07e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7bf4b1f-eb94-40ef-b8e4-a7e2c6020b32', 'volume_name': 'volume-a7bf4b1f-eb94-40ef-b8e4-a7e2c6020b32', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-410f6298-82ee-42e7-8859-64788b18d129 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c1d186f-7ead-4bf7-b0ff-bdee503a0be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-410f6298-82ee-42e7-8859-64788b18d129 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c1d186f-7ead-4bf7-b0ff-bdee503a0be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-410f6298-82ee-42e7-8859-64788b18d129 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f459585b-cfd5-4fd6-96fd-c7a0c59b2b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:17 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-410f6298-82ee-42e7-8859-64788b18d129 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Volume a7bf4b1f-eb94-40ef-b8e4-a7e2c6020b32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7bf4b1f-eb94-40ef-b8e4-a7e2c6020b32', 'volume_size': 1}
Apr 15 20:14:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-410f6298-82ee-42e7-8859-64788b18d129 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:14:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-021b377b-0df5-4f5d-b4b8-039c2a3d9b7c tempest-VolumeDependencyTests-2146631135 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148" returned: 0 in 0.840s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-259a75d4-c0ae-4e51-ac66-9ce5ca196d53 tempest-CreateVolumesFromSnapshotTest-622878184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-8c016cca-c76a-4651-8946-5799661120d6" returned: 0 in 0.670s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-021b377b-0df5-4f5d-b4b8-039c2a3d9b7c tempest-VolumeDependencyTests-2146631135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148.d19b377d-98df-4d17-9bbc-39a0a0ec8db4 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:17 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-259a75d4-c0ae-4e51-ac66-9ce5ca196d53 tempest-CreateVolumesFromSnapshotTest-622878184 None] Lock "cinder-quobyte-8c016cca-c76a-4651-8946-5799661120d6" released by "delete_volume" :: held 1.245s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:14:17 devstack sudo[90373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148.d19b377d-98df-4d17-9bbc-39a0a0ec8db4
Apr 15 20:14:17 devstack sudo[90373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:17 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-259a75d4-c0ae-4e51-ac66-9ce5ca196d53 tempest-CreateVolumesFromSnapshotTest-622878184 None] Created reservations ['787bd779-a385-4ec1-9378-c05af277909c', '9702e2d0-9eee-4326-932f-f8cc6656161e', 'bd349ec8-c6e6-443f-8ea4-f459c833a111', '62f184a9-e04d-46ac-951e-f8e7a936433b'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:14:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-259a75d4-c0ae-4e51-ac66-9ce5ca196d53 tempest-CreateVolumesFromSnapshotTest-622878184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:14:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-259a75d4-c0ae-4e51-ac66-9ce5ca196d53 tempest-CreateVolumesFromSnapshotTest-622878184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:14:17 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-259a75d4-c0ae-4e51-ac66-9ce5ca196d53 tempest-CreateVolumesFromSnapshotTest-622878184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:14:17 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-259a75d4-c0ae-4e51-ac66-9ce5ca196d53 tempest-CreateVolumesFromSnapshotTest-622878184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:14:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-259a75d4-c0ae-4e51-ac66-9ce5ca196d53 tempest-CreateVolumesFromSnapshotTest-622878184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:14:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-259a75d4-c0ae-4e51-ac66-9ce5ca196d53 tempest-CreateVolumesFromSnapshotTest-622878184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:17 devstack sudo[90375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:14:17 devstack sudo[90375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:17 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-070ab9f9-390d-4907-98b9-cc600f3ffac8 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:14:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-070ab9f9-390d-4907-98b9-cc600f3ffac8 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Flow 'volume_create_manager' (3bc3164d-7d2d-4b54-9ba3-19920a493dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:14:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-070ab9f9-390d-4907-98b9-cc600f3ffac8 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (451753eb-dfa3-4695-b339-63541a64b7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-070ab9f9-390d-4907-98b9-cc600f3ffac8 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (451753eb-dfa3-4695-b339-63541a64b7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:14:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-713293822',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b11b64a-2bda-4405-ac94-66765e8c33b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a1f5ae17c2943ba885c848f93851600',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:17Z,use_quota=True,user_id='77b9c6fd5b904cac92d8b9fc762e1055',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-070ab9f9-390d-4907-98b9-cc600f3ffac8 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f890128-4fa3-4e10-a20d-059e789be6c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-070ab9f9-390d-4907-98b9-cc600f3ffac8 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f890128-4fa3-4e10-a20d-059e789be6c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-070ab9f9-390d-4907-98b9-cc600f3ffac8 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16ed84b2-a277-4251-b254-f2c3bdf3dc1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-070ab9f9-390d-4907-98b9-cc600f3ffac8 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16ed84b2-a277-4251-b254-f2c3bdf3dc1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b11b64a-2bda-4405-ac94-66765e8c33b6', 'volume_name': 'volume-9b11b64a-2bda-4405-ac94-66765e8c33b6', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-070ab9f9-390d-4907-98b9-cc600f3ffac8 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63e4ef88-2564-44fc-93a8-4da05402ffa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-070ab9f9-390d-4907-98b9-cc600f3ffac8 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63e4ef88-2564-44fc-93a8-4da05402ffa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-070ab9f9-390d-4907-98b9-cc600f3ffac8 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (984a1c00-4032-4932-9c37-0ca6d7c65a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:17 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-070ab9f9-390d-4907-98b9-cc600f3ffac8 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Volume 9b11b64a-2bda-4405-ac94-66765e8c33b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b11b64a-2bda-4405-ac94-66765e8c33b6', 'volume_size': 1}
Apr 15 20:14:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-070ab9f9-390d-4907-98b9-cc600f3ffac8 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:14:17 devstack sudo[90371]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-032a6c3b-ed37-40e0-83e1-23f6d618eefc tempest-SnapshotDependencyTests-404514513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-444c2edb-5699-4c6f-97a3-57e19485ef02 -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-444c2edb-5699-4c6f-97a3-57e19485ef02.9abc9611-096b-4035-bc06-a5bd81331506" returned: 0 in 0.553s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:17 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-032a6c3b-ed37-40e0-83e1-23f6d618eefc tempest-SnapshotDependencyTests-404514513 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-444c2edb-5699-4c6f-97a3-57e19485ef02.9abc9611-096b-4035-bc06-a5bd81331506 is being set with open permissions: ugo+rw
Apr 15 20:14:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-032a6c3b-ed37-40e0-83e1-23f6d618eefc tempest-SnapshotDependencyTests-404514513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-444c2edb-5699-4c6f-97a3-57e19485ef02.9abc9611-096b-4035-bc06-a5bd81331506 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:17 devstack sudo[90380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-444c2edb-5699-4c6f-97a3-57e19485ef02.9abc9611-096b-4035-bc06-a5bd81331506
Apr 15 20:14:17 devstack sudo[90380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:17 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-24159c3a-15a2-41ab-a0b6-2029e9c04612 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:14:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-24159c3a-15a2-41ab-a0b6-2029e9c04612 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Flow 'volume_create_manager' (6d648f8b-d316-4106-93ae-b365275f492e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:14:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-24159c3a-15a2-41ab-a0b6-2029e9c04612 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d47c55bb-a188-45d3-861e-515e759e0a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-24159c3a-15a2-41ab-a0b6-2029e9c04612 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d47c55bb-a188-45d3-861e-515e759e0a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-746457494',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85b0ec8e-c9d2-4dfb-9909-2d71d036dbe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a1f5ae17c2943ba885c848f93851600',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:18Z,use_quota=True,user_id='77b9c6fd5b904cac92d8b9fc762e1055',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-24159c3a-15a2-41ab-a0b6-2029e9c04612 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab729854-8dce-4704-ba99-a740aab1b0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-24159c3a-15a2-41ab-a0b6-2029e9c04612 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab729854-8dce-4704-ba99-a740aab1b0ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-24159c3a-15a2-41ab-a0b6-2029e9c04612 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fe17970-45e0-4a2b-9ba1-f71e2f809a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-24159c3a-15a2-41ab-a0b6-2029e9c04612 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fe17970-45e0-4a2b-9ba1-f71e2f809a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85b0ec8e-c9d2-4dfb-9909-2d71d036dbe3', 'volume_name': 'volume-85b0ec8e-c9d2-4dfb-9909-2d71d036dbe3', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-24159c3a-15a2-41ab-a0b6-2029e9c04612 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91f7ce7e-8268-48d1-bf85-490ab64e2fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-24159c3a-15a2-41ab-a0b6-2029e9c04612 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91f7ce7e-8268-48d1-bf85-490ab64e2fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:17 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-24159c3a-15a2-41ab-a0b6-2029e9c04612 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea618d02-3ca2-4499-ae3b-8fa56edfefe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:17 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-24159c3a-15a2-41ab-a0b6-2029e9c04612 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Volume 85b0ec8e-c9d2-4dfb-9909-2d71d036dbe3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85b0ec8e-c9d2-4dfb-9909-2d71d036dbe3', 'volume_size': 1}
Apr 15 20:14:17 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-24159c3a-15a2-41ab-a0b6-2029e9c04612 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:14:18 devstack sudo[90375]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-259a75d4-c0ae-4e51-ac66-9ce5ca196d53 tempest-CreateVolumesFromSnapshotTest-622878184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.626s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:18 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-259a75d4-c0ae-4e51-ac66-9ce5ca196d53 tempest-CreateVolumesFromSnapshotTest-622878184 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:14:18 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-259a75d4-c0ae-4e51-ac66-9ce5ca196d53 tempest-CreateVolumesFromSnapshotTest-622878184 None] Deleted volume successfully.
Apr 15 20:14:18 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3555a26-485d-49d8-a41e-e5c14dcd159e tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:14:18 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b3555a26-485d-49d8-a41e-e5c14dcd159e tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Flow 'volume_create_manager' (6333df11-dfa2-44ad-9406-f239f529b61c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:14:18 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b3555a26-485d-49d8-a41e-e5c14dcd159e tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80ba95fb-31ef-4d5e-aae2-d791e88f262e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:18 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b3555a26-485d-49d8-a41e-e5c14dcd159e tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80ba95fb-31ef-4d5e-aae2-d791e88f262e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1591393407',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9140effe-99b2-453f-b875-0a57e7aee56c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a1f5ae17c2943ba885c848f93851600',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:18Z,use_quota=True,user_id='77b9c6fd5b904cac92d8b9fc762e1055',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:18 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b3555a26-485d-49d8-a41e-e5c14dcd159e tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49b2a16b-2ca5-4890-a78c-e36682e6426f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:18 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b3555a26-485d-49d8-a41e-e5c14dcd159e tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49b2a16b-2ca5-4890-a78c-e36682e6426f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:18 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b3555a26-485d-49d8-a41e-e5c14dcd159e tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5be72f9-6787-4eed-9444-ac5687fa51b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:18 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b3555a26-485d-49d8-a41e-e5c14dcd159e tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5be72f9-6787-4eed-9444-ac5687fa51b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9140effe-99b2-453f-b875-0a57e7aee56c', 'volume_name': 'volume-9140effe-99b2-453f-b875-0a57e7aee56c', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:18 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b3555a26-485d-49d8-a41e-e5c14dcd159e tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2e3236e-c9db-4861-a27a-66a9a16f8219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:18 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b3555a26-485d-49d8-a41e-e5c14dcd159e tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2e3236e-c9db-4861-a27a-66a9a16f8219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:18 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b3555a26-485d-49d8-a41e-e5c14dcd159e tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14c1a7b5-bc73-451c-9367-05606d28e8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:18 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-b3555a26-485d-49d8-a41e-e5c14dcd159e tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Volume 9140effe-99b2-453f-b875-0a57e7aee56c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9140effe-99b2-453f-b875-0a57e7aee56c', 'volume_size': 1}
Apr 15 20:14:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-b3555a26-485d-49d8-a41e-e5c14dcd159e tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:14:18 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-259a75d4-c0ae-4e51-ac66-9ce5ca196d53 tempest-CreateVolumesFromSnapshotTest-622878184 None] Lock "cinder-8c016cca-c76a-4651-8946-5799661120d6-delete_volume" released by "delete_volume" :: held 2.069s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:14:18 devstack sudo[90373]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-021b377b-0df5-4f5d-b4b8-039c2a3d9b7c tempest-VolumeDependencyTests-2146631135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148.d19b377d-98df-4d17-9bbc-39a0a0ec8db4" returned: 0 in 0.826s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-021b377b-0df5-4f5d-b4b8-039c2a3d9b7c tempest-VolumeDependencyTests-2146631135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148.d19b377d-98df-4d17-9bbc-39a0a0ec8db4 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:18 devstack sudo[90386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148.d19b377d-98df-4d17-9bbc-39a0a0ec8db4
Apr 15 20:14:18 devstack sudo[90386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:18 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-ba345841-ed1e-4c30-a806-d4910e1e38b1 tempest-CreateVolumesFromSnapshotTest-622878184 None] Acquiring lock "cinder-96e5d05f-a5b8-4dc6-b3dd-5d5d47d34a5c-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:14:18 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-ba345841-ed1e-4c30-a806-d4910e1e38b1 tempest-CreateVolumesFromSnapshotTest-622878184 None] Lock "cinder-96e5d05f-a5b8-4dc6-b3dd-5d5d47d34a5c-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:14:18 devstack sudo[90380]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-032a6c3b-ed37-40e0-83e1-23f6d618eefc tempest-SnapshotDependencyTests-404514513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-444c2edb-5699-4c6f-97a3-57e19485ef02.9abc9611-096b-4035-bc06-a5bd81331506" returned: 0 in 0.611s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:18 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-ba345841-ed1e-4c30-a806-d4910e1e38b1 tempest-CreateVolumesFromSnapshotTest-622878184 None] Acquiring lock "cinder-quobyte-96e5d05f-a5b8-4dc6-b3dd-5d5d47d34a5c" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:14:18 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-ba345841-ed1e-4c30-a806-d4910e1e38b1 tempest-CreateVolumesFromSnapshotTest-622878184 None] Lock "cinder-quobyte-96e5d05f-a5b8-4dc6-b3dd-5d5d47d34a5c" acquired by "delete_volume" :: waited 0.013s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:14:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-032a6c3b-ed37-40e0-83e1-23f6d618eefc tempest-SnapshotDependencyTests-404514513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-444c2edb-5699-4c6f-97a3-57e19485ef02.info {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:18 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[d665faa8-f52a-4fc6-9612-b022ceea35d4]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:14:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-ba345841-ed1e-4c30-a806-d4910e1e38b1 tempest-CreateVolumesFromSnapshotTest-622878184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-96e5d05f-a5b8-4dc6-b3dd-5d5d47d34a5c {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:18 devstack sudo[90389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-444c2edb-5699-4c6f-97a3-57e19485ef02.info
Apr 15 20:14:18 devstack sudo[90389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:18 devstack sudo[90390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-96e5d05f-a5b8-4dc6-b3dd-5d5d47d34a5c
Apr 15 20:14:18 devstack sudo[90390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:18 devstack sudo[90386]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-021b377b-0df5-4f5d-b4b8-039c2a3d9b7c tempest-VolumeDependencyTests-2146631135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148.d19b377d-98df-4d17-9bbc-39a0a0ec8db4" returned: 0 in 0.467s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:18 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-021b377b-0df5-4f5d-b4b8-039c2a3d9b7c tempest-VolumeDependencyTests-2146631135 None] Lock "cinder-quobyte-d19b377d-98df-4d17-9bbc-39a0a0ec8db4" released by "_delete_snapshot" :: held 2.783s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:14:18 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-021b377b-0df5-4f5d-b4b8-039c2a3d9b7c tempest-VolumeDependencyTests-2146631135 None] Lock "cinder-quobyte-f32e8a08-8198-4a7d-9bb9-ae3d8792d148" released by "delete_snapshot" :: held 2.794s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:14:18 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-021b377b-0df5-4f5d-b4b8-039c2a3d9b7c tempest-VolumeDependencyTests-2146631135 None] Created reservations ['ccc904c7-c7e5-431e-b8f5-c034d9d53020', 'a1737138-207c-4045-9925-923ffc0e5da7', '0237bdf2-f351-41a6-9839-c7a381080310', '6077bf81-8b51-4dd3-8958-47b452aaf40e'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:14:18 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-021b377b-0df5-4f5d-b4b8-039c2a3d9b7c tempest-VolumeDependencyTests-2146631135 None] Delete snapshot completed successfully.
Apr 15 20:14:18 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-021b377b-0df5-4f5d-b4b8-039c2a3d9b7c tempest-VolumeDependencyTests-2146631135 None] Lock "cinder-d19b377d-98df-4d17-9bbc-39a0a0ec8db4-delete_snapshot" released by "delete_snapshot" :: held 2.869s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:14:18 devstack sudo[90389]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-032a6c3b-ed37-40e0-83e1-23f6d618eefc tempest-SnapshotDependencyTests-404514513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-444c2edb-5699-4c6f-97a3-57e19485ef02.info" returned: 0 in 0.442s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:18 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-032a6c3b-ed37-40e0-83e1-23f6d618eefc tempest-SnapshotDependencyTests-404514513 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-444c2edb-5699-4c6f-97a3-57e19485ef02.info is being set with open permissions: ugo+rw
Apr 15 20:14:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-032a6c3b-ed37-40e0-83e1-23f6d618eefc tempest-SnapshotDependencyTests-404514513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-444c2edb-5699-4c6f-97a3-57e19485ef02.info {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:18 devstack sudo[90397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-444c2edb-5699-4c6f-97a3-57e19485ef02.info
Apr 15 20:14:18 devstack sudo[90397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:18 devstack sudo[90390]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-ba345841-ed1e-4c30-a806-d4910e1e38b1 tempest-CreateVolumesFromSnapshotTest-622878184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-96e5d05f-a5b8-4dc6-b3dd-5d5d47d34a5c" returned: 0 in 0.517s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:18 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-ba345841-ed1e-4c30-a806-d4910e1e38b1 tempest-CreateVolumesFromSnapshotTest-622878184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-96e5d05f-a5b8-4dc6-b3dd-5d5d47d34a5c {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:18 devstack sudo[90400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-96e5d05f-a5b8-4dc6-b3dd-5d5d47d34a5c
Apr 15 20:14:18 devstack sudo[90400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:18 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-9ecb261c-5ea1-4b28-9ae8-e14998b0dfe4 tempest-VolumeDependencyTests-2146631135 None] Acquiring lock "cinder-f32e8a08-8198-4a7d-9bb9-ae3d8792d148-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:14:19 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-9ecb261c-5ea1-4b28-9ae8-e14998b0dfe4 tempest-VolumeDependencyTests-2146631135 None] Lock "cinder-f32e8a08-8198-4a7d-9bb9-ae3d8792d148-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:14:19 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-9ecb261c-5ea1-4b28-9ae8-e14998b0dfe4 tempest-VolumeDependencyTests-2146631135 None] Acquiring lock "cinder-quobyte-f32e8a08-8198-4a7d-9bb9-ae3d8792d148" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:14:19 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-9ecb261c-5ea1-4b28-9ae8-e14998b0dfe4 tempest-VolumeDependencyTests-2146631135 None] Lock "cinder-quobyte-f32e8a08-8198-4a7d-9bb9-ae3d8792d148" acquired by "delete_volume" :: waited 0.008s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:14:19 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[5863256d-fe7d-467b-a204-ad6c73c54a48]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:14:19 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-9ecb261c-5ea1-4b28-9ae8-e14998b0dfe4 tempest-VolumeDependencyTests-2146631135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:19 devstack sudo[90397]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:19 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-032a6c3b-ed37-40e0-83e1-23f6d618eefc tempest-SnapshotDependencyTests-404514513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-444c2edb-5699-4c6f-97a3-57e19485ef02.info" returned: 0 in 0.422s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:19 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-032a6c3b-ed37-40e0-83e1-23f6d618eefc tempest-SnapshotDependencyTests-404514513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.309s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:14:19 devstack sudo[90403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148
Apr 15 20:14:19 devstack sudo[90403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:19 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-a06d5443-932b-4fd8-986b-eb75c39bc9c6 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.151s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:14:19 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-a06d5443-932b-4fd8-986b-eb75c39bc9c6 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:14:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1289687418',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d19f68ad-edc8-454f-ad7d-acde77a7b353,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a1f5ae17c2943ba885c848f93851600',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:17Z,use_quota=True,user_id='77b9c6fd5b904cac92d8b9fc762e1055',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:14:19 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-a06d5443-932b-4fd8-986b-eb75c39bc9c6 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Creating volume d19f68ad-edc8-454f-ad7d-acde77a7b353 {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:14:19 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-a06d5443-932b-4fd8-986b-eb75c39bc9c6 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:14:19 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-a06d5443-932b-4fd8-986b-eb75c39bc9c6 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:14:19 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-a06d5443-932b-4fd8-986b-eb75c39bc9c6 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:14:19 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-a06d5443-932b-4fd8-986b-eb75c39bc9c6 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:14:19 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-a06d5443-932b-4fd8-986b-eb75c39bc9c6 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:14:19 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-a06d5443-932b-4fd8-986b-eb75c39bc9c6 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:14:19 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-a06d5443-932b-4fd8-986b-eb75c39bc9c6 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:14:19 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-a06d5443-932b-4fd8-986b-eb75c39bc9c6 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d19f68ad-edc8-454f-ad7d-acde77a7b353 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:19 devstack sudo[90405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d19f68ad-edc8-454f-ad7d-acde77a7b353 1073741824
Apr 15 20:14:19 devstack sudo[90405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:19 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-032a6c3b-ed37-40e0-83e1-23f6d618eefc tempest-SnapshotDependencyTests-404514513 None] Create snapshot completed successfully
Apr 15 20:14:19 devstack sudo[90400]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:19 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-ba345841-ed1e-4c30-a806-d4910e1e38b1 tempest-CreateVolumesFromSnapshotTest-622878184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-96e5d05f-a5b8-4dc6-b3dd-5d5d47d34a5c" returned: 0 in 0.467s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:19 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-ba345841-ed1e-4c30-a806-d4910e1e38b1 tempest-CreateVolumesFromSnapshotTest-622878184 None] Lock "cinder-quobyte-96e5d05f-a5b8-4dc6-b3dd-5d5d47d34a5c" released by "delete_volume" :: held 1.015s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:14:19 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-ba345841-ed1e-4c30-a806-d4910e1e38b1 tempest-CreateVolumesFromSnapshotTest-622878184 None] Created reservations ['d425a379-7eac-4883-ae27-ca8710e4f830', '91841a8f-76ad-4a7c-921d-0a765f966931', '1a4ce33a-8796-4b98-aa2c-d6a4f49c7ac4', '1a4f381c-e23c-41ad-836c-9ff9edad4f83'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:14:19 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-ba345841-ed1e-4c30-a806-d4910e1e38b1 tempest-CreateVolumesFromSnapshotTest-622878184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:14:19 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-ba345841-ed1e-4c30-a806-d4910e1e38b1 tempest-CreateVolumesFromSnapshotTest-622878184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:14:19 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-ba345841-ed1e-4c30-a806-d4910e1e38b1 tempest-CreateVolumesFromSnapshotTest-622878184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:14:19 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-ba345841-ed1e-4c30-a806-d4910e1e38b1 tempest-CreateVolumesFromSnapshotTest-622878184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:14:19 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-ba345841-ed1e-4c30-a806-d4910e1e38b1 tempest-CreateVolumesFromSnapshotTest-622878184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:14:19 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-ba345841-ed1e-4c30-a806-d4910e1e38b1 tempest-CreateVolumesFromSnapshotTest-622878184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:19 devstack sudo[90408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:14:19 devstack sudo[90408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:19 devstack sudo[90403]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:19 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-9ecb261c-5ea1-4b28-9ae8-e14998b0dfe4 tempest-VolumeDependencyTests-2146631135 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148" returned: 0 in 0.549s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:19 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-9ecb261c-5ea1-4b28-9ae8-e14998b0dfe4 tempest-VolumeDependencyTests-2146631135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:19 devstack sudo[90416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148
Apr 15 20:14:19 devstack sudo[90416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:19 devstack sudo[90405]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:19 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-a06d5443-932b-4fd8-986b-eb75c39bc9c6 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d19f68ad-edc8-454f-ad7d-acde77a7b353 1073741824" returned: 0 in 0.512s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:19 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-a06d5443-932b-4fd8-986b-eb75c39bc9c6 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d19f68ad-edc8-454f-ad7d-acde77a7b353 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:19 devstack sudo[90418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d19f68ad-edc8-454f-ad7d-acde77a7b353
Apr 15 20:14:19 devstack sudo[90418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:19 devstack sudo[90408]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:19 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-ba345841-ed1e-4c30-a806-d4910e1e38b1 tempest-CreateVolumesFromSnapshotTest-622878184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.552s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:19 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-ba345841-ed1e-4c30-a806-d4910e1e38b1 tempest-CreateVolumesFromSnapshotTest-622878184 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:14:19 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-ba345841-ed1e-4c30-a806-d4910e1e38b1 tempest-CreateVolumesFromSnapshotTest-622878184 None] Deleted volume successfully.
Apr 15 20:14:19 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-ba345841-ed1e-4c30-a806-d4910e1e38b1 tempest-CreateVolumesFromSnapshotTest-622878184 None] Lock "cinder-96e5d05f-a5b8-4dc6-b3dd-5d5d47d34a5c-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:14:20 devstack sudo[90416]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-9ecb261c-5ea1-4b28-9ae8-e14998b0dfe4 tempest-VolumeDependencyTests-2146631135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-f32e8a08-8198-4a7d-9bb9-ae3d8792d148" returned: 0 in 0.486s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:20 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-9ecb261c-5ea1-4b28-9ae8-e14998b0dfe4 tempest-VolumeDependencyTests-2146631135 None] Lock "cinder-quobyte-f32e8a08-8198-4a7d-9bb9-ae3d8792d148" released by "delete_volume" :: held 1.074s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:14:20 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-9ecb261c-5ea1-4b28-9ae8-e14998b0dfe4 tempest-VolumeDependencyTests-2146631135 None] Created reservations ['90a8e2b7-5a41-4931-9cd2-6f3494e2fed0', '12168ec6-1615-4ea2-82a6-6a4d11e0e470', '54691958-2a55-4d1d-9960-af85b5e59216', 'e47bdc59-27e0-408d-b127-d13c9b131aba'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:14:20 devstack sudo[90418]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-a06d5443-932b-4fd8-986b-eb75c39bc9c6 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d19f68ad-edc8-454f-ad7d-acde77a7b353" returned: 0 in 0.493s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:20 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-a06d5443-932b-4fd8-986b-eb75c39bc9c6 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:14:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-a06d5443-932b-4fd8-986b-eb75c39bc9c6 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:14:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-410f6298-82ee-42e7-8859-64788b18d129 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.943s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:14:20 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-410f6298-82ee-42e7-8859-64788b18d129 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:14:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-52408987',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7bf4b1f-eb94-40ef-b8e4-a7e2c6020b32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a1f5ae17c2943ba885c848f93851600',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:17Z,use_quota=True,user_id='77b9c6fd5b904cac92d8b9fc762e1055',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:14:20 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-410f6298-82ee-42e7-8859-64788b18d129 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Creating volume a7bf4b1f-eb94-40ef-b8e4-a7e2c6020b32 {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:14:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-410f6298-82ee-42e7-8859-64788b18d129 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:14:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-410f6298-82ee-42e7-8859-64788b18d129 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:14:20 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-410f6298-82ee-42e7-8859-64788b18d129 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:14:20 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-410f6298-82ee-42e7-8859-64788b18d129 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:14:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-410f6298-82ee-42e7-8859-64788b18d129 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:14:20 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-410f6298-82ee-42e7-8859-64788b18d129 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:14:20 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-410f6298-82ee-42e7-8859-64788b18d129 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:14:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-410f6298-82ee-42e7-8859-64788b18d129 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7bf4b1f-eb94-40ef-b8e4-a7e2c6020b32 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-9ecb261c-5ea1-4b28-9ae8-e14998b0dfe4 tempest-VolumeDependencyTests-2146631135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:14:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-9ecb261c-5ea1-4b28-9ae8-e14998b0dfe4 tempest-VolumeDependencyTests-2146631135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:14:20 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-9ecb261c-5ea1-4b28-9ae8-e14998b0dfe4 tempest-VolumeDependencyTests-2146631135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:14:20 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-9ecb261c-5ea1-4b28-9ae8-e14998b0dfe4 tempest-VolumeDependencyTests-2146631135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:14:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-9ecb261c-5ea1-4b28-9ae8-e14998b0dfe4 tempest-VolumeDependencyTests-2146631135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:14:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-9ecb261c-5ea1-4b28-9ae8-e14998b0dfe4 tempest-VolumeDependencyTests-2146631135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:20 devstack sudo[90423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7bf4b1f-eb94-40ef-b8e4-a7e2c6020b32 1073741824
Apr 15 20:14:20 devstack sudo[90423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:20 devstack sudo[90425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:14:20 devstack sudo[90425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:20 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-a06d5443-932b-4fd8-986b-eb75c39bc9c6 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecb7d99c-048d-4502-a6e4-ba74ee552266) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d19f68ad-edc8-454f-ad7d-acde77a7b353', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:20 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-a06d5443-932b-4fd8-986b-eb75c39bc9c6 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e30b479f-a9f0-499b-bc74-d26a1115e866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:20 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-c639bbc3-b3fc-45bf-8c93-743ecd9cfe93 tempest-SnapshotDependencyTests-404514513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:14:20 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-a06d5443-932b-4fd8-986b-eb75c39bc9c6 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Volume volume-d19f68ad-edc8-454f-ad7d-acde77a7b353 (d19f68ad-edc8-454f-ad7d-acde77a7b353): created successfully
Apr 15 20:14:20 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-a06d5443-932b-4fd8-986b-eb75c39bc9c6 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e30b479f-a9f0-499b-bc74-d26a1115e866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:20 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-a06d5443-932b-4fd8-986b-eb75c39bc9c6 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Flow 'volume_create_manager' (bdca4b32-f173-4a43-aaff-3844ab365a00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:14:20 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-c639bbc3-b3fc-45bf-8c93-743ecd9cfe93 tempest-SnapshotDependencyTests-404514513 None] Flow 'volume_create_manager' (f06782ea-f061-4744-b705-cf84833fc00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:14:20 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-c639bbc3-b3fc-45bf-8c93-743ecd9cfe93 tempest-SnapshotDependencyTests-404514513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf3d9688-0ffe-4a85-b826-e470947fb88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:20 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-a06d5443-932b-4fd8-986b-eb75c39bc9c6 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Created volume successfully.
Apr 15 20:14:20 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-c639bbc3-b3fc-45bf-8c93-743ecd9cfe93 tempest-SnapshotDependencyTests-404514513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf3d9688-0ffe-4a85-b826-e470947fb88a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:14:20Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9938e16c-504f-423c-b615-911808c2dcc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e50c266d15c448cba19d340f7c30a1f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9abc9611-096b-4035-bc06-a5bd81331506,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:20Z,use_quota=True,user_id='36cff39c229f48eda5e4688d8e1216e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:20 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-c639bbc3-b3fc-45bf-8c93-743ecd9cfe93 tempest-SnapshotDependencyTests-404514513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21a0a428-08b3-4ac4-afe4-858f1db42684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:20 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-c639bbc3-b3fc-45bf-8c93-743ecd9cfe93 tempest-SnapshotDependencyTests-404514513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21a0a428-08b3-4ac4-afe4-858f1db42684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:20 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-c639bbc3-b3fc-45bf-8c93-743ecd9cfe93 tempest-SnapshotDependencyTests-404514513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a4889c0-2b26-4b93-8f9e-ce4caa589494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:20 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-c639bbc3-b3fc-45bf-8c93-743ecd9cfe93 tempest-SnapshotDependencyTests-404514513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a4889c0-2b26-4b93-8f9e-ce4caa589494) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9938e16c-504f-423c-b615-911808c2dcc5', 'volume_name': 'volume-9938e16c-504f-423c-b615-911808c2dcc5', 'volume_size': 1, 'snapshot_id': '9abc9611-096b-4035-bc06-a5bd81331506'}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:20 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-c639bbc3-b3fc-45bf-8c93-743ecd9cfe93 tempest-SnapshotDependencyTests-404514513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be8618fa-e8cb-41e1-8237-077e9a12daee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:20 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-c639bbc3-b3fc-45bf-8c93-743ecd9cfe93 tempest-SnapshotDependencyTests-404514513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be8618fa-e8cb-41e1-8237-077e9a12daee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:20 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-c639bbc3-b3fc-45bf-8c93-743ecd9cfe93 tempest-SnapshotDependencyTests-404514513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ae289cf-0a0f-436d-861d-23a51a8e0a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:20 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-c639bbc3-b3fc-45bf-8c93-743ecd9cfe93 tempest-SnapshotDependencyTests-404514513 None] Volume 9938e16c-504f-423c-b615-911808c2dcc5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9938e16c-504f-423c-b615-911808c2dcc5', 'volume_size': 1, 'snapshot_id': '9abc9611-096b-4035-bc06-a5bd81331506'}
Apr 15 20:14:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-c639bbc3-b3fc-45bf-8c93-743ecd9cfe93 tempest-SnapshotDependencyTests-404514513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:14:20 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-5216454c-56d8-4f81-94bd-f7a4f8a00d4c tempest-CreateVolumesFromSnapshotTest-622878184 None] Acquiring lock "cinder-76302e0a-bcb5-4d9d-b854-4c87e8c3e78b-delete_snapshot" by "delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:14:20 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-5216454c-56d8-4f81-94bd-f7a4f8a00d4c tempest-CreateVolumesFromSnapshotTest-622878184 None] Lock "cinder-76302e0a-bcb5-4d9d-b854-4c87e8c3e78b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:14:20 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-5216454c-56d8-4f81-94bd-f7a4f8a00d4c tempest-CreateVolumesFromSnapshotTest-622878184 None] Acquiring lock "cinder-quobyte-92c99b8f-2c94-4461-8171-4f079b482500" by "delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:14:20 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-5216454c-56d8-4f81-94bd-f7a4f8a00d4c tempest-CreateVolumesFromSnapshotTest-622878184 None] Lock "cinder-quobyte-92c99b8f-2c94-4461-8171-4f079b482500" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:14:20 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-5216454c-56d8-4f81-94bd-f7a4f8a00d4c tempest-CreateVolumesFromSnapshotTest-622878184 None] Acquiring lock "cinder-quobyte-76302e0a-bcb5-4d9d-b854-4c87e8c3e78b" by "_delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:14:20 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-5216454c-56d8-4f81-94bd-f7a4f8a00d4c tempest-CreateVolumesFromSnapshotTest-622878184 None] Lock "cinder-quobyte-76302e0a-bcb5-4d9d-b854-4c87e8c3e78b" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:14:20 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-5216454c-56d8-4f81-94bd-f7a4f8a00d4c tempest-CreateVolumesFromSnapshotTest-622878184 None] Deleting offline snapshot 76302e0a-bcb5-4d9d-b854-4c87e8c3e78b of volume 92c99b8f-2c94-4461-8171-4f079b482500 {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 20:14:20 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-5216454c-56d8-4f81-94bd-f7a4f8a00d4c tempest-CreateVolumesFromSnapshotTest-622878184 None] snapshot_file for this snap is: volume-92c99b8f-2c94-4461-8171-4f079b482500.76302e0a-bcb5-4d9d-b854-4c87e8c3e78b {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 20:14:20 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d70d32-189f-455c-8bc9-0e7df50ff6db]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:14:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5216454c-56d8-4f81-94bd-f7a4f8a00d4c tempest-CreateVolumesFromSnapshotTest-622878184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-92c99b8f-2c94-4461-8171-4f079b482500.76302e0a-bcb5-4d9d-b854-4c87e8c3e78b {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:20 devstack sudo[90427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-92c99b8f-2c94-4461-8171-4f079b482500.76302e0a-bcb5-4d9d-b854-4c87e8c3e78b
Apr 15 20:14:20 devstack sudo[90427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:20 devstack sudo[90425]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-9ecb261c-5ea1-4b28-9ae8-e14998b0dfe4 tempest-VolumeDependencyTests-2146631135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.491s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:20 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-9ecb261c-5ea1-4b28-9ae8-e14998b0dfe4 tempest-VolumeDependencyTests-2146631135 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:14:20 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-9ecb261c-5ea1-4b28-9ae8-e14998b0dfe4 tempest-VolumeDependencyTests-2146631135 None] Deleted volume successfully.
Apr 15 20:14:20 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-9ecb261c-5ea1-4b28-9ae8-e14998b0dfe4 tempest-VolumeDependencyTests-2146631135 None] Lock "cinder-f32e8a08-8198-4a7d-9bb9-ae3d8792d148-delete_volume" released by "delete_volume" :: held 1.770s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:14:20 devstack sudo[90423]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-410f6298-82ee-42e7-8859-64788b18d129 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7bf4b1f-eb94-40ef-b8e4-a7e2c6020b32 1073741824" returned: 0 in 0.543s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:20 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-410f6298-82ee-42e7-8859-64788b18d129 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7bf4b1f-eb94-40ef-b8e4-a7e2c6020b32 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:20 devstack sudo[90433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7bf4b1f-eb94-40ef-b8e4-a7e2c6020b32
Apr 15 20:14:20 devstack sudo[90433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:21 devstack sudo[90427]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5216454c-56d8-4f81-94bd-f7a4f8a00d4c tempest-CreateVolumesFromSnapshotTest-622878184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-92c99b8f-2c94-4461-8171-4f079b482500.76302e0a-bcb5-4d9d-b854-4c87e8c3e78b" returned: 0 in 0.568s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:21 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-5216454c-56d8-4f81-94bd-f7a4f8a00d4c tempest-CreateVolumesFromSnapshotTest-622878184 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92c99b8f-2c94-4461-8171-4f079b482500(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82646) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 20:14:21 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42ec5fb-3e1a-439e-86c2-3f47b1ef8e1d]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:14:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5216454c-56d8-4f81-94bd-f7a4f8a00d4c tempest-CreateVolumesFromSnapshotTest-622878184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-92c99b8f-2c94-4461-8171-4f079b482500 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:21 devstack sudo[90438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-92c99b8f-2c94-4461-8171-4f079b482500
Apr 15 20:14:21 devstack sudo[90438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:21 devstack sudo[90433]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-410f6298-82ee-42e7-8859-64788b18d129 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7bf4b1f-eb94-40ef-b8e4-a7e2c6020b32" returned: 0 in 0.515s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:21 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-410f6298-82ee-42e7-8859-64788b18d129 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:14:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-410f6298-82ee-42e7-8859-64788b18d129 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:14:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-070ab9f9-390d-4907-98b9-cc600f3ffac8 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.722s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:14:21 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-070ab9f9-390d-4907-98b9-cc600f3ffac8 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:14:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-713293822',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b11b64a-2bda-4405-ac94-66765e8c33b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a1f5ae17c2943ba885c848f93851600',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:17Z,use_quota=True,user_id='77b9c6fd5b904cac92d8b9fc762e1055',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:14:21 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-070ab9f9-390d-4907-98b9-cc600f3ffac8 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Creating volume 9b11b64a-2bda-4405-ac94-66765e8c33b6 {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:14:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-070ab9f9-390d-4907-98b9-cc600f3ffac8 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:14:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-070ab9f9-390d-4907-98b9-cc600f3ffac8 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:14:21 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-070ab9f9-390d-4907-98b9-cc600f3ffac8 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:14:21 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-070ab9f9-390d-4907-98b9-cc600f3ffac8 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:14:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-070ab9f9-390d-4907-98b9-cc600f3ffac8 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:14:21 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-070ab9f9-390d-4907-98b9-cc600f3ffac8 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:14:21 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-070ab9f9-390d-4907-98b9-cc600f3ffac8 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:14:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-070ab9f9-390d-4907-98b9-cc600f3ffac8 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9b11b64a-2bda-4405-ac94-66765e8c33b6 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:21 devstack sudo[90441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9b11b64a-2bda-4405-ac94-66765e8c33b6 1073741824
Apr 15 20:14:21 devstack sudo[90441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:21 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-410f6298-82ee-42e7-8859-64788b18d129 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f459585b-cfd5-4fd6-96fd-c7a0c59b2b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7bf4b1f-eb94-40ef-b8e4-a7e2c6020b32', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:21 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-410f6298-82ee-42e7-8859-64788b18d129 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d1edc46-d78e-4b34-8a6c-73abd855fc4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:21 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-410f6298-82ee-42e7-8859-64788b18d129 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Volume volume-a7bf4b1f-eb94-40ef-b8e4-a7e2c6020b32 (a7bf4b1f-eb94-40ef-b8e4-a7e2c6020b32): created successfully
Apr 15 20:14:21 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-410f6298-82ee-42e7-8859-64788b18d129 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d1edc46-d78e-4b34-8a6c-73abd855fc4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:21 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-410f6298-82ee-42e7-8859-64788b18d129 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Flow 'volume_create_manager' (7b54a83f-ccb9-4f85-8e7f-82dbb5c1cbcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:14:21 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-410f6298-82ee-42e7-8859-64788b18d129 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Created volume successfully.
Apr 15 20:14:21 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-f683bc59-f08b-4eb1-bf75-eb3ecaa0ad84 tempest-VolumeDependencyTests-2146631135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:14:21 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f683bc59-f08b-4eb1-bf75-eb3ecaa0ad84 tempest-VolumeDependencyTests-2146631135 None] Flow 'volume_create_manager' (e0b0ed90-06d2-4c87-916d-9c799f8cd52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:14:21 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f683bc59-f08b-4eb1-bf75-eb3ecaa0ad84 tempest-VolumeDependencyTests-2146631135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdd12fd7-1d58-420f-9863-c9b8f243b808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:21 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f683bc59-f08b-4eb1-bf75-eb3ecaa0ad84 tempest-VolumeDependencyTests-2146631135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdd12fd7-1d58-420f-9863-c9b8f243b808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1637758844',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46ce7964-295a-4e62-b8a1-5a21405f7ab9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8beda731ffc94345980fbb9fadc77736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:21Z,use_quota=True,user_id='febc3aa7e59e46e29f55adac7b15c620',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:21 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f683bc59-f08b-4eb1-bf75-eb3ecaa0ad84 tempest-VolumeDependencyTests-2146631135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9276131b-91a6-40ad-909b-090fbc1ce455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:21 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f683bc59-f08b-4eb1-bf75-eb3ecaa0ad84 tempest-VolumeDependencyTests-2146631135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9276131b-91a6-40ad-909b-090fbc1ce455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:21 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f683bc59-f08b-4eb1-bf75-eb3ecaa0ad84 tempest-VolumeDependencyTests-2146631135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96ed2e2d-6920-4026-8149-017d9a817a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:21 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f683bc59-f08b-4eb1-bf75-eb3ecaa0ad84 tempest-VolumeDependencyTests-2146631135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96ed2e2d-6920-4026-8149-017d9a817a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46ce7964-295a-4e62-b8a1-5a21405f7ab9', 'volume_name': 'volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:21 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f683bc59-f08b-4eb1-bf75-eb3ecaa0ad84 tempest-VolumeDependencyTests-2146631135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc456164-9fa3-40c2-bb06-4f5cb709f4ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:21 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f683bc59-f08b-4eb1-bf75-eb3ecaa0ad84 tempest-VolumeDependencyTests-2146631135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc456164-9fa3-40c2-bb06-4f5cb709f4ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:21 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f683bc59-f08b-4eb1-bf75-eb3ecaa0ad84 tempest-VolumeDependencyTests-2146631135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7e20ec0-08c6-498c-b1d6-de6de239e29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:21 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-f683bc59-f08b-4eb1-bf75-eb3ecaa0ad84 tempest-VolumeDependencyTests-2146631135 None] Volume 46ce7964-295a-4e62-b8a1-5a21405f7ab9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9', 'volume_size': 1}
Apr 15 20:14:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-f683bc59-f08b-4eb1-bf75-eb3ecaa0ad84 tempest-VolumeDependencyTests-2146631135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:14:21 devstack sudo[90438]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5216454c-56d8-4f81-94bd-f7a4f8a00d4c tempest-CreateVolumesFromSnapshotTest-622878184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-92c99b8f-2c94-4461-8171-4f079b482500" returned: 0 in 0.617s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5216454c-56d8-4f81-94bd-f7a4f8a00d4c tempest-CreateVolumesFromSnapshotTest-622878184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-92c99b8f-2c94-4461-8171-4f079b482500.76302e0a-bcb5-4d9d-b854-4c87e8c3e78b {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:21 devstack sudo[90448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-92c99b8f-2c94-4461-8171-4f079b482500.76302e0a-bcb5-4d9d-b854-4c87e8c3e78b
Apr 15 20:14:21 devstack sudo[90448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:21 devstack sudo[90441]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-070ab9f9-390d-4907-98b9-cc600f3ffac8 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9b11b64a-2bda-4405-ac94-66765e8c33b6 1073741824" returned: 0 in 0.524s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:21 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-070ab9f9-390d-4907-98b9-cc600f3ffac8 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9b11b64a-2bda-4405-ac94-66765e8c33b6 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:21 devstack sudo[90451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9b11b64a-2bda-4405-ac94-66765e8c33b6
Apr 15 20:14:21 devstack sudo[90451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:22 devstack sudo[90448]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5216454c-56d8-4f81-94bd-f7a4f8a00d4c tempest-CreateVolumesFromSnapshotTest-622878184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-92c99b8f-2c94-4461-8171-4f079b482500.76302e0a-bcb5-4d9d-b854-4c87e8c3e78b" returned: 0 in 0.475s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5216454c-56d8-4f81-94bd-f7a4f8a00d4c tempest-CreateVolumesFromSnapshotTest-622878184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-92c99b8f-2c94-4461-8171-4f079b482500.76302e0a-bcb5-4d9d-b854-4c87e8c3e78b {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:22 devstack sudo[90456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-92c99b8f-2c94-4461-8171-4f079b482500.76302e0a-bcb5-4d9d-b854-4c87e8c3e78b
Apr 15 20:14:22 devstack sudo[90456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:22 devstack sudo[90451]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-070ab9f9-390d-4907-98b9-cc600f3ffac8 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9b11b64a-2bda-4405-ac94-66765e8c33b6" returned: 0 in 0.444s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:22 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-070ab9f9-390d-4907-98b9-cc600f3ffac8 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:14:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-070ab9f9-390d-4907-98b9-cc600f3ffac8 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:14:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-24159c3a-15a2-41ab-a0b6-2029e9c04612 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.396s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:14:22 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-24159c3a-15a2-41ab-a0b6-2029e9c04612 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-746457494',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85b0ec8e-c9d2-4dfb-9909-2d71d036dbe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a1f5ae17c2943ba885c848f93851600',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:18Z,use_quota=True,user_id='77b9c6fd5b904cac92d8b9fc762e1055',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:14:22 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-24159c3a-15a2-41ab-a0b6-2029e9c04612 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Creating volume 85b0ec8e-c9d2-4dfb-9909-2d71d036dbe3 {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:14:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-24159c3a-15a2-41ab-a0b6-2029e9c04612 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:14:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-24159c3a-15a2-41ab-a0b6-2029e9c04612 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:14:22 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-24159c3a-15a2-41ab-a0b6-2029e9c04612 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:14:22 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-24159c3a-15a2-41ab-a0b6-2029e9c04612 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:14:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-24159c3a-15a2-41ab-a0b6-2029e9c04612 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:14:22 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-24159c3a-15a2-41ab-a0b6-2029e9c04612 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:14:22 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-24159c3a-15a2-41ab-a0b6-2029e9c04612 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:14:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-24159c3a-15a2-41ab-a0b6-2029e9c04612 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-85b0ec8e-c9d2-4dfb-9909-2d71d036dbe3 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:22 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-070ab9f9-390d-4907-98b9-cc600f3ffac8 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (984a1c00-4032-4932-9c37-0ca6d7c65a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b11b64a-2bda-4405-ac94-66765e8c33b6', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:22 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-070ab9f9-390d-4907-98b9-cc600f3ffac8 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e002c2aa-2d97-40ea-8d13-b1adb5d532ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:22 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-070ab9f9-390d-4907-98b9-cc600f3ffac8 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Volume volume-9b11b64a-2bda-4405-ac94-66765e8c33b6 (9b11b64a-2bda-4405-ac94-66765e8c33b6): created successfully
Apr 15 20:14:22 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-070ab9f9-390d-4907-98b9-cc600f3ffac8 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e002c2aa-2d97-40ea-8d13-b1adb5d532ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:22 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-070ab9f9-390d-4907-98b9-cc600f3ffac8 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Flow 'volume_create_manager' (3bc3164d-7d2d-4b54-9ba3-19920a493dfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:14:22 devstack sudo[90459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-85b0ec8e-c9d2-4dfb-9909-2d71d036dbe3 1073741824
Apr 15 20:14:22 devstack sudo[90459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:22 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-070ab9f9-390d-4907-98b9-cc600f3ffac8 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Created volume successfully.
Apr 15 20:14:22 devstack sudo[90456]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5216454c-56d8-4f81-94bd-f7a4f8a00d4c tempest-CreateVolumesFromSnapshotTest-622878184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-92c99b8f-2c94-4461-8171-4f079b482500.76302e0a-bcb5-4d9d-b854-4c87e8c3e78b" returned: 0 in 0.481s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:22 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-5216454c-56d8-4f81-94bd-f7a4f8a00d4c tempest-CreateVolumesFromSnapshotTest-622878184 None] Lock "cinder-quobyte-76302e0a-bcb5-4d9d-b854-4c87e8c3e78b" released by "_delete_snapshot" :: held 2.200s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:14:22 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-5216454c-56d8-4f81-94bd-f7a4f8a00d4c tempest-CreateVolumesFromSnapshotTest-622878184 None] Lock "cinder-quobyte-92c99b8f-2c94-4461-8171-4f079b482500" released by "delete_snapshot" :: held 2.213s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:14:22 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-5216454c-56d8-4f81-94bd-f7a4f8a00d4c tempest-CreateVolumesFromSnapshotTest-622878184 None] Created reservations ['6e8d6143-90e5-45f3-b077-e9e1f73d4a98', 'c85cb444-9cee-4dbd-954f-6b9384fae9c5', '08499238-f694-4f3d-be6c-801fcb40b434', '2ac28045-2b0d-44e7-8487-7da68359039b'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:14:22 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-5216454c-56d8-4f81-94bd-f7a4f8a00d4c tempest-CreateVolumesFromSnapshotTest-622878184 None] Delete snapshot completed successfully.
Apr 15 20:14:22 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-5216454c-56d8-4f81-94bd-f7a4f8a00d4c tempest-CreateVolumesFromSnapshotTest-622878184 None] Lock "cinder-76302e0a-bcb5-4d9d-b854-4c87e8c3e78b-delete_snapshot" released by "delete_snapshot" :: held 2.305s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:14:22 devstack sudo[90459]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-24159c3a-15a2-41ab-a0b6-2029e9c04612 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-85b0ec8e-c9d2-4dfb-9909-2d71d036dbe3 1073741824" returned: 0 in 0.581s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:22 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-24159c3a-15a2-41ab-a0b6-2029e9c04612 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-85b0ec8e-c9d2-4dfb-9909-2d71d036dbe3 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:22 devstack sudo[90465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-85b0ec8e-c9d2-4dfb-9909-2d71d036dbe3
Apr 15 20:14:22 devstack sudo[90465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:23 devstack sudo[90465]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:23 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-24159c3a-15a2-41ab-a0b6-2029e9c04612 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-85b0ec8e-c9d2-4dfb-9909-2d71d036dbe3" returned: 0 in 0.408s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:23 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-24159c3a-15a2-41ab-a0b6-2029e9c04612 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:14:23 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-24159c3a-15a2-41ab-a0b6-2029e9c04612 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:14:23 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-b3555a26-485d-49d8-a41e-e5c14dcd159e tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.272s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:14:23 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-b3555a26-485d-49d8-a41e-e5c14dcd159e tempest-CreateVolumesFromSourceVolumeTest-430838871 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1591393407',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9140effe-99b2-453f-b875-0a57e7aee56c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a1f5ae17c2943ba885c848f93851600',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:18Z,use_quota=True,user_id='77b9c6fd5b904cac92d8b9fc762e1055',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:14:23 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-b3555a26-485d-49d8-a41e-e5c14dcd159e tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Creating volume 9140effe-99b2-453f-b875-0a57e7aee56c {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:14:23 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-b3555a26-485d-49d8-a41e-e5c14dcd159e tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:14:23 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-b3555a26-485d-49d8-a41e-e5c14dcd159e tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:14:23 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-b3555a26-485d-49d8-a41e-e5c14dcd159e tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:14:23 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-b3555a26-485d-49d8-a41e-e5c14dcd159e tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:14:23 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-b3555a26-485d-49d8-a41e-e5c14dcd159e tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:14:23 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-b3555a26-485d-49d8-a41e-e5c14dcd159e tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:14:23 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-b3555a26-485d-49d8-a41e-e5c14dcd159e tempest-CreateVolumesFromSourceVolumeTest-430838871 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:14:23 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b3555a26-485d-49d8-a41e-e5c14dcd159e tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9140effe-99b2-453f-b875-0a57e7aee56c 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:23 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-24159c3a-15a2-41ab-a0b6-2029e9c04612 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea618d02-3ca2-4499-ae3b-8fa56edfefe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85b0ec8e-c9d2-4dfb-9909-2d71d036dbe3', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:23 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-24159c3a-15a2-41ab-a0b6-2029e9c04612 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c8c65ac-ee27-43d4-8638-5f89c71fa11f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:23 devstack sudo[90468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9140effe-99b2-453f-b875-0a57e7aee56c 1073741824
Apr 15 20:14:23 devstack sudo[90468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:23 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-24159c3a-15a2-41ab-a0b6-2029e9c04612 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Volume volume-85b0ec8e-c9d2-4dfb-9909-2d71d036dbe3 (85b0ec8e-c9d2-4dfb-9909-2d71d036dbe3): created successfully
Apr 15 20:14:23 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-24159c3a-15a2-41ab-a0b6-2029e9c04612 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c8c65ac-ee27-43d4-8638-5f89c71fa11f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:23 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-24159c3a-15a2-41ab-a0b6-2029e9c04612 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Flow 'volume_create_manager' (6d648f8b-d316-4106-93ae-b365275f492e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:14:23 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-24159c3a-15a2-41ab-a0b6-2029e9c04612 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Created volume successfully.
Apr 15 20:14:23 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-e7ebe991-f231-4366-b73c-c22aef964768 tempest-CreateVolumesFromSnapshotTest-622878184 None] Acquiring lock "cinder-92c99b8f-2c94-4461-8171-4f079b482500-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:14:23 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-e7ebe991-f231-4366-b73c-c22aef964768 tempest-CreateVolumesFromSnapshotTest-622878184 None] Lock "cinder-92c99b8f-2c94-4461-8171-4f079b482500-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:14:23 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-e7ebe991-f231-4366-b73c-c22aef964768 tempest-CreateVolumesFromSnapshotTest-622878184 None] Acquiring lock "cinder-quobyte-92c99b8f-2c94-4461-8171-4f079b482500" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:14:23 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-e7ebe991-f231-4366-b73c-c22aef964768 tempest-CreateVolumesFromSnapshotTest-622878184 None] Lock "cinder-quobyte-92c99b8f-2c94-4461-8171-4f079b482500" acquired by "delete_volume" :: waited 0.020s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:14:23 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[277071dd-3d87-4be7-b833-e7e0981f4818]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:14:23 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e7ebe991-f231-4366-b73c-c22aef964768 tempest-CreateVolumesFromSnapshotTest-622878184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-92c99b8f-2c94-4461-8171-4f079b482500 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:23 devstack sudo[90470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-92c99b8f-2c94-4461-8171-4f079b482500
Apr 15 20:14:23 devstack sudo[90470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:23 devstack sudo[90468]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:23 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b3555a26-485d-49d8-a41e-e5c14dcd159e tempest-CreateVolumesFromSourceVolumeTest-430838871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9140effe-99b2-453f-b875-0a57e7aee56c 1073741824" returned: 0 in 0.525s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:23 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b3555a26-485d-49d8-a41e-e5c14dcd159e tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9140effe-99b2-453f-b875-0a57e7aee56c {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:23 devstack sudo[90475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9140effe-99b2-453f-b875-0a57e7aee56c
Apr 15 20:14:23 devstack sudo[90475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:24 devstack sudo[90470]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e7ebe991-f231-4366-b73c-c22aef964768 tempest-CreateVolumesFromSnapshotTest-622878184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-92c99b8f-2c94-4461-8171-4f079b482500" returned: 0 in 0.476s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e7ebe991-f231-4366-b73c-c22aef964768 tempest-CreateVolumesFromSnapshotTest-622878184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-92c99b8f-2c94-4461-8171-4f079b482500 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:24 devstack sudo[90480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-92c99b8f-2c94-4461-8171-4f079b482500
Apr 15 20:14:24 devstack sudo[90480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:24 devstack sudo[90475]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-b3555a26-485d-49d8-a41e-e5c14dcd159e tempest-CreateVolumesFromSourceVolumeTest-430838871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9140effe-99b2-453f-b875-0a57e7aee56c" returned: 0 in 0.432s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:24 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-b3555a26-485d-49d8-a41e-e5c14dcd159e tempest-CreateVolumesFromSourceVolumeTest-430838871 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:14:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-b3555a26-485d-49d8-a41e-e5c14dcd159e tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:14:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-c639bbc3-b3fc-45bf-8c93-743ecd9cfe93 tempest-SnapshotDependencyTests-404514513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.938s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:14:24 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-c639bbc3-b3fc-45bf-8c93-743ecd9cfe93 tempest-SnapshotDependencyTests-404514513 None] Acquiring lock "cinder-quobyte-9abc9611-096b-4035-bc06-a5bd81331506-9938e16c-504f-423c-b615-911808c2dcc5" by "_create_volume_from_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:14:24 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b3555a26-485d-49d8-a41e-e5c14dcd159e tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14c1a7b5-bc73-451c-9367-05606d28e8fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9140effe-99b2-453f-b875-0a57e7aee56c', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:24 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b3555a26-485d-49d8-a41e-e5c14dcd159e tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6958ffcc-1ac0-4eb2-95fe-077f5b05fd25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:24 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-c639bbc3-b3fc-45bf-8c93-743ecd9cfe93 tempest-SnapshotDependencyTests-404514513 None] Lock "cinder-quobyte-9abc9611-096b-4035-bc06-a5bd81331506-9938e16c-504f-423c-b615-911808c2dcc5" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:14:24 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-c639bbc3-b3fc-45bf-8c93-743ecd9cfe93 tempest-SnapshotDependencyTests-404514513 None] Creating volume 9938e16c-504f-423c-b615-911808c2dcc5 from snapshot 9abc9611-096b-4035-bc06-a5bd81331506 {{(pid=82646) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 15 20:14:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-c639bbc3-b3fc-45bf-8c93-743ecd9cfe93 tempest-SnapshotDependencyTests-404514513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:14:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-c639bbc3-b3fc-45bf-8c93-743ecd9cfe93 tempest-SnapshotDependencyTests-404514513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:14:24 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-c639bbc3-b3fc-45bf-8c93-743ecd9cfe93 tempest-SnapshotDependencyTests-404514513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:14:24 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-c639bbc3-b3fc-45bf-8c93-743ecd9cfe93 tempest-SnapshotDependencyTests-404514513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:14:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-c639bbc3-b3fc-45bf-8c93-743ecd9cfe93 tempest-SnapshotDependencyTests-404514513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:14:24 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-c639bbc3-b3fc-45bf-8c93-743ecd9cfe93 tempest-SnapshotDependencyTests-404514513 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:14:24 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-c639bbc3-b3fc-45bf-8c93-743ecd9cfe93 tempest-SnapshotDependencyTests-404514513 None] Acquiring lock "cinder-quobyte-9938e16c-504f-423c-b615-911808c2dcc5" by "_copy_volume_from_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:14:24 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-b3555a26-485d-49d8-a41e-e5c14dcd159e tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Volume volume-9140effe-99b2-453f-b875-0a57e7aee56c (9140effe-99b2-453f-b875-0a57e7aee56c): created successfully
Apr 15 20:14:24 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b3555a26-485d-49d8-a41e-e5c14dcd159e tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6958ffcc-1ac0-4eb2-95fe-077f5b05fd25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:24 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-b3555a26-485d-49d8-a41e-e5c14dcd159e tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Flow 'volume_create_manager' (6333df11-dfa2-44ad-9406-f239f529b61c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:14:24 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-b3555a26-485d-49d8-a41e-e5c14dcd159e tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Created volume successfully.
Apr 15 20:14:24 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-c639bbc3-b3fc-45bf-8c93-743ecd9cfe93 tempest-SnapshotDependencyTests-404514513 None] Lock "cinder-quobyte-9938e16c-504f-423c-b615-911808c2dcc5" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:14:24 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-c639bbc3-b3fc-45bf-8c93-743ecd9cfe93 tempest-SnapshotDependencyTests-404514513 None] snapshot: 9abc9611-096b-4035-bc06-a5bd81331506, volume: 9938e16c-504f-423c-b615-911808c2dcc5,  {{(pid=82646) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 15 20:14:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-c639bbc3-b3fc-45bf-8c93-743ecd9cfe93 tempest-SnapshotDependencyTests-404514513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:14:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-c639bbc3-b3fc-45bf-8c93-743ecd9cfe93 tempest-SnapshotDependencyTests-404514513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:14:24 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-c639bbc3-b3fc-45bf-8c93-743ecd9cfe93 tempest-SnapshotDependencyTests-404514513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:14:24 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-c639bbc3-b3fc-45bf-8c93-743ecd9cfe93 tempest-SnapshotDependencyTests-404514513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:14:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-c639bbc3-b3fc-45bf-8c93-743ecd9cfe93 tempest-SnapshotDependencyTests-404514513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:14:24 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b15874d-1395-4b55-8374-fb19d4c0e02f]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:14:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c639bbc3-b3fc-45bf-8c93-743ecd9cfe93 tempest-SnapshotDependencyTests-404514513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-444c2edb-5699-4c6f-97a3-57e19485ef02.9abc9611-096b-4035-bc06-a5bd81331506 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:24 devstack sudo[90483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-444c2edb-5699-4c6f-97a3-57e19485ef02.9abc9611-096b-4035-bc06-a5bd81331506
Apr 15 20:14:24 devstack sudo[90483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:24 devstack sudo[90480]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e7ebe991-f231-4366-b73c-c22aef964768 tempest-CreateVolumesFromSnapshotTest-622878184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-92c99b8f-2c94-4461-8171-4f079b482500" returned: 0 in 0.467s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:24 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-e7ebe991-f231-4366-b73c-c22aef964768 tempest-CreateVolumesFromSnapshotTest-622878184 None] Lock "cinder-quobyte-92c99b8f-2c94-4461-8171-4f079b482500" released by "delete_volume" :: held 0.975s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:14:24 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-475982c7-045c-4d4f-8b5a-e65efcb41590 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Acquiring lock "cinder-9140effe-99b2-453f-b875-0a57e7aee56c-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:14:24 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-e7ebe991-f231-4366-b73c-c22aef964768 tempest-CreateVolumesFromSnapshotTest-622878184 None] Created reservations ['e48f046c-0480-4c22-a3ce-97cc7675da93', 'd8e7cd6c-d849-4f7b-bf42-f2d2c2560b5a', '263cfecb-d386-49de-be2f-3f6aa9636874', '5842c7ad-7f93-410b-94fe-c05455be3a16'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:14:24 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-475982c7-045c-4d4f-8b5a-e65efcb41590 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Lock "cinder-9140effe-99b2-453f-b875-0a57e7aee56c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:14:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-e7ebe991-f231-4366-b73c-c22aef964768 tempest-CreateVolumesFromSnapshotTest-622878184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:14:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-e7ebe991-f231-4366-b73c-c22aef964768 tempest-CreateVolumesFromSnapshotTest-622878184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:14:24 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-e7ebe991-f231-4366-b73c-c22aef964768 tempest-CreateVolumesFromSnapshotTest-622878184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:14:24 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-e7ebe991-f231-4366-b73c-c22aef964768 tempest-CreateVolumesFromSnapshotTest-622878184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:14:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-e7ebe991-f231-4366-b73c-c22aef964768 tempest-CreateVolumesFromSnapshotTest-622878184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:14:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e7ebe991-f231-4366-b73c-c22aef964768 tempest-CreateVolumesFromSnapshotTest-622878184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:24 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-475982c7-045c-4d4f-8b5a-e65efcb41590 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Acquiring lock "cinder-quobyte-9140effe-99b2-453f-b875-0a57e7aee56c" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:14:24 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-475982c7-045c-4d4f-8b5a-e65efcb41590 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Lock "cinder-quobyte-9140effe-99b2-453f-b875-0a57e7aee56c" acquired by "delete_volume" :: waited 0.011s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:14:24 devstack sudo[90486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:14:24 devstack sudo[90486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:24 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec91256f-a767-490c-8d0a-c91fe76bf3db]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:14:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-475982c7-045c-4d4f-8b5a-e65efcb41590 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9140effe-99b2-453f-b875-0a57e7aee56c {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:24 devstack sudo[90488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9140effe-99b2-453f-b875-0a57e7aee56c
Apr 15 20:14:24 devstack sudo[90488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:24 devstack sudo[90483]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c639bbc3-b3fc-45bf-8c93-743ecd9cfe93 tempest-SnapshotDependencyTests-404514513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-444c2edb-5699-4c6f-97a3-57e19485ef02.9abc9611-096b-4035-bc06-a5bd81331506" returned: 0 in 0.514s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:24 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-c639bbc3-b3fc-45bf-8c93-743ecd9cfe93 tempest-SnapshotDependencyTests-404514513 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-444c2edb-5699-4c6f-97a3-57e19485ef02(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82646) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 20:14:24 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-c639bbc3-b3fc-45bf-8c93-743ecd9cfe93 tempest-SnapshotDependencyTests-404514513 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-444c2edb-5699-4c6f-97a3-57e19485ef02 {{(pid=82646) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 15 20:14:24 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-c639bbc3-b3fc-45bf-8c93-743ecd9cfe93 tempest-SnapshotDependencyTests-404514513 None] Creating direct copy from snapshot {{(pid=82646) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 15 20:14:24 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0d56ec-1e18-4de6-b6b9-0a2e923dc02f]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:14:24 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c639bbc3-b3fc-45bf-8c93-743ecd9cfe93 tempest-SnapshotDependencyTests-404514513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-444c2edb-5699-4c6f-97a3-57e19485ef02 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:25 devstack sudo[90493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-444c2edb-5699-4c6f-97a3-57e19485ef02
Apr 15 20:14:25 devstack sudo[90493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:25 devstack sudo[90486]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:25 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-e7ebe991-f231-4366-b73c-c22aef964768 tempest-CreateVolumesFromSnapshotTest-622878184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.461s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:25 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-e7ebe991-f231-4366-b73c-c22aef964768 tempest-CreateVolumesFromSnapshotTest-622878184 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:14:25 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-e7ebe991-f231-4366-b73c-c22aef964768 tempest-CreateVolumesFromSnapshotTest-622878184 None] Deleted volume successfully.
Apr 15 20:14:25 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-e7ebe991-f231-4366-b73c-c22aef964768 tempest-CreateVolumesFromSnapshotTest-622878184 None] Lock "cinder-92c99b8f-2c94-4461-8171-4f079b482500-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:14:25 devstack sudo[90488]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:25 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-475982c7-045c-4d4f-8b5a-e65efcb41590 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9140effe-99b2-453f-b875-0a57e7aee56c" returned: 0 in 0.485s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:25 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-475982c7-045c-4d4f-8b5a-e65efcb41590 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9140effe-99b2-453f-b875-0a57e7aee56c {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:25 devstack sudo[90499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9140effe-99b2-453f-b875-0a57e7aee56c
Apr 15 20:14:25 devstack sudo[90499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:25 devstack sudo[90493]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:25 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c639bbc3-b3fc-45bf-8c93-743ecd9cfe93 tempest-SnapshotDependencyTests-404514513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-444c2edb-5699-4c6f-97a3-57e19485ef02" returned: 0 in 0.548s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:25 devstack cinder-volume[82646]: DEBUG cinder.utils [None req-c639bbc3-b3fc-45bf-8c93-743ecd9cfe93 tempest-SnapshotDependencyTests-404514513 None] Path /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9938e16c-504f-423c-b615-911808c2dcc5 not found in is_blk_device check {{(pid=82646) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 15 20:14:25 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c639bbc3-b3fc-45bf-8c93-743ecd9cfe93 tempest-SnapshotDependencyTests-404514513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-444c2edb-5699-4c6f-97a3-57e19485ef02 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9938e16c-504f-423c-b615-911808c2dcc5 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:25 devstack sudo[90504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-444c2edb-5699-4c6f-97a3-57e19485ef02 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9938e16c-504f-423c-b615-911808c2dcc5
Apr 15 20:14:25 devstack sudo[90504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:25 devstack sudo[90499]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:25 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-475982c7-045c-4d4f-8b5a-e65efcb41590 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9140effe-99b2-453f-b875-0a57e7aee56c" returned: 0 in 0.497s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:25 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-475982c7-045c-4d4f-8b5a-e65efcb41590 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Lock "cinder-quobyte-9140effe-99b2-453f-b875-0a57e7aee56c" released by "delete_volume" :: held 1.008s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:14:25 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-475982c7-045c-4d4f-8b5a-e65efcb41590 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Created reservations ['1ee30328-024c-46e4-ba6f-55fe146d6763', '53b48e7a-3b9b-4b8d-9f71-b97c6672cb74', '3a25e620-7d36-458e-87aa-05c2d888dd1d', '6fb62216-eb7f-46c6-b444-37051af671e5'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:14:25 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-475982c7-045c-4d4f-8b5a-e65efcb41590 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:14:25 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-475982c7-045c-4d4f-8b5a-e65efcb41590 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:14:25 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-475982c7-045c-4d4f-8b5a-e65efcb41590 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:14:25 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-475982c7-045c-4d4f-8b5a-e65efcb41590 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:14:25 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-475982c7-045c-4d4f-8b5a-e65efcb41590 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:14:25 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-475982c7-045c-4d4f-8b5a-e65efcb41590 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:25 devstack sudo[90508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:14:25 devstack sudo[90508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:26 devstack sudo[90508]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:26 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-475982c7-045c-4d4f-8b5a-e65efcb41590 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.827s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:26 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-475982c7-045c-4d4f-8b5a-e65efcb41590 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:14:26 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-475982c7-045c-4d4f-8b5a-e65efcb41590 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Deleted volume successfully.
Apr 15 20:14:26 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-475982c7-045c-4d4f-8b5a-e65efcb41590 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Lock "cinder-9140effe-99b2-453f-b875-0a57e7aee56c-delete_volume" released by "delete_volume" :: held 2.056s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:14:27 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-dcffdf43-b38d-4deb-9cc4-544218b52601 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Acquiring lock "cinder-85b0ec8e-c9d2-4dfb-9909-2d71d036dbe3-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:14:27 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-dcffdf43-b38d-4deb-9cc4-544218b52601 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Lock "cinder-85b0ec8e-c9d2-4dfb-9909-2d71d036dbe3-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:14:27 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-dcffdf43-b38d-4deb-9cc4-544218b52601 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Acquiring lock "cinder-quobyte-85b0ec8e-c9d2-4dfb-9909-2d71d036dbe3" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:14:27 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-dcffdf43-b38d-4deb-9cc4-544218b52601 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Lock "cinder-quobyte-85b0ec8e-c9d2-4dfb-9909-2d71d036dbe3" acquired by "delete_volume" :: waited 0.024s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:14:27 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f19e30-4007-49d6-b1e9-a9e7a7ab7ff9]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:14:27 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-dcffdf43-b38d-4deb-9cc4-544218b52601 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-85b0ec8e-c9d2-4dfb-9909-2d71d036dbe3 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:27 devstack sudo[90521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-85b0ec8e-c9d2-4dfb-9909-2d71d036dbe3
Apr 15 20:14:27 devstack sudo[90521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:28 devstack sudo[90504]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:28 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c639bbc3-b3fc-45bf-8c93-743ecd9cfe93 tempest-SnapshotDependencyTests-404514513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-444c2edb-5699-4c6f-97a3-57e19485ef02 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9938e16c-504f-423c-b615-911808c2dcc5" returned: 0 in 2.572s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:28 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a33e52-013a-4c70-b7e1-bec6e5c1a350]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:14:28 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c639bbc3-b3fc-45bf-8c93-743ecd9cfe93 tempest-SnapshotDependencyTests-404514513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-444c2edb-5699-4c6f-97a3-57e19485ef02 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:28 devstack sudo[90523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-444c2edb-5699-4c6f-97a3-57e19485ef02
Apr 15 20:14:28 devstack sudo[90523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:28 devstack sudo[90521]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:28 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-dcffdf43-b38d-4deb-9cc4-544218b52601 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-85b0ec8e-c9d2-4dfb-9909-2d71d036dbe3" returned: 0 in 1.163s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:28 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-dcffdf43-b38d-4deb-9cc4-544218b52601 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-85b0ec8e-c9d2-4dfb-9909-2d71d036dbe3 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:28 devstack sudo[90528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-85b0ec8e-c9d2-4dfb-9909-2d71d036dbe3
Apr 15 20:14:28 devstack sudo[90528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:28 devstack sudo[90523]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:28 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c639bbc3-b3fc-45bf-8c93-743ecd9cfe93 tempest-SnapshotDependencyTests-404514513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-444c2edb-5699-4c6f-97a3-57e19485ef02" returned: 0 in 0.669s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:28 devstack cinder-volume[82646]: DEBUG cinder.image.image_utils [None req-c639bbc3-b3fc-45bf-8c93-743ecd9cfe93 tempest-SnapshotDependencyTests-404514513 None] Image conversion details: src /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-444c2edb-5699-4c6f-97a3-57e19485ef02, size 1024.00 MB, duration 2.57 sec, destination /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9938e16c-504f-423c-b615-911808c2dcc5 {{(pid=82646) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 20:14:28 devstack cinder-volume[82646]: INFO cinder.image.image_utils [None req-c639bbc3-b3fc-45bf-8c93-743ecd9cfe93 tempest-SnapshotDependencyTests-404514513 None] Converted 1024.00 MB image at 397.97 MB/s
Apr 15 20:14:28 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-c639bbc3-b3fc-45bf-8c93-743ecd9cfe93 tempest-SnapshotDependencyTests-404514513 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9938e16c-504f-423c-b615-911808c2dcc5 is being set with open permissions: ugo+rw
Apr 15 20:14:28 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c639bbc3-b3fc-45bf-8c93-743ecd9cfe93 tempest-SnapshotDependencyTests-404514513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9938e16c-504f-423c-b615-911808c2dcc5 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:28 devstack sudo[90534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9938e16c-504f-423c-b615-911808c2dcc5
Apr 15 20:14:28 devstack sudo[90534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:28 devstack sudo[90528]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:28 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-dcffdf43-b38d-4deb-9cc4-544218b52601 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-85b0ec8e-c9d2-4dfb-9909-2d71d036dbe3" returned: 0 in 0.509s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:28 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-dcffdf43-b38d-4deb-9cc4-544218b52601 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Lock "cinder-quobyte-85b0ec8e-c9d2-4dfb-9909-2d71d036dbe3" released by "delete_volume" :: held 1.721s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:14:28 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-dcffdf43-b38d-4deb-9cc4-544218b52601 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Created reservations ['a70d0cae-049e-4a1f-870d-a421e187e6cb', '7fc1c2b1-763e-4cda-8f21-f4f705728433', 'd2cece3f-3bb5-4814-a6af-7c1090eeb183', '7c08b5bb-b246-4620-b81b-097b9ea5334b'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:14:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-dcffdf43-b38d-4deb-9cc4-544218b52601 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:14:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-dcffdf43-b38d-4deb-9cc4-544218b52601 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:14:29 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-dcffdf43-b38d-4deb-9cc4-544218b52601 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:14:29 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-dcffdf43-b38d-4deb-9cc4-544218b52601 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:14:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-dcffdf43-b38d-4deb-9cc4-544218b52601 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:14:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-dcffdf43-b38d-4deb-9cc4-544218b52601 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:29 devstack sudo[90536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:14:29 devstack sudo[90536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:29 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb43efc6-a5fe-496e-89e3-f9bafd6119be tempest-CinderUnicodeTest-2085134074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:14:29 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-bb43efc6-a5fe-496e-89e3-f9bafd6119be tempest-CinderUnicodeTest-2085134074 None] Flow 'volume_create_manager' (5883b828-d810-465f-a79c-71e48c84db52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:14:29 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-bb43efc6-a5fe-496e-89e3-f9bafd6119be tempest-CinderUnicodeTest-2085134074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c404fac-18cb-4779-a42b-26ed9b35da69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:29 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-bb43efc6-a5fe-496e-89e3-f9bafd6119be tempest-CinderUnicodeTest-2085134074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c404fac-18cb-4779-a42b-26ed9b35da69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:14:29Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7b1b2f0-afc4-4e0a-8458-3fa7f941f951,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b53d9b55218543278a14cbe26834147d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:29Z,use_quota=True,user_id='b1cafaaf4286491cac8360733d3327ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:29 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-bb43efc6-a5fe-496e-89e3-f9bafd6119be tempest-CinderUnicodeTest-2085134074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d10d50d5-59b8-438a-8c60-7f6ba6dfb711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:29 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-bb43efc6-a5fe-496e-89e3-f9bafd6119be tempest-CinderUnicodeTest-2085134074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d10d50d5-59b8-438a-8c60-7f6ba6dfb711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:29 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-bb43efc6-a5fe-496e-89e3-f9bafd6119be tempest-CinderUnicodeTest-2085134074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d7bf578-6767-47b4-9f54-71944d0c70fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:29 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-bb43efc6-a5fe-496e-89e3-f9bafd6119be tempest-CinderUnicodeTest-2085134074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d7bf578-6767-47b4-9f54-71944d0c70fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7b1b2f0-afc4-4e0a-8458-3fa7f941f951', 'volume_name': 'volume-b7b1b2f0-afc4-4e0a-8458-3fa7f941f951', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:29 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-bb43efc6-a5fe-496e-89e3-f9bafd6119be tempest-CinderUnicodeTest-2085134074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (425e88a2-d568-4b2b-80ee-a180f70eb24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:29 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-bb43efc6-a5fe-496e-89e3-f9bafd6119be tempest-CinderUnicodeTest-2085134074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (425e88a2-d568-4b2b-80ee-a180f70eb24a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:29 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-bb43efc6-a5fe-496e-89e3-f9bafd6119be tempest-CinderUnicodeTest-2085134074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2260aff9-3011-4e54-b3de-49d055601bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:29 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-bb43efc6-a5fe-496e-89e3-f9bafd6119be tempest-CinderUnicodeTest-2085134074 None] Volume b7b1b2f0-afc4-4e0a-8458-3fa7f941f951: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7b1b2f0-afc4-4e0a-8458-3fa7f941f951', 'volume_size': 1}
Apr 15 20:14:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-bb43efc6-a5fe-496e-89e3-f9bafd6119be tempest-CinderUnicodeTest-2085134074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:14:29 devstack sudo[90534]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-c639bbc3-b3fc-45bf-8c93-743ecd9cfe93 tempest-SnapshotDependencyTests-404514513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9938e16c-504f-423c-b615-911808c2dcc5" returned: 0 in 0.525s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:29 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-c639bbc3-b3fc-45bf-8c93-743ecd9cfe93 tempest-SnapshotDependencyTests-404514513 None] Lock "cinder-quobyte-9938e16c-504f-423c-b615-911808c2dcc5" released by "_copy_volume_from_snapshot" :: held 4.896s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:14:29 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-c639bbc3-b3fc-45bf-8c93-743ecd9cfe93 tempest-SnapshotDependencyTests-404514513 None] Lock "cinder-quobyte-9abc9611-096b-4035-bc06-a5bd81331506-9938e16c-504f-423c-b615-911808c2dcc5" released by "_create_volume_from_snapshot" :: held 4.937s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:14:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-c639bbc3-b3fc-45bf-8c93-743ecd9cfe93 tempest-SnapshotDependencyTests-404514513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.965s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:14:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-f683bc59-f08b-4eb1-bf75-eb3ecaa0ad84 tempest-VolumeDependencyTests-2146631135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.803s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:14:29 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-f683bc59-f08b-4eb1-bf75-eb3ecaa0ad84 tempest-VolumeDependencyTests-2146631135 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1637758844',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46ce7964-295a-4e62-b8a1-5a21405f7ab9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8beda731ffc94345980fbb9fadc77736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:21Z,use_quota=True,user_id='febc3aa7e59e46e29f55adac7b15c620',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:14:29 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-f683bc59-f08b-4eb1-bf75-eb3ecaa0ad84 tempest-VolumeDependencyTests-2146631135 None] Creating volume 46ce7964-295a-4e62-b8a1-5a21405f7ab9 {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:14:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-f683bc59-f08b-4eb1-bf75-eb3ecaa0ad84 tempest-VolumeDependencyTests-2146631135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:14:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-f683bc59-f08b-4eb1-bf75-eb3ecaa0ad84 tempest-VolumeDependencyTests-2146631135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:14:29 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-f683bc59-f08b-4eb1-bf75-eb3ecaa0ad84 tempest-VolumeDependencyTests-2146631135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:14:29 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-f683bc59-f08b-4eb1-bf75-eb3ecaa0ad84 tempest-VolumeDependencyTests-2146631135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:14:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-f683bc59-f08b-4eb1-bf75-eb3ecaa0ad84 tempest-VolumeDependencyTests-2146631135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:14:29 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-f683bc59-f08b-4eb1-bf75-eb3ecaa0ad84 tempest-VolumeDependencyTests-2146631135 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:14:29 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-f683bc59-f08b-4eb1-bf75-eb3ecaa0ad84 tempest-VolumeDependencyTests-2146631135 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:14:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-f683bc59-f08b-4eb1-bf75-eb3ecaa0ad84 tempest-VolumeDependencyTests-2146631135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:29 devstack sudo[90539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9 1073741824
Apr 15 20:14:29 devstack sudo[90539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:29 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-87702288-e37b-4710-a45b-b95b02c91b39 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Acquiring lock "cinder-9b11b64a-2bda-4405-ac94-66765e8c33b6-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:14:29 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-c639bbc3-b3fc-45bf-8c93-743ecd9cfe93 tempest-SnapshotDependencyTests-404514513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ae289cf-0a0f-436d-861d-23a51a8e0a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9938e16c-504f-423c-b615-911808c2dcc5', 'volume_size': 1, 'snapshot_id': '9abc9611-096b-4035-bc06-a5bd81331506'}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:29 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-c639bbc3-b3fc-45bf-8c93-743ecd9cfe93 tempest-SnapshotDependencyTests-404514513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8e966bd-340a-4575-b23a-efac5cbde33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:29 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-c639bbc3-b3fc-45bf-8c93-743ecd9cfe93 tempest-SnapshotDependencyTests-404514513 None] Volume volume-9938e16c-504f-423c-b615-911808c2dcc5 (9938e16c-504f-423c-b615-911808c2dcc5): created successfully
Apr 15 20:14:29 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-c639bbc3-b3fc-45bf-8c93-743ecd9cfe93 tempest-SnapshotDependencyTests-404514513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8e966bd-340a-4575-b23a-efac5cbde33a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:29 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-c639bbc3-b3fc-45bf-8c93-743ecd9cfe93 tempest-SnapshotDependencyTests-404514513 None] Flow 'volume_create_manager' (f06782ea-f061-4744-b705-cf84833fc00e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:14:29 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-87702288-e37b-4710-a45b-b95b02c91b39 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Lock "cinder-9b11b64a-2bda-4405-ac94-66765e8c33b6-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:14:29 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-c639bbc3-b3fc-45bf-8c93-743ecd9cfe93 tempest-SnapshotDependencyTests-404514513 None] Created volume successfully.
Apr 15 20:14:29 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-87702288-e37b-4710-a45b-b95b02c91b39 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Acquiring lock "cinder-quobyte-9b11b64a-2bda-4405-ac94-66765e8c33b6" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:14:29 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-87702288-e37b-4710-a45b-b95b02c91b39 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Lock "cinder-quobyte-9b11b64a-2bda-4405-ac94-66765e8c33b6" acquired by "delete_volume" :: waited 0.011s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:14:29 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f62dc33-d577-4200-acf9-70481ccd49b1]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:14:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-87702288-e37b-4710-a45b-b95b02c91b39 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9b11b64a-2bda-4405-ac94-66765e8c33b6 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:29 devstack sudo[90542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9b11b64a-2bda-4405-ac94-66765e8c33b6
Apr 15 20:14:29 devstack sudo[90542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:29 devstack sudo[90536]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-dcffdf43-b38d-4deb-9cc4-544218b52601 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.528s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:29 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-dcffdf43-b38d-4deb-9cc4-544218b52601 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:14:29 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-dcffdf43-b38d-4deb-9cc4-544218b52601 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Deleted volume successfully.
Apr 15 20:14:29 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-dcffdf43-b38d-4deb-9cc4-544218b52601 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Lock "cinder-85b0ec8e-c9d2-4dfb-9909-2d71d036dbe3-delete_volume" released by "delete_volume" :: held 2.496s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:14:29 devstack sudo[90539]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-f683bc59-f08b-4eb1-bf75-eb3ecaa0ad84 tempest-VolumeDependencyTests-2146631135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9 1073741824" returned: 0 in 0.591s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:29 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-f683bc59-f08b-4eb1-bf75-eb3ecaa0ad84 tempest-VolumeDependencyTests-2146631135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:29 devstack sudo[90551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9
Apr 15 20:14:29 devstack sudo[90551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:30 devstack sudo[90542]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-87702288-e37b-4710-a45b-b95b02c91b39 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9b11b64a-2bda-4405-ac94-66765e8c33b6" returned: 0 in 0.599s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-87702288-e37b-4710-a45b-b95b02c91b39 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9b11b64a-2bda-4405-ac94-66765e8c33b6 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:30 devstack sudo[90553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9b11b64a-2bda-4405-ac94-66765e8c33b6
Apr 15 20:14:30 devstack sudo[90553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:30 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-3873a2fe-322d-4096-b80b-c87dff719b50 tempest-SnapshotDependencyTests-404514513 None] Acquiring lock "cinder-9abc9611-096b-4035-bc06-a5bd81331506-delete_snapshot" by "delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:14:30 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-3873a2fe-322d-4096-b80b-c87dff719b50 tempest-SnapshotDependencyTests-404514513 None] Lock "cinder-9abc9611-096b-4035-bc06-a5bd81331506-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:14:30 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-3873a2fe-322d-4096-b80b-c87dff719b50 tempest-SnapshotDependencyTests-404514513 None] Acquiring lock "cinder-quobyte-444c2edb-5699-4c6f-97a3-57e19485ef02" by "delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:14:30 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-3873a2fe-322d-4096-b80b-c87dff719b50 tempest-SnapshotDependencyTests-404514513 None] Lock "cinder-quobyte-444c2edb-5699-4c6f-97a3-57e19485ef02" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:14:30 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-3873a2fe-322d-4096-b80b-c87dff719b50 tempest-SnapshotDependencyTests-404514513 None] Acquiring lock "cinder-quobyte-9abc9611-096b-4035-bc06-a5bd81331506" by "_delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:14:30 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-3873a2fe-322d-4096-b80b-c87dff719b50 tempest-SnapshotDependencyTests-404514513 None] Lock "cinder-quobyte-9abc9611-096b-4035-bc06-a5bd81331506" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:14:30 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-3873a2fe-322d-4096-b80b-c87dff719b50 tempest-SnapshotDependencyTests-404514513 None] Deleting offline snapshot 9abc9611-096b-4035-bc06-a5bd81331506 of volume 444c2edb-5699-4c6f-97a3-57e19485ef02 {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 20:14:30 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-3873a2fe-322d-4096-b80b-c87dff719b50 tempest-SnapshotDependencyTests-404514513 None] snapshot_file for this snap is: volume-444c2edb-5699-4c6f-97a3-57e19485ef02.9abc9611-096b-4035-bc06-a5bd81331506 {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 20:14:30 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed2c5d5-593d-4ecf-b760-817f1b97842f]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:14:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-3873a2fe-322d-4096-b80b-c87dff719b50 tempest-SnapshotDependencyTests-404514513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-444c2edb-5699-4c6f-97a3-57e19485ef02.9abc9611-096b-4035-bc06-a5bd81331506 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:30 devstack sudo[90555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-444c2edb-5699-4c6f-97a3-57e19485ef02.9abc9611-096b-4035-bc06-a5bd81331506
Apr 15 20:14:30 devstack sudo[90555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:30 devstack sudo[90551]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-f683bc59-f08b-4eb1-bf75-eb3ecaa0ad84 tempest-VolumeDependencyTests-2146631135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9" returned: 0 in 0.484s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:30 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-f683bc59-f08b-4eb1-bf75-eb3ecaa0ad84 tempest-VolumeDependencyTests-2146631135 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:14:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-f683bc59-f08b-4eb1-bf75-eb3ecaa0ad84 tempest-VolumeDependencyTests-2146631135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:14:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-bb43efc6-a5fe-496e-89e3-f9bafd6119be tempest-CinderUnicodeTest-2085134074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.249s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:14:30 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-bb43efc6-a5fe-496e-89e3-f9bafd6119be tempest-CinderUnicodeTest-2085134074 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:14:29Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7b1b2f0-afc4-4e0a-8458-3fa7f941f951,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b53d9b55218543278a14cbe26834147d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:29Z,use_quota=True,user_id='b1cafaaf4286491cac8360733d3327ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:14:30 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-bb43efc6-a5fe-496e-89e3-f9bafd6119be tempest-CinderUnicodeTest-2085134074 None] Creating volume b7b1b2f0-afc4-4e0a-8458-3fa7f941f951 {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:14:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-bb43efc6-a5fe-496e-89e3-f9bafd6119be tempest-CinderUnicodeTest-2085134074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:14:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-bb43efc6-a5fe-496e-89e3-f9bafd6119be tempest-CinderUnicodeTest-2085134074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:14:30 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-bb43efc6-a5fe-496e-89e3-f9bafd6119be tempest-CinderUnicodeTest-2085134074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:14:30 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-bb43efc6-a5fe-496e-89e3-f9bafd6119be tempest-CinderUnicodeTest-2085134074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:14:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-bb43efc6-a5fe-496e-89e3-f9bafd6119be tempest-CinderUnicodeTest-2085134074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:14:30 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-bb43efc6-a5fe-496e-89e3-f9bafd6119be tempest-CinderUnicodeTest-2085134074 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:14:30 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-bb43efc6-a5fe-496e-89e3-f9bafd6119be tempest-CinderUnicodeTest-2085134074 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:14:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bb43efc6-a5fe-496e-89e3-f9bafd6119be tempest-CinderUnicodeTest-2085134074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b7b1b2f0-afc4-4e0a-8458-3fa7f941f951 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:30 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f683bc59-f08b-4eb1-bf75-eb3ecaa0ad84 tempest-VolumeDependencyTests-2146631135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7e20ec0-08c6-498c-b1d6-de6de239e29e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:30 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f683bc59-f08b-4eb1-bf75-eb3ecaa0ad84 tempest-VolumeDependencyTests-2146631135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e99dc4f-dc8c-437a-b805-aa3767be5cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:30 devstack sudo[90558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b7b1b2f0-afc4-4e0a-8458-3fa7f941f951 1073741824
Apr 15 20:14:30 devstack sudo[90558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:30 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-f683bc59-f08b-4eb1-bf75-eb3ecaa0ad84 tempest-VolumeDependencyTests-2146631135 None] Volume volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9 (46ce7964-295a-4e62-b8a1-5a21405f7ab9): created successfully
Apr 15 20:14:30 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f683bc59-f08b-4eb1-bf75-eb3ecaa0ad84 tempest-VolumeDependencyTests-2146631135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e99dc4f-dc8c-437a-b805-aa3767be5cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:30 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-f683bc59-f08b-4eb1-bf75-eb3ecaa0ad84 tempest-VolumeDependencyTests-2146631135 None] Flow 'volume_create_manager' (e0b0ed90-06d2-4c87-916d-9c799f8cd52d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:14:30 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-f683bc59-f08b-4eb1-bf75-eb3ecaa0ad84 tempest-VolumeDependencyTests-2146631135 None] Created volume successfully.
Apr 15 20:14:30 devstack sudo[90553]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-87702288-e37b-4710-a45b-b95b02c91b39 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9b11b64a-2bda-4405-ac94-66765e8c33b6" returned: 0 in 0.504s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:30 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-87702288-e37b-4710-a45b-b95b02c91b39 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Lock "cinder-quobyte-9b11b64a-2bda-4405-ac94-66765e8c33b6" released by "delete_volume" :: held 1.130s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:14:30 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-87702288-e37b-4710-a45b-b95b02c91b39 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Created reservations ['c9cb146d-f55c-4385-ab2b-782f15602b38', '0962ce0c-3d9c-4c20-8fa7-77893f6c1459', '9151794c-fcc8-46f5-928c-5fd7771e1060', '7da97710-7e61-47b4-8ec6-a7be2d0eaf47'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:14:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-87702288-e37b-4710-a45b-b95b02c91b39 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:14:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-87702288-e37b-4710-a45b-b95b02c91b39 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:14:30 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-87702288-e37b-4710-a45b-b95b02c91b39 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:14:30 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-87702288-e37b-4710-a45b-b95b02c91b39 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:14:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-87702288-e37b-4710-a45b-b95b02c91b39 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:14:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-87702288-e37b-4710-a45b-b95b02c91b39 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:30 devstack sudo[90564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:14:30 devstack sudo[90564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:30 devstack sudo[90555]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-3873a2fe-322d-4096-b80b-c87dff719b50 tempest-SnapshotDependencyTests-404514513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-444c2edb-5699-4c6f-97a3-57e19485ef02.9abc9611-096b-4035-bc06-a5bd81331506" returned: 0 in 0.559s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:30 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-3873a2fe-322d-4096-b80b-c87dff719b50 tempest-SnapshotDependencyTests-404514513 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-444c2edb-5699-4c6f-97a3-57e19485ef02(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82646) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 20:14:30 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[695b45b9-e2cd-4beb-b07c-25356e5a9021]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:14:30 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-3873a2fe-322d-4096-b80b-c87dff719b50 tempest-SnapshotDependencyTests-404514513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-444c2edb-5699-4c6f-97a3-57e19485ef02 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:30 devstack sudo[90566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-444c2edb-5699-4c6f-97a3-57e19485ef02
Apr 15 20:14:30 devstack sudo[90566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:31 devstack sudo[90558]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bb43efc6-a5fe-496e-89e3-f9bafd6119be tempest-CinderUnicodeTest-2085134074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b7b1b2f0-afc4-4e0a-8458-3fa7f941f951 1073741824" returned: 0 in 0.585s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bb43efc6-a5fe-496e-89e3-f9bafd6119be tempest-CinderUnicodeTest-2085134074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b7b1b2f0-afc4-4e0a-8458-3fa7f941f951 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:31 devstack sudo[90572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b7b1b2f0-afc4-4e0a-8458-3fa7f941f951
Apr 15 20:14:31 devstack sudo[90572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:31 devstack sudo[90564]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-87702288-e37b-4710-a45b-b95b02c91b39 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.482s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:31 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-87702288-e37b-4710-a45b-b95b02c91b39 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:14:31 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-87702288-e37b-4710-a45b-b95b02c91b39 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Deleted volume successfully.
Apr 15 20:14:31 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-87702288-e37b-4710-a45b-b95b02c91b39 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Lock "cinder-9b11b64a-2bda-4405-ac94-66765e8c33b6-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:14:31 devstack sudo[90566]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-3873a2fe-322d-4096-b80b-c87dff719b50 tempest-SnapshotDependencyTests-404514513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-444c2edb-5699-4c6f-97a3-57e19485ef02" returned: 0 in 0.606s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-3873a2fe-322d-4096-b80b-c87dff719b50 tempest-SnapshotDependencyTests-404514513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-444c2edb-5699-4c6f-97a3-57e19485ef02.9abc9611-096b-4035-bc06-a5bd81331506 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:31 devstack sudo[90577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-444c2edb-5699-4c6f-97a3-57e19485ef02.9abc9611-096b-4035-bc06-a5bd81331506
Apr 15 20:14:31 devstack sudo[90577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:31 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-fee48c50-d08f-4c15-b4eb-01d91a69e52d tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Acquiring lock "cinder-a7bf4b1f-eb94-40ef-b8e4-a7e2c6020b32-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:14:31 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:14:31 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-fee48c50-d08f-4c15-b4eb-01d91a69e52d tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Lock "cinder-a7bf4b1f-eb94-40ef-b8e4-a7e2c6020b32-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:14:31 devstack sudo[90572]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bb43efc6-a5fe-496e-89e3-f9bafd6119be tempest-CinderUnicodeTest-2085134074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b7b1b2f0-afc4-4e0a-8458-3fa7f941f951" returned: 0 in 0.590s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:31 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-bb43efc6-a5fe-496e-89e3-f9bafd6119be tempest-CinderUnicodeTest-2085134074 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:14:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-bb43efc6-a5fe-496e-89e3-f9bafd6119be tempest-CinderUnicodeTest-2085134074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:14:31 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] Flow 'volume_create_manager' (a2145302-9fb7-4cb2-9cdd-59e137a2a6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:14:31 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5a23b22-47c2-449b-9c34-b716c634b8c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:31 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5a23b22-47c2-449b-9c34-b716c634b8c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:14:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1811182999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b64ad3a-116f-44ee-8729-0276364de6d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8beda731ffc94345980fbb9fadc77736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=46ce7964-295a-4e62-b8a1-5a21405f7ab9,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:32Z,use_quota=True,user_id='febc3aa7e59e46e29f55adac7b15c620',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:31 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd43bf10-8e40-42b9-93d3-2e52c1d773f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:31 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd43bf10-8e40-42b9-93d3-2e52c1d773f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:31 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d567545d-a74e-4ec1-9685-b68884bd7f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:31 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-bb43efc6-a5fe-496e-89e3-f9bafd6119be tempest-CinderUnicodeTest-2085134074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2260aff9-3011-4e54-b3de-49d055601bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7b1b2f0-afc4-4e0a-8458-3fa7f941f951', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:31 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-bb43efc6-a5fe-496e-89e3-f9bafd6119be tempest-CinderUnicodeTest-2085134074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88053e31-895f-425d-84a8-f198830a020b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:31 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d567545d-a74e-4ec1-9685-b68884bd7f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '5b64ad3a-116f-44ee-8729-0276364de6d3', 'volume_name': 'volume-5b64ad3a-116f-44ee-8729-0276364de6d3', 'volume_size': 1, 'source_volid': '46ce7964-295a-4e62-b8a1-5a21405f7ab9', 'source_volstatus': 'available'}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:31 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dec62d00-4172-422c-971f-39db522cc1c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:31 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dec62d00-4172-422c-971f-39db522cc1c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:31 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7e05527-7afc-4436-aef5-fbd5b9f88483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:31 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] Volume 5b64ad3a-116f-44ee-8729-0276364de6d3: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-5b64ad3a-116f-44ee-8729-0276364de6d3', 'volume_size': 1, 'source_volid': '46ce7964-295a-4e62-b8a1-5a21405f7ab9', 'source_volstatus': 'available'}
Apr 15 20:14:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:14:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:14:31 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] Cloning volume 46ce7964-295a-4e62-b8a1-5a21405f7ab9 to volume 5b64ad3a-116f-44ee-8729-0276364de6d3
Apr 15 20:14:31 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-fee48c50-d08f-4c15-b4eb-01d91a69e52d tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Acquiring lock "cinder-quobyte-a7bf4b1f-eb94-40ef-b8e4-a7e2c6020b32" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:14:31 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-bb43efc6-a5fe-496e-89e3-f9bafd6119be tempest-CinderUnicodeTest-2085134074 None] Volume volume-b7b1b2f0-afc4-4e0a-8458-3fa7f941f951 (b7b1b2f0-afc4-4e0a-8458-3fa7f941f951): created successfully
Apr 15 20:14:31 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-bb43efc6-a5fe-496e-89e3-f9bafd6119be tempest-CinderUnicodeTest-2085134074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88053e31-895f-425d-84a8-f198830a020b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:31 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-bb43efc6-a5fe-496e-89e3-f9bafd6119be tempest-CinderUnicodeTest-2085134074 None] Flow 'volume_create_manager' (5883b828-d810-465f-a79c-71e48c84db52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:14:31 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-bb43efc6-a5fe-496e-89e3-f9bafd6119be tempest-CinderUnicodeTest-2085134074 None] Created volume successfully.
Apr 15 20:14:31 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-fee48c50-d08f-4c15-b4eb-01d91a69e52d tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Lock "cinder-quobyte-a7bf4b1f-eb94-40ef-b8e4-a7e2c6020b32" acquired by "delete_volume" :: waited 0.034s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:14:31 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] Creating offline snapshot edc4bb94-bf18-40d2-b3f3-0bb3d24e8b92 of volume 46ce7964-295a-4e62-b8a1-5a21405f7ab9 {{(pid=82646) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 20:14:31 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c93a6b-6f2d-4a21-bbfe-ea14b685d10d]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:14:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-fee48c50-d08f-4c15-b4eb-01d91a69e52d tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7bf4b1f-eb94-40ef-b8e4-a7e2c6020b32 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:31 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc46f8d-c299-4789-847a-cbb419916d93]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:14:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:31 devstack sudo[90583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7bf4b1f-eb94-40ef-b8e4-a7e2c6020b32
Apr 15 20:14:31 devstack sudo[90583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:31 devstack sudo[90584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9
Apr 15 20:14:31 devstack sudo[90584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:31 devstack sudo[90577]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-3873a2fe-322d-4096-b80b-c87dff719b50 tempest-SnapshotDependencyTests-404514513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-444c2edb-5699-4c6f-97a3-57e19485ef02.9abc9611-096b-4035-bc06-a5bd81331506" returned: 0 in 0.576s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:31 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-3873a2fe-322d-4096-b80b-c87dff719b50 tempest-SnapshotDependencyTests-404514513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-444c2edb-5699-4c6f-97a3-57e19485ef02.9abc9611-096b-4035-bc06-a5bd81331506 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:31 devstack sudo[90587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-444c2edb-5699-4c6f-97a3-57e19485ef02.9abc9611-096b-4035-bc06-a5bd81331506
Apr 15 20:14:31 devstack sudo[90587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:32 devstack sudo[90583]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-fee48c50-d08f-4c15-b4eb-01d91a69e52d tempest-CreateVolumesFromSourceVolumeTest-430838871 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7bf4b1f-eb94-40ef-b8e4-a7e2c6020b32" returned: 0 in 0.541s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-fee48c50-d08f-4c15-b4eb-01d91a69e52d tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7bf4b1f-eb94-40ef-b8e4-a7e2c6020b32 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:32 devstack sudo[90584]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9" returned: 0 in 0.551s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9.edc4bb94-bf18-40d2-b3f3-0bb3d24e8b92 1G {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:32 devstack sudo[90596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7bf4b1f-eb94-40ef-b8e4-a7e2c6020b32
Apr 15 20:14:32 devstack sudo[90596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:32 devstack sudo[90598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9.edc4bb94-bf18-40d2-b3f3-0bb3d24e8b92 1G
Apr 15 20:14:32 devstack sudo[90598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:32 devstack sudo[90587]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-3873a2fe-322d-4096-b80b-c87dff719b50 tempest-SnapshotDependencyTests-404514513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-444c2edb-5699-4c6f-97a3-57e19485ef02.9abc9611-096b-4035-bc06-a5bd81331506" returned: 0 in 0.506s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:32 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-3873a2fe-322d-4096-b80b-c87dff719b50 tempest-SnapshotDependencyTests-404514513 None] Lock "cinder-quobyte-9abc9611-096b-4035-bc06-a5bd81331506" released by "_delete_snapshot" :: held 2.305s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:14:32 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-3873a2fe-322d-4096-b80b-c87dff719b50 tempest-SnapshotDependencyTests-404514513 None] Lock "cinder-quobyte-444c2edb-5699-4c6f-97a3-57e19485ef02" released by "delete_snapshot" :: held 2.323s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:14:32 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-3873a2fe-322d-4096-b80b-c87dff719b50 tempest-SnapshotDependencyTests-404514513 None] Created reservations ['f0be4b8d-5f9b-4470-a623-e55af2da7a72', 'e0c8192d-3e32-45a5-9eab-096fe864e8da', '31c30007-8a70-4389-a502-2113e8357990', '5d97d4b3-db58-4e3b-8b0a-a057336a9fe8'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:14:32 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-3873a2fe-322d-4096-b80b-c87dff719b50 tempest-SnapshotDependencyTests-404514513 None] Delete snapshot completed successfully.
Apr 15 20:14:32 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-3873a2fe-322d-4096-b80b-c87dff719b50 tempest-SnapshotDependencyTests-404514513 None] Lock "cinder-9abc9611-096b-4035-bc06-a5bd81331506-delete_snapshot" released by "delete_snapshot" :: held 2.457s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:14:32 devstack cinder-volume[82646]: DEBUG cinder.volume.flows.manager.create_volume [None req-84d0cc6f-402c-4098-9fa4-6ec7fb37ef67 tempest-CinderUnicodeTest-2085134074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82646) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 20:14:32 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-84d0cc6f-402c-4098-9fa4-6ec7fb37ef67 tempest-CinderUnicodeTest-2085134074 None] Flow 'volume_create_manager' (7795f5bf-f681-4901-a920-d8bc591c6133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:14:32 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-84d0cc6f-402c-4098-9fa4-6ec7fb37ef67 tempest-CinderUnicodeTest-2085134074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (389800b5-7a6a-4e7c-8a70-e23ee81b38f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:32 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-84d0cc6f-402c-4098-9fa4-6ec7fb37ef67 tempest-CinderUnicodeTest-2085134074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (389800b5-7a6a-4e7c-8a70-e23ee81b38f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:14:32Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-172660488',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5be08271-fafd-4e23-8fbf-5fb650ba1422,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b53d9b55218543278a14cbe26834147d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:33Z,use_quota=True,user_id='b1cafaaf4286491cac8360733d3327ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:32 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-84d0cc6f-402c-4098-9fa4-6ec7fb37ef67 tempest-CinderUnicodeTest-2085134074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (207ff177-e6db-46cc-ba68-56839baba458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:32 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-84d0cc6f-402c-4098-9fa4-6ec7fb37ef67 tempest-CinderUnicodeTest-2085134074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (207ff177-e6db-46cc-ba68-56839baba458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:32 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-84d0cc6f-402c-4098-9fa4-6ec7fb37ef67 tempest-CinderUnicodeTest-2085134074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcf53bec-c9ca-4afd-9a8f-08c2c70f435e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:32 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-84d0cc6f-402c-4098-9fa4-6ec7fb37ef67 tempest-CinderUnicodeTest-2085134074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcf53bec-c9ca-4afd-9a8f-08c2c70f435e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5be08271-fafd-4e23-8fbf-5fb650ba1422', 'volume_name': 'volume-5be08271-fafd-4e23-8fbf-5fb650ba1422', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:32 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-84d0cc6f-402c-4098-9fa4-6ec7fb37ef67 tempest-CinderUnicodeTest-2085134074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (018f035c-a105-4264-883b-12db7013f79c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:32 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-84d0cc6f-402c-4098-9fa4-6ec7fb37ef67 tempest-CinderUnicodeTest-2085134074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (018f035c-a105-4264-883b-12db7013f79c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:32 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-84d0cc6f-402c-4098-9fa4-6ec7fb37ef67 tempest-CinderUnicodeTest-2085134074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e30ace55-6cc8-49db-8773-d860d0505df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:32 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-84d0cc6f-402c-4098-9fa4-6ec7fb37ef67 tempest-CinderUnicodeTest-2085134074 None] Volume 5be08271-fafd-4e23-8fbf-5fb650ba1422: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5be08271-fafd-4e23-8fbf-5fb650ba1422', 'volume_size': 1}
Apr 15 20:14:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-84d0cc6f-402c-4098-9fa4-6ec7fb37ef67 tempest-CinderUnicodeTest-2085134074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:14:32 devstack sudo[90596]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-fee48c50-d08f-4c15-b4eb-01d91a69e52d tempest-CreateVolumesFromSourceVolumeTest-430838871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-a7bf4b1f-eb94-40ef-b8e4-a7e2c6020b32" returned: 0 in 0.504s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:32 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-fee48c50-d08f-4c15-b4eb-01d91a69e52d tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Lock "cinder-quobyte-a7bf4b1f-eb94-40ef-b8e4-a7e2c6020b32" released by "delete_volume" :: held 1.070s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:14:32 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-fee48c50-d08f-4c15-b4eb-01d91a69e52d tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Created reservations ['635150df-ef2e-4377-8417-92df877cf9f7', '779f6c70-321c-4cd1-884f-be78798e859a', '59e82ee9-e2ad-4730-a990-fd26fa230822', 'cef1970b-e3b2-48ea-8f09-54392318c92d'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:14:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-fee48c50-d08f-4c15-b4eb-01d91a69e52d tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:14:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-fee48c50-d08f-4c15-b4eb-01d91a69e52d tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:14:32 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-fee48c50-d08f-4c15-b4eb-01d91a69e52d tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:14:32 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-fee48c50-d08f-4c15-b4eb-01d91a69e52d tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:14:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-fee48c50-d08f-4c15-b4eb-01d91a69e52d tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:14:32 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-fee48c50-d08f-4c15-b4eb-01d91a69e52d tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:33 devstack sudo[90604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:14:33 devstack sudo[90604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:33 devstack sudo[90598]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:33 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9.edc4bb94-bf18-40d2-b3f3-0bb3d24e8b92 1G" returned: 0 in 0.616s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:33 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9 -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9.edc4bb94-bf18-40d2-b3f3-0bb3d24e8b92 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:33 devstack sudo[90606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9 -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9.edc4bb94-bf18-40d2-b3f3-0bb3d24e8b92
Apr 15 20:14:33 devstack sudo[90606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:33 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-5cc36bdb-acdb-4e7f-94c2-053d2aec2245 tempest-SnapshotDependencyTests-404514513 None] Acquiring lock "cinder-444c2edb-5699-4c6f-97a3-57e19485ef02-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:14:33 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-5cc36bdb-acdb-4e7f-94c2-053d2aec2245 tempest-SnapshotDependencyTests-404514513 None] Lock "cinder-444c2edb-5699-4c6f-97a3-57e19485ef02-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:14:33 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-5cc36bdb-acdb-4e7f-94c2-053d2aec2245 tempest-SnapshotDependencyTests-404514513 None] Acquiring lock "cinder-quobyte-444c2edb-5699-4c6f-97a3-57e19485ef02" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:14:33 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-5cc36bdb-acdb-4e7f-94c2-053d2aec2245 tempest-SnapshotDependencyTests-404514513 None] Lock "cinder-quobyte-444c2edb-5699-4c6f-97a3-57e19485ef02" acquired by "delete_volume" :: waited 0.011s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:14:33 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[97fb6e09-09f4-4d04-b298-41fdfe2626b9]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:14:33 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5cc36bdb-acdb-4e7f-94c2-053d2aec2245 tempest-SnapshotDependencyTests-404514513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-444c2edb-5699-4c6f-97a3-57e19485ef02 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:33 devstack sudo[90604]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:33 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-fee48c50-d08f-4c15-b4eb-01d91a69e52d tempest-CreateVolumesFromSourceVolumeTest-430838871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.479s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:33 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-fee48c50-d08f-4c15-b4eb-01d91a69e52d tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:14:33 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-fee48c50-d08f-4c15-b4eb-01d91a69e52d tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Deleted volume successfully.
Apr 15 20:14:33 devstack sudo[90618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-444c2edb-5699-4c6f-97a3-57e19485ef02
Apr 15 20:14:33 devstack sudo[90618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:33 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-fee48c50-d08f-4c15-b4eb-01d91a69e52d tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Lock "cinder-a7bf4b1f-eb94-40ef-b8e4-a7e2c6020b32-delete_volume" released by "delete_volume" :: held 1.832s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:14:33 devstack sudo[90606]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:33 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9 -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9.edc4bb94-bf18-40d2-b3f3-0bb3d24e8b92" returned: 0 in 0.486s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:33 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9.edc4bb94-bf18-40d2-b3f3-0bb3d24e8b92 is being set with open permissions: ugo+rw
Apr 15 20:14:33 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9.edc4bb94-bf18-40d2-b3f3-0bb3d24e8b92 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:33 devstack sudo[90620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9.edc4bb94-bf18-40d2-b3f3-0bb3d24e8b92
Apr 15 20:14:33 devstack sudo[90620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:33 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-d989fe99-35f9-486f-bf7e-d4ba7ec42c87 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Acquiring lock "cinder-d19f68ad-edc8-454f-ad7d-acde77a7b353-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:14:33 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-d989fe99-35f9-486f-bf7e-d4ba7ec42c87 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Lock "cinder-d19f68ad-edc8-454f-ad7d-acde77a7b353-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:14:33 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-d989fe99-35f9-486f-bf7e-d4ba7ec42c87 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Acquiring lock "cinder-quobyte-d19f68ad-edc8-454f-ad7d-acde77a7b353" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:14:33 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-d989fe99-35f9-486f-bf7e-d4ba7ec42c87 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Lock "cinder-quobyte-d19f68ad-edc8-454f-ad7d-acde77a7b353" acquired by "delete_volume" :: waited 0.020s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:14:33 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[758ee47b-2ce4-4dfa-bb1b-ba4be1f52ea1]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:14:33 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d989fe99-35f9-486f-bf7e-d4ba7ec42c87 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d19f68ad-edc8-454f-ad7d-acde77a7b353 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:33 devstack sudo[90625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d19f68ad-edc8-454f-ad7d-acde77a7b353
Apr 15 20:14:33 devstack sudo[90625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:33 devstack sudo[90618]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:33 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5cc36bdb-acdb-4e7f-94c2-053d2aec2245 tempest-SnapshotDependencyTests-404514513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-444c2edb-5699-4c6f-97a3-57e19485ef02" returned: 0 in 0.559s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:33 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5cc36bdb-acdb-4e7f-94c2-053d2aec2245 tempest-SnapshotDependencyTests-404514513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-444c2edb-5699-4c6f-97a3-57e19485ef02 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:33 devstack sudo[90620]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:33 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9.edc4bb94-bf18-40d2-b3f3-0bb3d24e8b92" returned: 0 in 0.462s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:33 devstack sudo[90628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-444c2edb-5699-4c6f-97a3-57e19485ef02
Apr 15 20:14:33 devstack sudo[90628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:33 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9.info {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:34 devstack sudo[90630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9.info
Apr 15 20:14:34 devstack sudo[90630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:34 devstack sudo[90625]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:34 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d989fe99-35f9-486f-bf7e-d4ba7ec42c87 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d19f68ad-edc8-454f-ad7d-acde77a7b353" returned: 0 in 0.518s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:34 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d989fe99-35f9-486f-bf7e-d4ba7ec42c87 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d19f68ad-edc8-454f-ad7d-acde77a7b353 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:34 devstack sudo[90628]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:34 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5cc36bdb-acdb-4e7f-94c2-053d2aec2245 tempest-SnapshotDependencyTests-404514513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-444c2edb-5699-4c6f-97a3-57e19485ef02" returned: 0 in 0.421s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:34 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-5cc36bdb-acdb-4e7f-94c2-053d2aec2245 tempest-SnapshotDependencyTests-404514513 None] Lock "cinder-quobyte-444c2edb-5699-4c6f-97a3-57e19485ef02" released by "delete_volume" :: held 1.016s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:14:34 devstack sudo[90637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d19f68ad-edc8-454f-ad7d-acde77a7b353
Apr 15 20:14:34 devstack sudo[90637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:34 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-5cc36bdb-acdb-4e7f-94c2-053d2aec2245 tempest-SnapshotDependencyTests-404514513 None] Created reservations ['9119be67-8d23-4eb5-a22f-480eaef32cf0', '24950b8e-90ad-463a-b312-6324fcaf70f2', '11a2ed01-5a8e-441d-8787-302d16ddb124', '8766b6c5-efb8-41c1-b283-8c4d31eeea71'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:14:34 devstack sudo[90630]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:34 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9.info" returned: 0 in 0.476s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:34 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9.info is being set with open permissions: ugo+rw
Apr 15 20:14:34 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9.info {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:34 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-5cc36bdb-acdb-4e7f-94c2-053d2aec2245 tempest-SnapshotDependencyTests-404514513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:14:34 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-5cc36bdb-acdb-4e7f-94c2-053d2aec2245 tempest-SnapshotDependencyTests-404514513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:14:34 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-5cc36bdb-acdb-4e7f-94c2-053d2aec2245 tempest-SnapshotDependencyTests-404514513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:14:34 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-5cc36bdb-acdb-4e7f-94c2-053d2aec2245 tempest-SnapshotDependencyTests-404514513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:14:34 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-5cc36bdb-acdb-4e7f-94c2-053d2aec2245 tempest-SnapshotDependencyTests-404514513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:14:34 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5cc36bdb-acdb-4e7f-94c2-053d2aec2245 tempest-SnapshotDependencyTests-404514513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:34 devstack sudo[90639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9.info
Apr 15 20:14:34 devstack sudo[90639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:34 devstack sudo[90641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:14:34 devstack sudo[90641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:34 devstack sudo[90637]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:34 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d989fe99-35f9-486f-bf7e-d4ba7ec42c87 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d19f68ad-edc8-454f-ad7d-acde77a7b353" returned: 0 in 0.467s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:34 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-d989fe99-35f9-486f-bf7e-d4ba7ec42c87 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Lock "cinder-quobyte-d19f68ad-edc8-454f-ad7d-acde77a7b353" released by "delete_volume" :: held 1.012s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:14:34 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-d989fe99-35f9-486f-bf7e-d4ba7ec42c87 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Created reservations ['cdb04fa8-bfea-466a-ba80-45ab6e9c0e33', '690fad41-5a01-4373-bf25-a69b0058d271', 'ee1d64d9-4ad7-4b0e-9bb2-c32285c8a5e2', '693aa786-f611-4027-86f0-b6c9e2d09b19'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:14:34 devstack sudo[90641]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:34 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-5cc36bdb-acdb-4e7f-94c2-053d2aec2245 tempest-SnapshotDependencyTests-404514513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.463s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:34 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-5cc36bdb-acdb-4e7f-94c2-053d2aec2245 tempest-SnapshotDependencyTests-404514513 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:14:34 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-5cc36bdb-acdb-4e7f-94c2-053d2aec2245 tempest-SnapshotDependencyTests-404514513 None] Deleted volume successfully.
Apr 15 20:14:34 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-5cc36bdb-acdb-4e7f-94c2-053d2aec2245 tempest-SnapshotDependencyTests-404514513 None] Lock "cinder-444c2edb-5699-4c6f-97a3-57e19485ef02-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:14:34 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-d989fe99-35f9-486f-bf7e-d4ba7ec42c87 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:14:34 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-d989fe99-35f9-486f-bf7e-d4ba7ec42c87 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:14:34 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-d989fe99-35f9-486f-bf7e-d4ba7ec42c87 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:14:34 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-d989fe99-35f9-486f-bf7e-d4ba7ec42c87 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:14:34 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-d989fe99-35f9-486f-bf7e-d4ba7ec42c87 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:14:34 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d989fe99-35f9-486f-bf7e-d4ba7ec42c87 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:35 devstack sudo[90646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:14:35 devstack sudo[90646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:35 devstack sudo[90639]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:35 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9.info" returned: 0 in 0.568s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:35 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] Acquiring lock "cinder-quobyte-5b64ad3a-116f-44ee-8729-0276364de6d3" by "_copy_volume_from_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:14:35 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] Lock "cinder-quobyte-5b64ad3a-116f-44ee-8729-0276364de6d3" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:14:35 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] snapshot: edc4bb94-bf18-40d2-b3f3-0bb3d24e8b92, volume: 5b64ad3a-116f-44ee-8729-0276364de6d3,  {{(pid=82646) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 15 20:14:35 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:14:35 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:14:35 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:14:35 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:14:35 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:14:35 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[360f19ba-a161-431b-8545-0dc9dbb5fc2a]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:14:35 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9.edc4bb94-bf18-40d2-b3f3-0bb3d24e8b92 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:35 devstack sudo[90648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9.edc4bb94-bf18-40d2-b3f3-0bb3d24e8b92
Apr 15 20:14:35 devstack sudo[90648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:35 devstack sudo[90646]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:35 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-d989fe99-35f9-486f-bf7e-d4ba7ec42c87 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.446s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:35 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-d989fe99-35f9-486f-bf7e-d4ba7ec42c87 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:14:35 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-d989fe99-35f9-486f-bf7e-d4ba7ec42c87 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Deleted volume successfully.
Apr 15 20:14:35 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-d989fe99-35f9-486f-bf7e-d4ba7ec42c87 tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Lock "cinder-d19f68ad-edc8-454f-ad7d-acde77a7b353-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:14:35 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-17034c8f-d074-4c9d-8c1d-a4472c472f21 tempest-SnapshotDependencyTests-404514513 None] Acquiring lock "cinder-9938e16c-504f-423c-b615-911808c2dcc5-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:14:35 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-17034c8f-d074-4c9d-8c1d-a4472c472f21 tempest-SnapshotDependencyTests-404514513 None] Lock "cinder-9938e16c-504f-423c-b615-911808c2dcc5-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:14:35 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-17034c8f-d074-4c9d-8c1d-a4472c472f21 tempest-SnapshotDependencyTests-404514513 None] Acquiring lock "cinder-quobyte-9938e16c-504f-423c-b615-911808c2dcc5" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:14:35 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-17034c8f-d074-4c9d-8c1d-a4472c472f21 tempest-SnapshotDependencyTests-404514513 None] Lock "cinder-quobyte-9938e16c-504f-423c-b615-911808c2dcc5" acquired by "delete_volume" :: waited 0.010s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:14:35 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ea36ad-efbb-4aa7-917e-59a0184b7fb3]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:14:35 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-17034c8f-d074-4c9d-8c1d-a4472c472f21 tempest-SnapshotDependencyTests-404514513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9938e16c-504f-423c-b615-911808c2dcc5 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:35 devstack sudo[90648]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:35 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9.edc4bb94-bf18-40d2-b3f3-0bb3d24e8b92" returned: 0 in 0.523s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:35 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82646) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 20:14:35 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9 {{(pid=82646) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 15 20:14:35 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] Creating direct copy from snapshot {{(pid=82646) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 15 20:14:35 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1dfd397-b071-49d1-b5a4-7a9c00af011b]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:14:35 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:35 devstack sudo[90654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9938e16c-504f-423c-b615-911808c2dcc5
Apr 15 20:14:35 devstack sudo[90654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:35 devstack sudo[90655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9
Apr 15 20:14:35 devstack sudo[90655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:35 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-7df6b52a-c4b6-4c78-91ba-9d2e9b62468a tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Acquiring lock "cinder-d4144cf9-c659-4c22-93f4-8a7c20e93dcb-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:14:35 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-7df6b52a-c4b6-4c78-91ba-9d2e9b62468a tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Lock "cinder-d4144cf9-c659-4c22-93f4-8a7c20e93dcb-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:14:36 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-7df6b52a-c4b6-4c78-91ba-9d2e9b62468a tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Acquiring lock "cinder-quobyte-d4144cf9-c659-4c22-93f4-8a7c20e93dcb" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:14:36 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-7df6b52a-c4b6-4c78-91ba-9d2e9b62468a tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Lock "cinder-quobyte-d4144cf9-c659-4c22-93f4-8a7c20e93dcb" acquired by "delete_volume" :: waited 0.020s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:14:36 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca75d39-cf7d-4712-89a8-acf06bde8874]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:14:36 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-7df6b52a-c4b6-4c78-91ba-9d2e9b62468a tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d4144cf9-c659-4c22-93f4-8a7c20e93dcb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:36 devstack sudo[90654]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:36 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-17034c8f-d074-4c9d-8c1d-a4472c472f21 tempest-SnapshotDependencyTests-404514513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9938e16c-504f-423c-b615-911808c2dcc5" returned: 0 in 0.549s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:36 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-17034c8f-d074-4c9d-8c1d-a4472c472f21 tempest-SnapshotDependencyTests-404514513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9938e16c-504f-423c-b615-911808c2dcc5 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:36 devstack sudo[90663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d4144cf9-c659-4c22-93f4-8a7c20e93dcb
Apr 15 20:14:36 devstack sudo[90663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:36 devstack sudo[90666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9938e16c-504f-423c-b615-911808c2dcc5
Apr 15 20:14:36 devstack sudo[90666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:36 devstack sudo[90655]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:36 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9" returned: 0 in 0.562s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:36 devstack cinder-volume[82646]: DEBUG cinder.utils [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] Path /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5b64ad3a-116f-44ee-8729-0276364de6d3 not found in is_blk_device check {{(pid=82646) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 15 20:14:36 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5b64ad3a-116f-44ee-8729-0276364de6d3 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:36 devstack sudo[90669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5b64ad3a-116f-44ee-8729-0276364de6d3
Apr 15 20:14:36 devstack sudo[90669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:36 devstack sudo[90663]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:36 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-7df6b52a-c4b6-4c78-91ba-9d2e9b62468a tempest-CreateVolumesFromSourceVolumeTest-430838871 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d4144cf9-c659-4c22-93f4-8a7c20e93dcb" returned: 0 in 0.556s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:36 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-7df6b52a-c4b6-4c78-91ba-9d2e9b62468a tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d4144cf9-c659-4c22-93f4-8a7c20e93dcb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:36 devstack sudo[90681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d4144cf9-c659-4c22-93f4-8a7c20e93dcb
Apr 15 20:14:36 devstack sudo[90681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:36 devstack sudo[90666]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:36 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-17034c8f-d074-4c9d-8c1d-a4472c472f21 tempest-SnapshotDependencyTests-404514513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-9938e16c-504f-423c-b615-911808c2dcc5" returned: 0 in 0.628s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:36 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-17034c8f-d074-4c9d-8c1d-a4472c472f21 tempest-SnapshotDependencyTests-404514513 None] Lock "cinder-quobyte-9938e16c-504f-423c-b615-911808c2dcc5" released by "delete_volume" :: held 1.221s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:14:36 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-17034c8f-d074-4c9d-8c1d-a4472c472f21 tempest-SnapshotDependencyTests-404514513 None] Created reservations ['2123763c-3af8-444f-a078-dc7fb9d2dc97', '6d99a69a-fc48-4c6a-be94-98cb5bbfb86f', 'b7516761-e848-40ae-a3d8-fa348fb83704', 'f4ea9c15-9214-4cd9-b01d-71dea6ce9e4d'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:14:37 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-17034c8f-d074-4c9d-8c1d-a4472c472f21 tempest-SnapshotDependencyTests-404514513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:14:37 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-17034c8f-d074-4c9d-8c1d-a4472c472f21 tempest-SnapshotDependencyTests-404514513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:14:37 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-17034c8f-d074-4c9d-8c1d-a4472c472f21 tempest-SnapshotDependencyTests-404514513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:14:37 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-17034c8f-d074-4c9d-8c1d-a4472c472f21 tempest-SnapshotDependencyTests-404514513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:14:37 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-17034c8f-d074-4c9d-8c1d-a4472c472f21 tempest-SnapshotDependencyTests-404514513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:14:37 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-17034c8f-d074-4c9d-8c1d-a4472c472f21 tempest-SnapshotDependencyTests-404514513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:37 devstack sudo[90687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:14:37 devstack sudo[90687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:38 devstack sudo[90681]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:38 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-7df6b52a-c4b6-4c78-91ba-9d2e9b62468a tempest-CreateVolumesFromSourceVolumeTest-430838871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-d4144cf9-c659-4c22-93f4-8a7c20e93dcb" returned: 0 in 1.445s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:38 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-7df6b52a-c4b6-4c78-91ba-9d2e9b62468a tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Lock "cinder-quobyte-d4144cf9-c659-4c22-93f4-8a7c20e93dcb" released by "delete_volume" :: held 2.045s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:14:38 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-7df6b52a-c4b6-4c78-91ba-9d2e9b62468a tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Created reservations ['5125194e-3141-4c9e-921b-06f432df7ba3', '631751de-2437-407a-ae32-ada520ae2807', '816fdcf8-4fe8-4096-81a6-e5612b725044', '255562fa-0fab-4835-acdb-7d55dd3e15a5'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:14:38 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-7df6b52a-c4b6-4c78-91ba-9d2e9b62468a tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:14:38 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-7df6b52a-c4b6-4c78-91ba-9d2e9b62468a tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:14:38 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-7df6b52a-c4b6-4c78-91ba-9d2e9b62468a tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:14:38 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-7df6b52a-c4b6-4c78-91ba-9d2e9b62468a tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:14:38 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-7df6b52a-c4b6-4c78-91ba-9d2e9b62468a tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:14:38 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-7df6b52a-c4b6-4c78-91ba-9d2e9b62468a tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:38 devstack sudo[90692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:14:38 devstack sudo[90692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:38 devstack sudo[90669]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:38 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5b64ad3a-116f-44ee-8729-0276364de6d3" returned: 0 in 2.454s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:38 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[320d304e-39ab-4a32-9b12-a19b509210ba]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:14:38 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:38 devstack sudo[90694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9
Apr 15 20:14:38 devstack sudo[90694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:38 devstack sudo[90687]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:38 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-17034c8f-d074-4c9d-8c1d-a4472c472f21 tempest-SnapshotDependencyTests-404514513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 1.722s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:38 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-17034c8f-d074-4c9d-8c1d-a4472c472f21 tempest-SnapshotDependencyTests-404514513 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:14:38 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-17034c8f-d074-4c9d-8c1d-a4472c472f21 tempest-SnapshotDependencyTests-404514513 None] Deleted volume successfully.
Apr 15 20:14:38 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-17034c8f-d074-4c9d-8c1d-a4472c472f21 tempest-SnapshotDependencyTests-404514513 None] Lock "cinder-9938e16c-504f-423c-b615-911808c2dcc5-delete_volume" released by "delete_volume" :: held 3.247s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:14:39 devstack sudo[90692]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:39 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-7df6b52a-c4b6-4c78-91ba-9d2e9b62468a tempest-CreateVolumesFromSourceVolumeTest-430838871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.549s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:39 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-7df6b52a-c4b6-4c78-91ba-9d2e9b62468a tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:14:39 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-7df6b52a-c4b6-4c78-91ba-9d2e9b62468a tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Deleted volume successfully.
Apr 15 20:14:39 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-7df6b52a-c4b6-4c78-91ba-9d2e9b62468a tempest-CreateVolumesFromSourceVolumeTest-430838871 None] Lock "cinder-d4144cf9-c659-4c22-93f4-8a7c20e93dcb-delete_volume" released by "delete_volume" :: held 3.075s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:14:39 devstack sudo[90694]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:39 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9" returned: 0 in 0.694s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:39 devstack cinder-volume[82646]: DEBUG cinder.image.image_utils [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] Image conversion details: src /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9, size 1024.00 MB, duration 2.46 sec, destination /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5b64ad3a-116f-44ee-8729-0276364de6d3 {{(pid=82646) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 20:14:39 devstack cinder-volume[82646]: INFO cinder.image.image_utils [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] Converted 1024.00 MB image at 417.03 MB/s
Apr 15 20:14:39 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5b64ad3a-116f-44ee-8729-0276364de6d3 is being set with open permissions: ugo+rw
Apr 15 20:14:39 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5b64ad3a-116f-44ee-8729-0276364de6d3 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:39 devstack sudo[90701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5b64ad3a-116f-44ee-8729-0276364de6d3
Apr 15 20:14:39 devstack sudo[90701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:39 devstack sudo[90701]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:39 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5b64ad3a-116f-44ee-8729-0276364de6d3" returned: 0 in 0.513s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:39 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] Lock "cinder-quobyte-5b64ad3a-116f-44ee-8729-0276364de6d3" released by "_copy_volume_from_snapshot" :: held 4.799s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:14:39 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] Acquiring lock "cinder-quobyte-edc4bb94-bf18-40d2-b3f3-0bb3d24e8b92" by "_delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:14:39 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] Lock "cinder-quobyte-edc4bb94-bf18-40d2-b3f3-0bb3d24e8b92" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:14:39 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] Deleting offline snapshot edc4bb94-bf18-40d2-b3f3-0bb3d24e8b92 of volume 46ce7964-295a-4e62-b8a1-5a21405f7ab9 {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 20:14:39 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] snapshot_file for this snap is: volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9.edc4bb94-bf18-40d2-b3f3-0bb3d24e8b92 {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 20:14:39 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[03cce42c-b020-46b4-8b99-9ff544c51df1]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:14:39 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9.edc4bb94-bf18-40d2-b3f3-0bb3d24e8b92 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:40 devstack sudo[90704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9.edc4bb94-bf18-40d2-b3f3-0bb3d24e8b92
Apr 15 20:14:40 devstack sudo[90704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:40 devstack sudo[90704]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:40 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9.edc4bb94-bf18-40d2-b3f3-0bb3d24e8b92" returned: 0 in 0.672s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:40 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82646) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 20:14:40 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9308be-d9a6-4b86-9343-bc529e1fcc30]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:14:40 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:40 devstack sudo[90710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9
Apr 15 20:14:40 devstack sudo[90710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:41 devstack sudo[90710]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:41 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9" returned: 0 in 0.533s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:41 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9.edc4bb94-bf18-40d2-b3f3-0bb3d24e8b92 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:41 devstack sudo[90715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9.edc4bb94-bf18-40d2-b3f3-0bb3d24e8b92
Apr 15 20:14:41 devstack sudo[90715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:41 devstack sudo[90715]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:41 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9.edc4bb94-bf18-40d2-b3f3-0bb3d24e8b92" returned: 0 in 0.467s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:41 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9.edc4bb94-bf18-40d2-b3f3-0bb3d24e8b92 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:41 devstack sudo[90720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9.edc4bb94-bf18-40d2-b3f3-0bb3d24e8b92
Apr 15 20:14:41 devstack sudo[90720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:42 devstack sudo[90720]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:42 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9.edc4bb94-bf18-40d2-b3f3-0bb3d24e8b92" returned: 0 in 0.473s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:42 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] Lock "cinder-quobyte-edc4bb94-bf18-40d2-b3f3-0bb3d24e8b92" released by "_delete_snapshot" :: held 2.206s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:14:42 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.343s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:14:42 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-84d0cc6f-402c-4098-9fa4-6ec7fb37ef67 tempest-CinderUnicodeTest-2085134074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.381s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:14:42 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-84d0cc6f-402c-4098-9fa4-6ec7fb37ef67 tempest-CinderUnicodeTest-2085134074 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fe168247d60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T18:14:32Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-172660488',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5be08271-fafd-4e23-8fbf-5fb650ba1422,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b53d9b55218543278a14cbe26834147d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:33Z,use_quota=True,user_id='b1cafaaf4286491cac8360733d3327ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c735fded-09a2-45d4-9e81-f53edc93b159),volume_type_id=c735fded-09a2-45d4-9e81-f53edc93b159)}" {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 20:14:42 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-84d0cc6f-402c-4098-9fa4-6ec7fb37ef67 tempest-CinderUnicodeTest-2085134074 None] Creating volume 5be08271-fafd-4e23-8fbf-5fb650ba1422 {{(pid=82646) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 20:14:42 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-84d0cc6f-402c-4098-9fa4-6ec7fb37ef67 tempest-CinderUnicodeTest-2085134074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:14:42 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-84d0cc6f-402c-4098-9fa4-6ec7fb37ef67 tempest-CinderUnicodeTest-2085134074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:14:42 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-84d0cc6f-402c-4098-9fa4-6ec7fb37ef67 tempest-CinderUnicodeTest-2085134074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:14:42 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-84d0cc6f-402c-4098-9fa4-6ec7fb37ef67 tempest-CinderUnicodeTest-2085134074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:14:42 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-84d0cc6f-402c-4098-9fa4-6ec7fb37ef67 tempest-CinderUnicodeTest-2085134074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:14:42 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-84d0cc6f-402c-4098-9fa4-6ec7fb37ef67 tempest-CinderUnicodeTest-2085134074 None] Selected osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450 as target Quobyte volume. {{(pid=82646) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 20:14:42 devstack cinder-volume[82646]: INFO cinder.volume.drivers.remotefs [None req-84d0cc6f-402c-4098-9fa4-6ec7fb37ef67 tempest-CinderUnicodeTest-2085134074 None] casted to osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450
Apr 15 20:14:42 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-84d0cc6f-402c-4098-9fa4-6ec7fb37ef67 tempest-CinderUnicodeTest-2085134074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5be08271-fafd-4e23-8fbf-5fb650ba1422 1073741824 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:42 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7e05527-7afc-4436-aef5-fbd5b9f88483) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b64ad3a-116f-44ee-8729-0276364de6d3', 'volume_size': 1, 'source_volid': '46ce7964-295a-4e62-b8a1-5a21405f7ab9', 'source_volstatus': 'available'}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:42 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (258e8e00-7a0f-4ef9-b1d5-05e8eb1d4908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:42 devstack sudo[90724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5be08271-fafd-4e23-8fbf-5fb650ba1422 1073741824
Apr 15 20:14:42 devstack sudo[90724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:42 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] Volume volume-5b64ad3a-116f-44ee-8729-0276364de6d3 (5b64ad3a-116f-44ee-8729-0276364de6d3): created successfully
Apr 15 20:14:42 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (258e8e00-7a0f-4ef9-b1d5-05e8eb1d4908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:42 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] Flow 'volume_create_manager' (a2145302-9fb7-4cb2-9cdd-59e137a2a6b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:14:42 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-41feb418-88b8-43fa-80ba-635c260bb0db tempest-VolumeDependencyTests-2146631135 None] Created volume successfully.
Apr 15 20:14:42 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-4849105a-aeac-4d17-9f8b-1656c3c0b03b tempest-VolumeDependencyTests-2146631135 None] Acquiring lock "cinder-46ce7964-295a-4e62-b8a1-5a21405f7ab9-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:14:42 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-4849105a-aeac-4d17-9f8b-1656c3c0b03b tempest-VolumeDependencyTests-2146631135 None] Lock "cinder-46ce7964-295a-4e62-b8a1-5a21405f7ab9-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:14:42 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-4849105a-aeac-4d17-9f8b-1656c3c0b03b tempest-VolumeDependencyTests-2146631135 None] Acquiring lock "cinder-quobyte-46ce7964-295a-4e62-b8a1-5a21405f7ab9" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:14:42 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-4849105a-aeac-4d17-9f8b-1656c3c0b03b tempest-VolumeDependencyTests-2146631135 None] Lock "cinder-quobyte-46ce7964-295a-4e62-b8a1-5a21405f7ab9" acquired by "delete_volume" :: waited 0.027s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:14:42 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf14cf47-8e04-4fa2-85f5-24b8c650fa52]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:14:42 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-4849105a-aeac-4d17-9f8b-1656c3c0b03b tempest-VolumeDependencyTests-2146631135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:42 devstack sudo[90727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9
Apr 15 20:14:42 devstack sudo[90727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:42 devstack sudo[90724]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:42 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-84d0cc6f-402c-4098-9fa4-6ec7fb37ef67 tempest-CinderUnicodeTest-2085134074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5be08271-fafd-4e23-8fbf-5fb650ba1422 1073741824" returned: 0 in 0.686s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:42 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-84d0cc6f-402c-4098-9fa4-6ec7fb37ef67 tempest-CinderUnicodeTest-2085134074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5be08271-fafd-4e23-8fbf-5fb650ba1422 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:42 devstack sudo[90731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5be08271-fafd-4e23-8fbf-5fb650ba1422
Apr 15 20:14:42 devstack sudo[90731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:43 devstack sudo[90727]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:43 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-4849105a-aeac-4d17-9f8b-1656c3c0b03b tempest-VolumeDependencyTests-2146631135 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9" returned: 0 in 0.643s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:43 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-4849105a-aeac-4d17-9f8b-1656c3c0b03b tempest-VolumeDependencyTests-2146631135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:43 devstack sudo[90738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9
Apr 15 20:14:43 devstack sudo[90738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:43 devstack sudo[90731]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:43 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-84d0cc6f-402c-4098-9fa4-6ec7fb37ef67 tempest-CinderUnicodeTest-2085134074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5be08271-fafd-4e23-8fbf-5fb650ba1422" returned: 0 in 0.520s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:43 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-84d0cc6f-402c-4098-9fa4-6ec7fb37ef67 tempest-CinderUnicodeTest-2085134074 None] <== create_volume: return (1237ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'} {{(pid=82646) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 20:14:43 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-84d0cc6f-402c-4098-9fa4-6ec7fb37ef67 tempest-CinderUnicodeTest-2085134074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.240s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:14:43 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-84d0cc6f-402c-4098-9fa4-6ec7fb37ef67 tempest-CinderUnicodeTest-2085134074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e30ace55-6cc8-49db-8773-d860d0505df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5be08271-fafd-4e23-8fbf-5fb650ba1422', 'volume_size': 1}' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:43 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-84d0cc6f-402c-4098-9fa4-6ec7fb37ef67 tempest-CinderUnicodeTest-2085134074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b986f1a1-816e-495f-b370-82ba7f37e681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 20:14:43 devstack cinder-volume[82646]: INFO cinder.volume.flows.manager.create_volume [None req-84d0cc6f-402c-4098-9fa4-6ec7fb37ef67 tempest-CinderUnicodeTest-2085134074 None] Volume volume-5be08271-fafd-4e23-8fbf-5fb650ba1422 (5be08271-fafd-4e23-8fbf-5fb650ba1422): created successfully
Apr 15 20:14:43 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-84d0cc6f-402c-4098-9fa4-6ec7fb37ef67 tempest-CinderUnicodeTest-2085134074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b986f1a1-816e-495f-b370-82ba7f37e681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82646) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 20:14:43 devstack cinder-volume[82646]: DEBUG cinder.volume.manager [None req-84d0cc6f-402c-4098-9fa4-6ec7fb37ef67 tempest-CinderUnicodeTest-2085134074 None] Flow 'volume_create_manager' (7795f5bf-f681-4901-a920-d8bc591c6133) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82646) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 20:14:43 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-84d0cc6f-402c-4098-9fa4-6ec7fb37ef67 tempest-CinderUnicodeTest-2085134074 None] Created volume successfully.
Apr 15 20:14:43 devstack sudo[90738]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:43 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-4849105a-aeac-4d17-9f8b-1656c3c0b03b tempest-VolumeDependencyTests-2146631135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-46ce7964-295a-4e62-b8a1-5a21405f7ab9" returned: 0 in 0.461s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:43 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-4849105a-aeac-4d17-9f8b-1656c3c0b03b tempest-VolumeDependencyTests-2146631135 None] Lock "cinder-quobyte-46ce7964-295a-4e62-b8a1-5a21405f7ab9" released by "delete_volume" :: held 1.140s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:14:43 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-4849105a-aeac-4d17-9f8b-1656c3c0b03b tempest-VolumeDependencyTests-2146631135 None] Created reservations ['ea79f1d3-c037-4350-9ebd-11afa6c49363', 'dc768b96-332a-4c50-8c85-adcd44bbcbee', '4a84d739-34de-4e22-b1a8-995970b08f4a', '570e94ac-1753-4075-86de-43cee934e1f1'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:14:43 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-4849105a-aeac-4d17-9f8b-1656c3c0b03b tempest-VolumeDependencyTests-2146631135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:14:43 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-4849105a-aeac-4d17-9f8b-1656c3c0b03b tempest-VolumeDependencyTests-2146631135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:14:43 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-4849105a-aeac-4d17-9f8b-1656c3c0b03b tempest-VolumeDependencyTests-2146631135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:14:43 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-4849105a-aeac-4d17-9f8b-1656c3c0b03b tempest-VolumeDependencyTests-2146631135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:14:43 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-4849105a-aeac-4d17-9f8b-1656c3c0b03b tempest-VolumeDependencyTests-2146631135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:14:43 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-4849105a-aeac-4d17-9f8b-1656c3c0b03b tempest-VolumeDependencyTests-2146631135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:43 devstack sudo[90743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:14:43 devstack sudo[90743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:44 devstack sudo[90743]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:44 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-4849105a-aeac-4d17-9f8b-1656c3c0b03b tempest-VolumeDependencyTests-2146631135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.526s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:44 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-4849105a-aeac-4d17-9f8b-1656c3c0b03b tempest-VolumeDependencyTests-2146631135 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:14:44 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-4849105a-aeac-4d17-9f8b-1656c3c0b03b tempest-VolumeDependencyTests-2146631135 None] Deleted volume successfully.
Apr 15 20:14:44 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-4849105a-aeac-4d17-9f8b-1656c3c0b03b tempest-VolumeDependencyTests-2146631135 None] Lock "cinder-46ce7964-295a-4e62-b8a1-5a21405f7ab9-delete_volume" released by "delete_volume" :: held 1.833s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:14:44 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-6dbcbca0-4534-41e8-9399-f2b65876093a tempest-CinderUnicodeTest-2085134074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:14:44 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-6dbcbca0-4534-41e8-9399-f2b65876093a tempest-CinderUnicodeTest-2085134074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:14:44 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-6dbcbca0-4534-41e8-9399-f2b65876093a tempest-CinderUnicodeTest-2085134074 None] Creating offline snapshot 9040bc56-b91f-4e61-8ac8-022de54970d2 of volume 5be08271-fafd-4e23-8fbf-5fb650ba1422 {{(pid=82646) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 20:14:44 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-186ac456-e960-43bb-b38f-c5878491bcd8 tempest-VolumeDependencyTests-2146631135 None] Acquiring lock "cinder-5b64ad3a-116f-44ee-8729-0276364de6d3-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:14:44 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0bef31c-25e9-40a3-a007-15c63aeb9f44]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:14:44 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6dbcbca0-4534-41e8-9399-f2b65876093a tempest-CinderUnicodeTest-2085134074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5be08271-fafd-4e23-8fbf-5fb650ba1422 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:44 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-186ac456-e960-43bb-b38f-c5878491bcd8 tempest-VolumeDependencyTests-2146631135 None] Lock "cinder-5b64ad3a-116f-44ee-8729-0276364de6d3-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:14:44 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-186ac456-e960-43bb-b38f-c5878491bcd8 tempest-VolumeDependencyTests-2146631135 None] Acquiring lock "cinder-quobyte-5b64ad3a-116f-44ee-8729-0276364de6d3" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:14:44 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-186ac456-e960-43bb-b38f-c5878491bcd8 tempest-VolumeDependencyTests-2146631135 None] Lock "cinder-quobyte-5b64ad3a-116f-44ee-8729-0276364de6d3" acquired by "delete_volume" :: waited 0.008s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:14:44 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[129d0df7-94dd-4974-8db3-2d9727abd382]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:14:44 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-186ac456-e960-43bb-b38f-c5878491bcd8 tempest-VolumeDependencyTests-2146631135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5b64ad3a-116f-44ee-8729-0276364de6d3 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:44 devstack sudo[90778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5be08271-fafd-4e23-8fbf-5fb650ba1422
Apr 15 20:14:44 devstack sudo[90778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:44 devstack sudo[90782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5b64ad3a-116f-44ee-8729-0276364de6d3
Apr 15 20:14:44 devstack sudo[90782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:45 devstack sudo[90778]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:45 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6dbcbca0-4534-41e8-9399-f2b65876093a tempest-CinderUnicodeTest-2085134074 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5be08271-fafd-4e23-8fbf-5fb650ba1422" returned: 0 in 0.606s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:45 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6dbcbca0-4534-41e8-9399-f2b65876093a tempest-CinderUnicodeTest-2085134074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5be08271-fafd-4e23-8fbf-5fb650ba1422,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5be08271-fafd-4e23-8fbf-5fb650ba1422.9040bc56-b91f-4e61-8ac8-022de54970d2 1G {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:45 devstack sudo[90789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5be08271-fafd-4e23-8fbf-5fb650ba1422,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5be08271-fafd-4e23-8fbf-5fb650ba1422.9040bc56-b91f-4e61-8ac8-022de54970d2 1G
Apr 15 20:14:45 devstack sudo[90789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:45 devstack sudo[90782]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:45 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-186ac456-e960-43bb-b38f-c5878491bcd8 tempest-VolumeDependencyTests-2146631135 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5b64ad3a-116f-44ee-8729-0276364de6d3" returned: 0 in 0.604s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:45 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-186ac456-e960-43bb-b38f-c5878491bcd8 tempest-VolumeDependencyTests-2146631135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5b64ad3a-116f-44ee-8729-0276364de6d3 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:45 devstack sudo[90793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5b64ad3a-116f-44ee-8729-0276364de6d3
Apr 15 20:14:45 devstack sudo[90793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:45 devstack sudo[90789]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:45 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6dbcbca0-4534-41e8-9399-f2b65876093a tempest-CinderUnicodeTest-2085134074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5be08271-fafd-4e23-8fbf-5fb650ba1422,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5be08271-fafd-4e23-8fbf-5fb650ba1422.9040bc56-b91f-4e61-8ac8-022de54970d2 1G" returned: 0 in 0.634s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:45 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6dbcbca0-4534-41e8-9399-f2b65876093a tempest-CinderUnicodeTest-2085134074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5be08271-fafd-4e23-8fbf-5fb650ba1422 -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5be08271-fafd-4e23-8fbf-5fb650ba1422.9040bc56-b91f-4e61-8ac8-022de54970d2 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:45 devstack sudo[90793]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:45 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-186ac456-e960-43bb-b38f-c5878491bcd8 tempest-VolumeDependencyTests-2146631135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5b64ad3a-116f-44ee-8729-0276364de6d3" returned: 0 in 0.523s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:45 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-186ac456-e960-43bb-b38f-c5878491bcd8 tempest-VolumeDependencyTests-2146631135 None] Lock "cinder-quobyte-5b64ad3a-116f-44ee-8729-0276364de6d3" released by "delete_volume" :: held 1.172s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:14:45 devstack sudo[90799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5be08271-fafd-4e23-8fbf-5fb650ba1422 -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5be08271-fafd-4e23-8fbf-5fb650ba1422.9040bc56-b91f-4e61-8ac8-022de54970d2
Apr 15 20:14:45 devstack sudo[90799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:46 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-186ac456-e960-43bb-b38f-c5878491bcd8 tempest-VolumeDependencyTests-2146631135 None] Created reservations ['42fcbb92-1e2b-49d8-ab62-11437cf6c259', '623390d2-9764-49b1-8915-19efda2b1a49', '8404b522-3b4e-41db-9a06-c31adb3d9acb', 'ff94288b-edce-4a51-a0b7-ed1effc89df5'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:14:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-186ac456-e960-43bb-b38f-c5878491bcd8 tempest-VolumeDependencyTests-2146631135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:14:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-186ac456-e960-43bb-b38f-c5878491bcd8 tempest-VolumeDependencyTests-2146631135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:14:46 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-186ac456-e960-43bb-b38f-c5878491bcd8 tempest-VolumeDependencyTests-2146631135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:14:46 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-186ac456-e960-43bb-b38f-c5878491bcd8 tempest-VolumeDependencyTests-2146631135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:14:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-186ac456-e960-43bb-b38f-c5878491bcd8 tempest-VolumeDependencyTests-2146631135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:14:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-186ac456-e960-43bb-b38f-c5878491bcd8 tempest-VolumeDependencyTests-2146631135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:46 devstack sudo[90802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:14:46 devstack sudo[90802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:46 devstack sudo[90799]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6dbcbca0-4534-41e8-9399-f2b65876093a tempest-CinderUnicodeTest-2085134074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5be08271-fafd-4e23-8fbf-5fb650ba1422 -F qcow2 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5be08271-fafd-4e23-8fbf-5fb650ba1422.9040bc56-b91f-4e61-8ac8-022de54970d2" returned: 0 in 0.469s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:46 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-6dbcbca0-4534-41e8-9399-f2b65876093a tempest-CinderUnicodeTest-2085134074 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5be08271-fafd-4e23-8fbf-5fb650ba1422.9040bc56-b91f-4e61-8ac8-022de54970d2 is being set with open permissions: ugo+rw
Apr 15 20:14:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6dbcbca0-4534-41e8-9399-f2b65876093a tempest-CinderUnicodeTest-2085134074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5be08271-fafd-4e23-8fbf-5fb650ba1422.9040bc56-b91f-4e61-8ac8-022de54970d2 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:46 devstack sudo[90807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5be08271-fafd-4e23-8fbf-5fb650ba1422.9040bc56-b91f-4e61-8ac8-022de54970d2
Apr 15 20:14:46 devstack sudo[90807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:46 devstack sudo[90802]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-186ac456-e960-43bb-b38f-c5878491bcd8 tempest-VolumeDependencyTests-2146631135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.478s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:46 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-186ac456-e960-43bb-b38f-c5878491bcd8 tempest-VolumeDependencyTests-2146631135 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:14:46 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-186ac456-e960-43bb-b38f-c5878491bcd8 tempest-VolumeDependencyTests-2146631135 None] Deleted volume successfully.
Apr 15 20:14:46 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-186ac456-e960-43bb-b38f-c5878491bcd8 tempest-VolumeDependencyTests-2146631135 None] Lock "cinder-5b64ad3a-116f-44ee-8729-0276364de6d3-delete_volume" released by "delete_volume" :: held 1.812s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:14:46 devstack sudo[90807]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6dbcbca0-4534-41e8-9399-f2b65876093a tempest-CinderUnicodeTest-2085134074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5be08271-fafd-4e23-8fbf-5fb650ba1422.9040bc56-b91f-4e61-8ac8-022de54970d2" returned: 0 in 0.452s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:46 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6dbcbca0-4534-41e8-9399-f2b65876093a tempest-CinderUnicodeTest-2085134074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5be08271-fafd-4e23-8fbf-5fb650ba1422.info {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:46 devstack sudo[90811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5be08271-fafd-4e23-8fbf-5fb650ba1422.info
Apr 15 20:14:46 devstack sudo[90811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:46 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-bcbed3f2-4341-4dec-ba06-94aed2e5d9f6 tempest-VolumeDependencyTests-2146631135 None] Acquiring lock "cinder-6ff267a1-912d-4e38-a419-867191f84b15-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:14:46 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-bcbed3f2-4341-4dec-ba06-94aed2e5d9f6 tempest-VolumeDependencyTests-2146631135 None] Lock "cinder-6ff267a1-912d-4e38-a419-867191f84b15-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:14:47 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-bcbed3f2-4341-4dec-ba06-94aed2e5d9f6 tempest-VolumeDependencyTests-2146631135 None] Acquiring lock "cinder-quobyte-6ff267a1-912d-4e38-a419-867191f84b15" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:14:47 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-bcbed3f2-4341-4dec-ba06-94aed2e5d9f6 tempest-VolumeDependencyTests-2146631135 None] Lock "cinder-quobyte-6ff267a1-912d-4e38-a419-867191f84b15" acquired by "delete_volume" :: waited 0.010s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:14:47 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[77fe1c11-0d78-4f4b-8cb5-19f5c54946fa]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:14:47 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bcbed3f2-4341-4dec-ba06-94aed2e5d9f6 tempest-VolumeDependencyTests-2146631135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6ff267a1-912d-4e38-a419-867191f84b15 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:47 devstack sudo[90813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6ff267a1-912d-4e38-a419-867191f84b15
Apr 15 20:14:47 devstack sudo[90813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:47 devstack sudo[90811]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:47 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6dbcbca0-4534-41e8-9399-f2b65876093a tempest-CinderUnicodeTest-2085134074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5be08271-fafd-4e23-8fbf-5fb650ba1422.info" returned: 0 in 0.422s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:47 devstack cinder-volume[82646]: WARNING cinder.volume.drivers.remotefs [None req-6dbcbca0-4534-41e8-9399-f2b65876093a tempest-CinderUnicodeTest-2085134074 None] /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5be08271-fafd-4e23-8fbf-5fb650ba1422.info is being set with open permissions: ugo+rw
Apr 15 20:14:47 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6dbcbca0-4534-41e8-9399-f2b65876093a tempest-CinderUnicodeTest-2085134074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5be08271-fafd-4e23-8fbf-5fb650ba1422.info {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:47 devstack sudo[90816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5be08271-fafd-4e23-8fbf-5fb650ba1422.info
Apr 15 20:14:47 devstack sudo[90816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:47 devstack sudo[90813]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:47 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bcbed3f2-4341-4dec-ba06-94aed2e5d9f6 tempest-VolumeDependencyTests-2146631135 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6ff267a1-912d-4e38-a419-867191f84b15" returned: 0 in 0.444s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:47 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bcbed3f2-4341-4dec-ba06-94aed2e5d9f6 tempest-VolumeDependencyTests-2146631135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6ff267a1-912d-4e38-a419-867191f84b15 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:47 devstack sudo[90821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6ff267a1-912d-4e38-a419-867191f84b15
Apr 15 20:14:47 devstack sudo[90821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:47 devstack sudo[90816]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:47 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6dbcbca0-4534-41e8-9399-f2b65876093a tempest-CinderUnicodeTest-2085134074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5be08271-fafd-4e23-8fbf-5fb650ba1422.info" returned: 0 in 0.438s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:47 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-6dbcbca0-4534-41e8-9399-f2b65876093a tempest-CinderUnicodeTest-2085134074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.109s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:14:47 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-6dbcbca0-4534-41e8-9399-f2b65876093a tempest-CinderUnicodeTest-2085134074 None] Create snapshot completed successfully
Apr 15 20:14:47 devstack sudo[90821]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:47 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bcbed3f2-4341-4dec-ba06-94aed2e5d9f6 tempest-VolumeDependencyTests-2146631135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-6ff267a1-912d-4e38-a419-867191f84b15" returned: 0 in 0.417s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:47 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-bcbed3f2-4341-4dec-ba06-94aed2e5d9f6 tempest-VolumeDependencyTests-2146631135 None] Lock "cinder-quobyte-6ff267a1-912d-4e38-a419-867191f84b15" released by "delete_volume" :: held 0.882s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:14:47 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-bcbed3f2-4341-4dec-ba06-94aed2e5d9f6 tempest-VolumeDependencyTests-2146631135 None] Created reservations ['be302d9d-56b1-4a95-b303-9f174bd7c0ff', '9b653f46-c15b-490c-8eed-4be1502249cc', '64916979-8a3d-447d-b5f5-69d5cb38df30', '6c5db3e4-1938-4baf-b1fb-a11a16e44f5f'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:14:47 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-bcbed3f2-4341-4dec-ba06-94aed2e5d9f6 tempest-VolumeDependencyTests-2146631135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:14:47 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-bcbed3f2-4341-4dec-ba06-94aed2e5d9f6 tempest-VolumeDependencyTests-2146631135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:14:47 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-bcbed3f2-4341-4dec-ba06-94aed2e5d9f6 tempest-VolumeDependencyTests-2146631135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:14:47 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-bcbed3f2-4341-4dec-ba06-94aed2e5d9f6 tempest-VolumeDependencyTests-2146631135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:14:47 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-bcbed3f2-4341-4dec-ba06-94aed2e5d9f6 tempest-VolumeDependencyTests-2146631135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:14:47 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bcbed3f2-4341-4dec-ba06-94aed2e5d9f6 tempest-VolumeDependencyTests-2146631135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:47 devstack sudo[90825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:14:47 devstack sudo[90825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:48 devstack sudo[90825]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-bcbed3f2-4341-4dec-ba06-94aed2e5d9f6 tempest-VolumeDependencyTests-2146631135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.491s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:48 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-bcbed3f2-4341-4dec-ba06-94aed2e5d9f6 tempest-VolumeDependencyTests-2146631135 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:14:48 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-bcbed3f2-4341-4dec-ba06-94aed2e5d9f6 tempest-VolumeDependencyTests-2146631135 None] Deleted volume successfully.
Apr 15 20:14:48 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-bcbed3f2-4341-4dec-ba06-94aed2e5d9f6 tempest-VolumeDependencyTests-2146631135 None] Lock "cinder-6ff267a1-912d-4e38-a419-867191f84b15-delete_volume" released by "delete_volume" :: held 1.499s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:14:48 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-3f4bce84-2c6b-4b94-9b8d-332673a5c06e tempest-CinderUnicodeTest-2085134074 None] Acquiring lock "cinder-9040bc56-b91f-4e61-8ac8-022de54970d2-delete_snapshot" by "delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:14:48 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-3f4bce84-2c6b-4b94-9b8d-332673a5c06e tempest-CinderUnicodeTest-2085134074 None] Lock "cinder-9040bc56-b91f-4e61-8ac8-022de54970d2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:14:48 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-3f4bce84-2c6b-4b94-9b8d-332673a5c06e tempest-CinderUnicodeTest-2085134074 None] Acquiring lock "cinder-quobyte-5be08271-fafd-4e23-8fbf-5fb650ba1422" by "delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:14:48 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-3f4bce84-2c6b-4b94-9b8d-332673a5c06e tempest-CinderUnicodeTest-2085134074 None] Lock "cinder-quobyte-5be08271-fafd-4e23-8fbf-5fb650ba1422" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:14:48 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-3f4bce84-2c6b-4b94-9b8d-332673a5c06e tempest-CinderUnicodeTest-2085134074 None] Acquiring lock "cinder-quobyte-9040bc56-b91f-4e61-8ac8-022de54970d2" by "_delete_snapshot" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:14:48 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-3f4bce84-2c6b-4b94-9b8d-332673a5c06e tempest-CinderUnicodeTest-2085134074 None] Lock "cinder-quobyte-9040bc56-b91f-4e61-8ac8-022de54970d2" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:14:48 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-3f4bce84-2c6b-4b94-9b8d-332673a5c06e tempest-CinderUnicodeTest-2085134074 None] Deleting offline snapshot 9040bc56-b91f-4e61-8ac8-022de54970d2 of volume 5be08271-fafd-4e23-8fbf-5fb650ba1422 {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 20:14:48 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-3f4bce84-2c6b-4b94-9b8d-332673a5c06e tempest-CinderUnicodeTest-2085134074 None] snapshot_file for this snap is: volume-5be08271-fafd-4e23-8fbf-5fb650ba1422.9040bc56-b91f-4e61-8ac8-022de54970d2 {{(pid=82646) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 20:14:48 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2d5f57-f2e4-4271-b67f-3edcefe180fb]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:14:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-3f4bce84-2c6b-4b94-9b8d-332673a5c06e tempest-CinderUnicodeTest-2085134074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5be08271-fafd-4e23-8fbf-5fb650ba1422.9040bc56-b91f-4e61-8ac8-022de54970d2 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:48 devstack cinder-volume[82646]: DEBUG oslo_service.periodic_task [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 15 20:14:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:14:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:14:48 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:14:48 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:14:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:14:48 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:48 devstack sudo[90829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:14:48 devstack sudo[90829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:48 devstack sudo[90828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5be08271-fafd-4e23-8fbf-5fb650ba1422.9040bc56-b91f-4e61-8ac8-022de54970d2
Apr 15 20:14:48 devstack sudo[90828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:49 devstack sudo[90829]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:49 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.436s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:49 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-cf6fb0ac-ba0d-44f0-a556-161e33ffa641 None None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:14:49 devstack sudo[90828]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:49 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-3f4bce84-2c6b-4b94-9b8d-332673a5c06e tempest-CinderUnicodeTest-2085134074 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5be08271-fafd-4e23-8fbf-5fb650ba1422.9040bc56-b91f-4e61-8ac8-022de54970d2" returned: 0 in 0.529s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:49 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.remotefs [None req-3f4bce84-2c6b-4b94-9b8d-332673a5c06e tempest-CinderUnicodeTest-2085134074 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5be08271-fafd-4e23-8fbf-5fb650ba1422(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82646) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 20:14:49 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe24736-36be-445f-8b83-b9a9dcd22009]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:14:49 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-3f4bce84-2c6b-4b94-9b8d-332673a5c06e tempest-CinderUnicodeTest-2085134074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5be08271-fafd-4e23-8fbf-5fb650ba1422 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:49 devstack sudo[90836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5be08271-fafd-4e23-8fbf-5fb650ba1422
Apr 15 20:14:49 devstack sudo[90836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:49 devstack sudo[90836]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:49 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-3f4bce84-2c6b-4b94-9b8d-332673a5c06e tempest-CinderUnicodeTest-2085134074 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5be08271-fafd-4e23-8fbf-5fb650ba1422" returned: 0 in 0.502s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:49 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-3f4bce84-2c6b-4b94-9b8d-332673a5c06e tempest-CinderUnicodeTest-2085134074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5be08271-fafd-4e23-8fbf-5fb650ba1422.9040bc56-b91f-4e61-8ac8-022de54970d2 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:49 devstack sudo[90841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5be08271-fafd-4e23-8fbf-5fb650ba1422.9040bc56-b91f-4e61-8ac8-022de54970d2
Apr 15 20:14:49 devstack sudo[90841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:50 devstack sudo[90841]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:50 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-3f4bce84-2c6b-4b94-9b8d-332673a5c06e tempest-CinderUnicodeTest-2085134074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5be08271-fafd-4e23-8fbf-5fb650ba1422.9040bc56-b91f-4e61-8ac8-022de54970d2" returned: 0 in 0.431s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:50 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-3f4bce84-2c6b-4b94-9b8d-332673a5c06e tempest-CinderUnicodeTest-2085134074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5be08271-fafd-4e23-8fbf-5fb650ba1422.9040bc56-b91f-4e61-8ac8-022de54970d2 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:50 devstack sudo[90846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5be08271-fafd-4e23-8fbf-5fb650ba1422.9040bc56-b91f-4e61-8ac8-022de54970d2
Apr 15 20:14:50 devstack sudo[90846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:50 devstack sudo[90846]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:50 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-3f4bce84-2c6b-4b94-9b8d-332673a5c06e tempest-CinderUnicodeTest-2085134074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5be08271-fafd-4e23-8fbf-5fb650ba1422.9040bc56-b91f-4e61-8ac8-022de54970d2" returned: 0 in 0.413s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:50 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-3f4bce84-2c6b-4b94-9b8d-332673a5c06e tempest-CinderUnicodeTest-2085134074 None] Lock "cinder-quobyte-9040bc56-b91f-4e61-8ac8-022de54970d2" released by "_delete_snapshot" :: held 1.940s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:14:50 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-3f4bce84-2c6b-4b94-9b8d-332673a5c06e tempest-CinderUnicodeTest-2085134074 None] Lock "cinder-quobyte-5be08271-fafd-4e23-8fbf-5fb650ba1422" released by "delete_snapshot" :: held 1.951s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:14:50 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-3f4bce84-2c6b-4b94-9b8d-332673a5c06e tempest-CinderUnicodeTest-2085134074 None] Created reservations ['ce26cb4f-26a0-4532-9d24-dbdbb96aad8c', '7f6e9d90-0441-474f-80c2-6378f584b638', '72232f89-f5f5-4338-a92d-fbd4ce4a57f7', '7b4a8930-b1b9-4dd0-9999-a1da6501bd83'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:14:50 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-3f4bce84-2c6b-4b94-9b8d-332673a5c06e tempest-CinderUnicodeTest-2085134074 None] Delete snapshot completed successfully.
Apr 15 20:14:50 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-3f4bce84-2c6b-4b94-9b8d-332673a5c06e tempest-CinderUnicodeTest-2085134074 None] Lock "cinder-9040bc56-b91f-4e61-8ac8-022de54970d2-delete_snapshot" released by "delete_snapshot" :: held 2.057s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:14:50 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-6ce91455-4844-410a-949d-b7665d4b71a7 tempest-CinderUnicodeTest-2085134074 None] Acquiring lock "cinder-5be08271-fafd-4e23-8fbf-5fb650ba1422-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:14:50 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-6ce91455-4844-410a-949d-b7665d4b71a7 tempest-CinderUnicodeTest-2085134074 None] Lock "cinder-5be08271-fafd-4e23-8fbf-5fb650ba1422-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:14:50 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-6ce91455-4844-410a-949d-b7665d4b71a7 tempest-CinderUnicodeTest-2085134074 None] Acquiring lock "cinder-quobyte-5be08271-fafd-4e23-8fbf-5fb650ba1422" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:14:51 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-6ce91455-4844-410a-949d-b7665d4b71a7 tempest-CinderUnicodeTest-2085134074 None] Lock "cinder-quobyte-5be08271-fafd-4e23-8fbf-5fb650ba1422" acquired by "delete_volume" :: waited 0.010s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:14:51 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[4962069e-9bb9-4ae9-8870-774f8c2ee495]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:14:51 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6ce91455-4844-410a-949d-b7665d4b71a7 tempest-CinderUnicodeTest-2085134074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5be08271-fafd-4e23-8fbf-5fb650ba1422 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:51 devstack sudo[90849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5be08271-fafd-4e23-8fbf-5fb650ba1422
Apr 15 20:14:51 devstack sudo[90849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:51 devstack sudo[90849]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:51 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6ce91455-4844-410a-949d-b7665d4b71a7 tempest-CinderUnicodeTest-2085134074 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5be08271-fafd-4e23-8fbf-5fb650ba1422" returned: 0 in 0.509s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:51 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6ce91455-4844-410a-949d-b7665d4b71a7 tempest-CinderUnicodeTest-2085134074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5be08271-fafd-4e23-8fbf-5fb650ba1422 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:51 devstack sudo[90854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5be08271-fafd-4e23-8fbf-5fb650ba1422
Apr 15 20:14:51 devstack sudo[90854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:51 devstack sudo[90854]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:51 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6ce91455-4844-410a-949d-b7665d4b71a7 tempest-CinderUnicodeTest-2085134074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-5be08271-fafd-4e23-8fbf-5fb650ba1422" returned: 0 in 0.455s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:51 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-6ce91455-4844-410a-949d-b7665d4b71a7 tempest-CinderUnicodeTest-2085134074 None] Lock "cinder-quobyte-5be08271-fafd-4e23-8fbf-5fb650ba1422" released by "delete_volume" :: held 0.994s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:14:52 devstack cinder-volume[82646]: DEBUG dbcounter [-] [82646] Writing DB stats cinder:INSERT=76,cinder:UPDATE=285,cinder:DELETE=27,cinder:SELECT=207 {{(pid=82646) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 20:14:52 devstack cinder-volume[82646]: DEBUG dbcounter [-] [82646] Writing DB stats cinder:UPDATE=268,cinder:DELETE=23,cinder:SELECT=187,cinder:INSERT=58 {{(pid=82646) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 20:14:52 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-6ce91455-4844-410a-949d-b7665d4b71a7 tempest-CinderUnicodeTest-2085134074 None] Created reservations ['d962ef62-8bd0-431b-b59e-3920d12b4555', '3653d501-aa14-4032-ae64-17d34f2fc9a6', '880a8d0b-6e29-4b9b-8c72-448e54a5415e', 'bc22e490-1ff9-4212-bbc0-552b10bf139f'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:14:52 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-6ce91455-4844-410a-949d-b7665d4b71a7 tempest-CinderUnicodeTest-2085134074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:14:52 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-6ce91455-4844-410a-949d-b7665d4b71a7 tempest-CinderUnicodeTest-2085134074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:14:52 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-6ce91455-4844-410a-949d-b7665d4b71a7 tempest-CinderUnicodeTest-2085134074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:14:52 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-6ce91455-4844-410a-949d-b7665d4b71a7 tempest-CinderUnicodeTest-2085134074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:14:52 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-6ce91455-4844-410a-949d-b7665d4b71a7 tempest-CinderUnicodeTest-2085134074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:14:52 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6ce91455-4844-410a-949d-b7665d4b71a7 tempest-CinderUnicodeTest-2085134074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:52 devstack sudo[90857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:14:52 devstack sudo[90857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:52 devstack sudo[90857]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:52 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-6ce91455-4844-410a-949d-b7665d4b71a7 tempest-CinderUnicodeTest-2085134074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.407s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:52 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-6ce91455-4844-410a-949d-b7665d4b71a7 tempest-CinderUnicodeTest-2085134074 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:14:52 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-6ce91455-4844-410a-949d-b7665d4b71a7 tempest-CinderUnicodeTest-2085134074 None] Deleted volume successfully.
Apr 15 20:14:52 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-6ce91455-4844-410a-949d-b7665d4b71a7 tempest-CinderUnicodeTest-2085134074 None] Lock "cinder-5be08271-fafd-4e23-8fbf-5fb650ba1422-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:14:53 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-9c121e05-f8aa-4726-b392-d3ce8a9a56ba tempest-CinderUnicodeTest-2085134074 None] Acquiring lock "cinder-b7b1b2f0-afc4-4e0a-8458-3fa7f941f951-delete_volume" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:14:53 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-9c121e05-f8aa-4726-b392-d3ce8a9a56ba tempest-CinderUnicodeTest-2085134074 None] Lock "cinder-b7b1b2f0-afc4-4e0a-8458-3fa7f941f951-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:14:53 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-9c121e05-f8aa-4726-b392-d3ce8a9a56ba tempest-CinderUnicodeTest-2085134074 None] Acquiring lock "cinder-quobyte-b7b1b2f0-afc4-4e0a-8458-3fa7f941f951" by "delete_volume" {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 20:14:53 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-9c121e05-f8aa-4726-b392-d3ce8a9a56ba tempest-CinderUnicodeTest-2085134074 None] Lock "cinder-quobyte-b7b1b2f0-afc4-4e0a-8458-3fa7f941f951" acquired by "delete_volume" :: waited 0.012s {{(pid=82646) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 20:14:53 devstack cinder-volume[82646]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6d2f18-ac03-4025-a32a-f0316a1f209b]: (4, 'qcow2') {{(pid=83652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 20:14:53 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-9c121e05-f8aa-4726-b392-d3ce8a9a56ba tempest-CinderUnicodeTest-2085134074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b7b1b2f0-afc4-4e0a-8458-3fa7f941f951 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:53 devstack sudo[90860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b7b1b2f0-afc4-4e0a-8458-3fa7f941f951
Apr 15 20:14:53 devstack sudo[90860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:53 devstack sudo[90860]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:53 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-9c121e05-f8aa-4726-b392-d3ce8a9a56ba tempest-CinderUnicodeTest-2085134074 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b7b1b2f0-afc4-4e0a-8458-3fa7f941f951" returned: 0 in 0.516s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:53 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-9c121e05-f8aa-4726-b392-d3ce8a9a56ba tempest-CinderUnicodeTest-2085134074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b7b1b2f0-afc4-4e0a-8458-3fa7f941f951 {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:53 devstack sudo[90865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b7b1b2f0-afc4-4e0a-8458-3fa7f941f951
Apr 15 20:14:53 devstack sudo[90865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:54 devstack sudo[90865]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:54 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-9c121e05-f8aa-4726-b392-d3ce8a9a56ba tempest-CinderUnicodeTest-2085134074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb/volume-b7b1b2f0-afc4-4e0a-8458-3fa7f941f951" returned: 0 in 0.460s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:54 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-9c121e05-f8aa-4726-b392-d3ce8a9a56ba tempest-CinderUnicodeTest-2085134074 None] Lock "cinder-quobyte-b7b1b2f0-afc4-4e0a-8458-3fa7f941f951" released by "delete_volume" :: held 0.997s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:14:54 devstack cinder-volume[82646]: DEBUG cinder.quota [None req-9c121e05-f8aa-4726-b392-d3ce8a9a56ba tempest-CinderUnicodeTest-2085134074 None] Created reservations ['014449ba-c044-45d0-818d-fa08388ea30b', '743725a5-a357-4077-9d36-75883bcc3fdf', 'df4dbaa8-3002-4bc1-97eb-83d7514675f1', '53af14f4-1563-4d14-869d-b1f386c8e0ce'] {{(pid=82646) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 20:14:54 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-9c121e05-f8aa-4726-b392-d3ce8a9a56ba tempest-CinderUnicodeTest-2085134074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 20:14:54 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-9c121e05-f8aa-4726-b392-d3ce8a9a56ba tempest-CinderUnicodeTest-2085134074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 20:14:54 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-9c121e05-f8aa-4726-b392-d3ce8a9a56ba tempest-CinderUnicodeTest-2085134074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450': None} {{(pid=82646) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 20:14:54 devstack cinder-volume[82646]: DEBUG cinder.volume.drivers.quobyte [None req-9c121e05-f8aa-4726-b392-d3ce8a9a56ba tempest-CinderUnicodeTest-2085134074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0b304b49-81d8-47a5-84f6-5c7eb25a8450'] {{(pid=82646) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 20:14:54 devstack cinder-volume[82646]: DEBUG oslo_concurrency.lockutils [None req-9c121e05-f8aa-4726-b392-d3ce8a9a56ba tempest-CinderUnicodeTest-2085134074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 20:14:54 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-9c121e05-f8aa-4726-b392-d3ce8a9a56ba tempest-CinderUnicodeTest-2085134074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 20:14:54 devstack sudo[90868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb
Apr 15 20:14:54 devstack sudo[90868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 20:14:54 devstack sudo[90868]: pam_unix(sudo:session): session closed for user root
Apr 15 20:14:54 devstack cinder-volume[82646]: DEBUG oslo_concurrency.processutils [None req-9c121e05-f8aa-4726-b392-d3ce8a9a56ba tempest-CinderUnicodeTest-2085134074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5a585ca397ec04557145889bf8fb89eb" returned: 0 in 0.455s {{(pid=82646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 20:14:54 devstack cinder-volume[82646]: DEBUG cinder.manager [None req-9c121e05-f8aa-4726-b392-d3ce8a9a56ba tempest-CinderUnicodeTest-2085134074 None] Notifying Schedulers of capabilities ... {{(pid=82646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 20:14:54 devstack cinder-volume[82646]: INFO cinder.volume.manager [None req-9c121e05-f8aa-4726-b392-d3ce8a9a56ba tempest-CinderUnicodeTest-2085134074 None] Deleted volume successfully.
Apr 15 20:14:54 devstack cinder-volume[82646]: DEBUG cinder.coordination [None req-9c121e05-f8aa-4726-b392-d3ce8a9a56ba tempest-CinderUnicodeTest-2085134074 None] Lock "cinder-b7b1b2f0-afc4-4e0a-8458-3fa7f941f951-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=82646) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 20:15:04 devstack cinder-volume[82646]: DEBUG dbcounter [-] [82646] Writing DB stats cinder:SELECT=10,cinder:INSERT=8,cinder:UPDATE=18,cinder:DELETE=1 {{(pid=82646) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 20:15:04 devstack cinder-volume[82646]: DEBUG dbcounter [-] [82646] Writing DB stats cinder:UPDATE=13,cinder:SELECT=6,cinder:DELETE=1 {{(pid=82646) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}